3Core Systems, Inc · 5 hours ago
Data Engineer
Orlando, Florida, United States
Full-time
Hybrid
Mid Level3Core Systems, Inc is seeking a Data Engineer with strong ETL experience to design, build, and support file-to-table data transformations using IBM InfoSphere DataStage. The role involves turning inbound file feeds into reliable SQL Server table loads while ensuring performance and error handling.
Information ServicesInformation TechnologySoftware
Responsibilities
Design, develop, and maintain IBM DataStage ETL jobs that ingest file feeds (CSV, fixed-width, delimited) and load curated destination tables in SQL Server
Build end-to-end ETL flows, including staging, transformations, validations, and publishing to downstream schemas
Perform source-to-target mapping and implement transformation logic based on business and technical requirements
Use common DataStage stages and patterns (e.g., Sequential File, Transformer, Lookup, Join/Merge, Aggregator, Sort, Funnel, Remove Duplicates), with attention to partitioning and parallel job design
Write, optimize, and tune SQL Server queries, stored procedures, and T?SQL scripts used in ETL workflows
Implement restartable and supportable jobs: parameterization, robust logging, reject handling, auditing columns, and reconciliation checks
Apply data quality controls (format checks, referential checks, null/duplicate checks, threshold checks) and produce clear exception outputs for remediation
Monitor and troubleshoot ETL runs using DataStage Director/Operations Console and SQL Server tooling; perform root-cause analysis and fix defects
Improve performance through job design tuning (partitioning strategy, sorting choices, buffering, pushdown where appropriate) and SQL tuning (indexes, statistics, set-based logic)
Participate in code reviews, testing, documentation, and release activities; maintain clear runbooks and operational procedures
Collaborate with business analysts, data modelers, QA, and production support to deliver stable pipelines
Qualification
Required
Hands-on IBM DataStage ETL development experience, including data mapping and transformation implementation
Strong SQL Server experience with advanced T-SQL (joins, window functions, CTEs, temp tables, indexing basics, query plans)
Solid understanding of file-based ingestion and parsing (CSV, fixed-width, headers/trailers, control totals, encoding, delimiters, quoting/escaping)
Experience designing ETL jobs with good operational characteristics: parameter-driven design, logging, error handling, restart/re-run strategy, and auditability
Ability to troubleshoot data issues end-to-end (source file ? stage tables ? target tables) and communicate findings clearly
Preferred
Experience with DataStage Parallel Jobs tuning (partitioning methods, collect/sort trade-offs, skew handling)
Familiarity with UNIX/Linux basics and shell scripting for orchestration and file handling
Experience with job scheduling/orchestration tools (e.g., Control-M, Autosys) and CI/CD practices
Knowledge of common warehousing patterns (incremental loads, slowly changing dimensions, surrogate keys, effective dating)
Experience with version control (Git) and structured promotion/release processes across environments (dev/test/prod)
Exposure to data governance practices (metadata, lineage, naming standards) and secure handling of sensitive data
Company
3Core Systems, Inc
Established in 2004, 3Core System is a certified small minority owned business providing ERP Systems Integration, AMS, IT Consulting and Staff Augmentation Services to Fortune 1000, SMB, and State, Local and Education (SLED) customers.
Founded in 2004
51-200 employees
H1B Sponsorship
3Core Systems, Inc has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (3)
2024 (1)
2023 (12)
2022 (9)
2021 (14)
2020 (25)
Funding
Current Stage
Growth StageLeadership Team
Navin Kandula
President & CEO
Company data provided by crunchbase