Divit Technologies, Inc. · 9 hours ago
Senior ETL Developer
Divit Technologies, Inc. is seeking a Senior ETL Developer to design, develop, and maintain ETL/ELT pipelines. The role involves migrating existing DataStage ETL processes to Databricks/Spark-based solutions and collaborating with various stakeholders to ensure data quality and performance optimization.
Responsibilities
Design, develop, and maintain ETL/ELT pipelines using Databricks (Apache Spark)
Develop and support IBM DataStage jobs for data extraction, transformation, and loading
Migrate existing DataStage ETL processes to Databricks/Spark-based solutions
Build scalable data pipelines using PySpark / Spark SQL
Optimize Spark jobs for performance, cost, and scalability
Work with structured and semi-structured data (CSV, JSON, Parquet, Avro)
Integrate data from multiple sources including RDBMS, APIs, files, and data warehouses
Implement data quality, validation, and reconciliation checks
Collaborate with data architects, business analysts, and stakeholders
Support production deployments , monitoring, and issue resolution
Follow Agile/Scrum methodologies and best practices
Qualification
Required
Design, develop, and maintain ETL/ELT pipelines using Databricks (Apache Spark)
Develop and support IBM DataStage jobs for data extraction, transformation, and loading
Migrate existing DataStage ETL processes to Databricks/Spark-based solutions
Build scalable data pipelines using PySpark / Spark SQL
Optimize Spark jobs for performance, cost, and scalability
Work with structured and semi-structured data (CSV, JSON, Parquet, Avro)
Integrate data from multiple sources including RDBMS, APIs, files, and data warehouses
Implement data quality, validation, and reconciliation checks
Collaborate with data architects, business analysts, and stakeholders
Support production deployments, monitoring, and issue resolution
Follow Agile/Scrum methodologies and best practices
Strong hands-on experience with Databricks
Apache Spark (PySpark / Spark SQL)
IBM DataStage (Parallel jobs, Sequencers, Job monitoring)
Experience with ETL/ELT design patterns
SQL – advanced querying and performance tuning
Data modeling concepts (Star/Snowflake schemas)
Company
Divit Technologies, Inc.
Divit Technologies Inc. specialises in AI & Automation, Data Science, DevOps Security, Quality Engineering, and IT Staffing Solutions.
H1B Sponsorship
Divit Technologies, Inc. has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (6)
2024 (1)
Funding
Current Stage
Growth StageCompany data provided by crunchbase