Apply on Employer Site

Divit Technologies, Inc. · 1 day ago

Databricks Engineer with Datastage expertise

Dallas, TX

Full-time

Hybrid

Mid Level

Divit Technologies, Inc. is focused on building scalable data solutions, and they are seeking a Databricks Engineer with expertise in Datastage. The role involves developing data pipelines, migrating legacy ETL tools, and ensuring data quality across Azure-based platforms.

Information Technology & Services

H1B Sponsor Likely

Hiring Manager

Abishek Surya RS

Responsibilities

Build scalable data pipelines using Azure Data Factory, Databricks, Spark, and SQL for enterprise data processing

Migrate legacy ETL tools such as SSIS, DataStage, Informatica, and MapReduce to modern Databricks PySpark pipelines

Design ELT frameworks using Spark SQL, Delta Lake, and Snowflake with Medallion architecture

Orchestrate end-to-end data workflows in ADF across on-prem, cloud, and API data sources

Optimize Spark jobs in Databricks to improve performance and reduce processing time

Develop robust data models and data marts in Snowflake for analytics and reporting

Integrate structured and semi-structured data into unified analytics platforms

Implement monitoring, error handling, and scheduling for reliable data pipelines

Use advanced Databricks capabilities including Lakeflow, Lakebridge, Lakeflow Connect, and Delta Live Tables(DLT)

Ensure data quality, governance, and scalability across Azure-based data platforms

Qualification

Azure Data FactoryDatabricksSparkSQLSnowflakeDataStageETL toolsData modelingData governanceError handling

Required