NTT DATA North America · 9 hours ago
Databricks Engineer
United States
Full-time
Remote
Mid, Senior Level
4+ years expNTT DATA is a business and technology services leader, and they are seeking a Databricks Engineer to join their team. The role involves developing and optimizing Databricks workflows and integrating various Azure services to enhance data processing and analytics.
ConsultingDigital MarketingInformation ServicesInformation TechnologyIT Management
Responsibilities
Develop Databricks notebooks, jobs, and workflows to replicate and enhance Yellowbricks-based pipelines and transformations
Implement Delta Lake tables and patterns (bronze/silver/gold, ACID, time travel, schema evolution) for migrated data
Translate legacy SQL and ETL logic from Yellowbricks into PySpark/SQL in Databricks
Integrate Databricks with Azure ADLS, ADF/Synapse, Key Vault, and Snowflake as required
Optimize Databricks clusters, jobs, and queries for performance and cost
Implement incremental loads, CDC patterns, and batch schedules for large datasets
Collaborate with Snowflake and dbt teams to ensure consistent data models and data contracts
Participate in data validation and reconciliation between Yellowbricks and Databricks outputs
Follow coding standards, version control, and CI/CD practices using Git/Azure DevOps
Provide defect fixes and support during SIT/UAT and post go-live stabilization
Qualification
Required
4–7 years of experience in Data Engineering / Big Data, with 2+ years on Databricks (Azure preferred)
Strong skills in PySpark, Spark SQL, and Python in a Databricks context
Hands-on experience with Delta Lake and lakehouse concepts
Experience with Git, CI/CD, and DevOps practices
Develop Databricks notebooks, jobs, and workflows to replicate and enhance Yellowbricks-based pipelines and transformations
Implement Delta Lake tables and patterns (bronze/silver/gold, ACID, time travel, schema evolution) for migrated data
Translate legacy SQL and ETL logic from Yellowbricks into PySpark/SQL in Databricks
Integrate Databricks with Azure ADLS, ADF/Synapse, Key Vault, and Snowflake as required
Optimize Databricks clusters, jobs, and queries for performance and cost
Implement incremental loads, CDC patterns, and batch schedules for large datasets
Collaborate with Snowflake and dbt teams to ensure consistent data models and data contracts
Participate in data validation and reconciliation between Yellowbricks and Databricks outputs
Follow coding standards, version control, and CI/CD practices using Git/Azure DevOps
Provide defect fixes and support during SIT/UAT and post go-live stabilization
Preferred
Good understanding of Azure services: ADLS, ADF/Synapse pipelines, Key Vault, Functions/Logic Apps
Experience migrating or re-platforming from legacy DW/MPP systems to Databricks
Familiarity with Snowflake, dbt, and Informatica
Company
NTT DATA North America
NTT DATA, Inc. is a trusted global innovator of business and technology services.
10001+ employees
H1B Sponsorship
NTT DATA North America has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (144)
2024 (182)
2023 (257)
2022 (871)
2021 (809)
2020 (1266)
Funding
Current Stage
Late StageLeadership Team
John Barr
Vice President - Insurance Strategy
Recent News
2025-12-05
Company data provided by crunchbase