Tata Consultancy Services · 17 hours ago
Databricks Engineer
Tata Consultancy Services is seeking a Databricks Engineer to design and develop ETL/ELT pipelines using Azure Databricks and Apache Spark. The role involves integrating data from multiple sources, optimizing data workflows, and ensuring compliance with data governance and security standards.
Business Information SystemsConsultingInformation TechnologyIT Management
Responsibilities
Design and develop ETL/ELT pipelines using Azure Databricks and Apache Spark
Integrate data from multiple sources into the data lake and data warehouse environments
Optimize data workflows for performance and cost efficiency in cloud environments (Azure/AWS/GCP)
Implement data quality checks, monitoring, and alerting for pipelines
Collaborate with data scientists and analysts to provide clean, curated datasets
Ensure compliance with data governance, security, and privacy standards
Automate workflows using CI/CD pipelines and orchestration tools (e.g., Airflow, Azure Data Factory)
Troubleshoot and resolve issues in data pipelines and platform components
Qualification
Required
5+ years of experience in data engineering or similar roles
Strong expertise in Databricks, Apache Spark, and PySpark
Proficiency in SQL, Python, and data modeling concepts
Experience with cloud platforms (Azure preferred; AWS/GCP is a plus)
Knowledge of Delta Lake, Lakehouse architecture, and partitioning strategies
Familiarity with data governance, security best practices, and performance tuning
Hands-on experience with version control (Git) and CI/CD pipelines
Benefits
Discretionary Annual Incentive.
Comprehensive Medical Coverage: Medical & Health, Dental & Vision, Disability Planning & Insurance, Pet Insurance Plans.
Family Support: Maternal & Parental Leaves.
Insurance Options: Auto & Home Insurance, Identity Theft Protection.
Convenience & Professional Growth: Commuter Benefits & Certification & Training Reimbursement.
Time Off: Vacation, Time Off, Sick Leave & Holidays.
Legal & Financial Assistance: Legal Assistance , 401K Plan, Performance Bonus, College Fund, Student Loan Refinancing.
Company
Tata Consultancy Services
Tata Consultancy Services is a business solutions company that specializes on information technology services and consulting.
H1B Sponsorship
Tata Consultancy Services has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (7880)
2024 (9690)
2023 (8537)
2022 (11159)
2021 (9813)
2020 (11984)
Funding
Current Stage
Public CompanyTotal Funding
unknown2004-08-25IPO
Leadership Team
Recent News
Hindu Business Line
2026-01-16
TradingView
2026-01-16
Company data provided by crunchbase