SWITS DIGITAL Private Limited · 11 hours ago
Senior Data Engineer
Spring, TX
Contract
Onsite
Senior LevelSWITS DIGITAL Private Limited is seeking a highly skilled Senior Data Engineer to lead the design, development, automation, and optimization of scalable data infrastructure. The ideal candidate will have expertise in Azure-based data platforms and will collaborate closely with cross-functional teams in an agile environment.
Information Technology & Services
Responsibilities
Design, build, and optimize scalable data pipelines using Databricks, Delta Lake, PySpark, Python, and SQL
Develop and maintain high-performance data solutions supporting AI/ML workloads, advanced analytics, and real-time data processing
Optimize data processing efficiency and storage through Lakehouse architecture best practices
Collaborate with data scientists, software engineers, product owners, and business stakeholders to translate business requirements into robust technical solutions
Implement and strengthen CI/CD pipelines, automation, and governance standards for enterprise data platforms
Ensure secure, reliable, and production-grade data workflows aligned with enterprise standards
Qualification
Required
Proven experience as a Senior Data Engineer in enterprise-scale environments
Strong hands-on experience with Azure cloud services
Expertise in Databricks, Delta Lake, and Snowflake
Advanced proficiency in PySpark, Python, and SQL
Strong experience designing and optimizing ETL/ELT pipelines
In-depth knowledge of Databricks Lakehouse architecture, including: Schema evolution, ACID transactions, Data quality enforcement, Cost and performance optimization for large-scale datasets
Experience implementing Bronze/Silver/Gold Lakehouse architectures
Strong understanding of data governance, data quality frameworks (e.g., Great Expectations), and performance tuning
Hands-on experience with CI/CD automation, version control, and testing frameworks for data pipelines
Experience working in Agile/Scrum environments
Strong analytical, problem-solving, and communication skills
Preferred
Oil & Gas domain experience is a plus
Company
SWITS DIGITAL Private Limited
At SWITS Digital Private Limited, we are driven by innovation, integrity, and a commitment to empowering businesses through technology.
Founded in 2024
51-200 employees
Funding
Current Stage
Growth StageCompany data provided by crunchbase