Cynet Systems · 3 days ago
Senior Databricks Developer
Nashville, TN
Full-time
Onsite
Senior LevelCynet Systems is seeking a Senior Databricks Developer to lead the design, development, and optimization of large-scale data solutions using Azure Databricks and Apache Spark. The role involves building scalable cloud-based data engineering solutions and supporting enterprise data platforms while collaborating with engineering teams.
EmploymentRecruitingStaffing Agency
Responsibilities
Architect, design, and build large-scale ETL and ELT data pipelines using Databricks with PySpark and Spark SQL
Optimize Spark code, cluster usage, and Delta Lake pipelines to improve performance and efficiency
Implement Delta Lake capabilities including transactional integrity, schema evolution, and data versioning
Lead the migration of legacy or on-premise data workloads to Azure Databricks
Design data models, ensure data integrity, and support governance using catalog and metadata frameworks
Build and orchestrate data workflows using orchestration tools and scheduling frameworks
Integrate Databricks solutions with cloud data storage, messaging, analytics, and security services
Conduct code reviews, mentor junior engineers, and enforce engineering standards and best practices
Troubleshoot and resolve production issues across Spark jobs, workflows, and pipelines
Collaborate with software engineering teams and contribute to service integration when needed
Qualification
Required
Strong hands-on expertise with PySpark, Spark SQL, Apache Spark internals, and performance tuning
Deep understanding of Delta Lake, data versioning, and lakehouse architecture
Advanced SQL skills including complex queries, analytical functions, and optimization techniques
Experience integrating Databricks with cloud orchestration, storage, analytics, and messaging services
Hands-on experience with CI and CD pipelines and source control tools
Strong understanding of data modeling, distributed computing, and data security best practices
Ability to design scalable, reusable, and maintainable data engineering frameworks
Extensive experience in data engineering with multiple years of hands-on Azure Databricks development
Experience leading or contributing to enterprise-scale data platform implementations
Company
Cynet Systems
Headquartered in Washington DC Metro Area, Cynet Systems is a top talent supplier for companies across North America.
Founded in 2010
1001-5000 employees
Funding
Current Stage
Late StageLeadership Team
Ashwani (Ash) M.
Partner and Co-CEO
Nikhil "Nick" Budhiraja
Founder / Co-CEO
Company data provided by crunchbase