Datum Technologies Group · 2 weeks ago
US - Software Engineer III
Alpharetta, GA
Full-time
Hybrid
Mid Level
3+ years expDatum Technologies Group is seeking a skilled Software Engineer to support and enhance their Databricks-based data platform. The role focuses on building and validating reliability patterns during development and requires collaboration with Data Engineering teams to ensure scalable and efficient solutions.
Information TechnologyRecruitingStaffing Agency
Responsibilities
Develop, maintain, and optimize Databricks notebooks, jobs, and workflows
Write and enhance PySpark and Python code for efficient data processing
Design scalable and reliable data pipelines
Apply Spark best practices including partitioning, caching, joins, and file sizing
Work with Delta Lake tables and data models
Perform data validation and quality checks during development
Support cluster configuration and sizing for development workloads
Identify performance bottlenecks early and recommend improvements
Collaborate with Data Engineers to prepare solutions for future production deployment
Document development standards, patterns, and best practices
Qualification
Required
3+ years hands-on in Databricks and Spark ecosystems
Hands-on experience with Databricks
Strong knowledge of PySpark and Spark fundamentals
Experience with Delta Lake
Understanding of Spark execution concepts (jobs, stages, tasks)
Strong Python development skills
Ability to write clean, modular, and reusable code
Experience using Git and version control
Familiarity with Databricks Repos or similar workflows
Ability to perform basic testing and validation of data pipelines
Bachelor's degree required
Preferred
Experience with Microsoft Azure
Familiarity with Azure Databricks, Azure Data Lake Storage (ADLS), and Azure Blob Storage
Basic understanding of cloud resource usage and cost awareness
Experience with Spark SQL
Exposure to CI/CD pipelines for data platforms
Knowledge of Infrastructure as Code (Terraform, ARM)
Familiarity with Azure Monitor or Log Analytics
Interest in advancing development work toward production reliability
Master's degree preferred
Company
Datum Technologies Group
Datum Technologies Group provides technology solutions, managed services, government contracting, and IT staffing services.
201-500 employees
H1B Sponsorship
Datum Technologies Group has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (1)
2024 (4)
2023 (13)
2022 (10)
2021 (22)
2020 (20)
Funding
Current Stage
Growth StageLeadership Team
Latha Ganeshan
CEO & President
Alton Bunn Jr
AOC OSC Network Administrator
Company data provided by crunchbase