Next Gen Software Solutions LLC ยท 3 weeks ago
Sr Databricks Engineer with Python | Contract W2
Next Gen Software Solutions LLC is a trusted provider of IT Staffing and consulting services dedicated to empowering businesses with cutting-edge technology solutions. They are looking for a Senior Data Engineer with strong experience in Databricks and Pyspark to design, build, and optimize scalable data pipelines while collaborating with analytics, product, and engineering teams.
Responsibilities
Design and build ETL/ELT pipelines using Databricks and Pyspark
Develop and maintain data models and data warehouse structures (dimensional modeling, star/snowflake schemas)
Optimize data workflows for performance, scalability, and cost
Work with cloud platforms (Azure/AWS/GCP) for storage, compute, and orchestration
Ensure data quality, reliability, and security across pipelines
Collaborate with cross-functional teams (Data Science, BI, Product)
Write clean, reusable code and follow engineering best practices
Troubleshoot issues in production data pipelines
Qualification
Required
Strong hands-on skills in Databricks, Pyspark, and SQL
Experience with data warehouse concepts, ETL frameworks, batch/streaming pipelines
Solid understanding of Delta Lake and Lakehouse architecture
Experience with at least one cloud platform (Azure preferred)
Experience with workflow orchestration tools (Airflow, ADF, Prefect, etc.)
Strong communication and documentation skills
Ability to work independently and mentor others
Problem-solver with a focus on delivering business value
Preferred
Experience with CI/CD for data pipelines
Knowledge of data governance tools (Unity Catalog or similar)
Exposure to ML data preparation pipelines
Company
Next Gen Software Solutions LLC
๐น Welcome to NextGen Software Solutions Where innovation meets precision. Growth meets impact.
H1B Sponsorship
Next Gen Software Solutions LLC has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (17)
2024 (31)
2023 (15)
2022 (29)
2021 (13)
2020 (2)
Funding
Current Stage
Growth StageCompany data provided by crunchbase