Senior Data Engineer- Databricks jobs in United States
cer-icon
Apply on Employer Site
company-logo

Risepoint · 7 hours ago

Senior Data Engineer- Databricks

Risepoint is an education technology company that provides world-class support and trusted expertise to more than 100 universities and colleges. The role involves building reliable, scalable data pipelines on Databricks, implementing cloud-native architectures, and collaborating with data teams to support AI and machine learning initiatives.

EducationHigher EducationUniversities
check
H1B Sponsor Likelynote

Responsibilities

The ideal candidate will have a strong background in building scalable data pipelines, optimizing big data workflows, and integrating Databricks with cloud services
This role will play a pivotal part in enabling the customer’s data engineering and analytics initiatives—especially those tied to AI-driven solutions and projects—by implementing cloud-native architectures that fuel innovation and sustainability
Partner directly with the customer’s data engineering team to design and deliver scalable, cloud-based data solutions
Execute complex ad-hoc queries using Databricks SQL to explore large lakehouse datasets and uncover actionable insights
Leverage Databricks notebooks to develop robust data transformation workflows using PySpark and SQL
Design, develop, and maintain scalable data pipelines using Apache Spark on Databricks
Build ETL/ELT workflows with AWS and Azure Services
Optimize Spark jobs for both performance and cost within the customer’s cloud infrastructure
Collaborate with data scientists, ML engineers, and business analysts to support AI and machine learning use cases, including data preparation, feature engineering, and model operationalization
Contribute to the development of AI-powered solutions that improve operational efficiency, route optimization, and predictive maintenance in the waste management domain
Implement CI/CD pipelines for Databricks jobs using GitHub Actions, Azure DevOps, or Jenkins
Ensure data quality, lineage, and compliance through tools like Unity Catalog, Delta Lake, and AWS Lake Formation
Troubleshoot and maintain production data pipelines
Provide mentorship and share best practices with both internal and customer teams

Qualification

DatabricksApache SparkPythonAWSAzureSQLPySparkData LakehouseCI/CDAnalytical skillsCollaboration skillsDocumentation skillsMentoring

Required

Bachelor's degree in computer science, Engineering, or a related field
5+ years of experience in software/data engineering, including at least 2 years working with Databricks and Apache Spark
Strong proficiency in Python, SQL, and PySpark
Deep understanding of AWS and Azure Cloud service
Experience with Databricks Data LakeHouse, Databricks Workflows, and Databricks SQL, dbt
Solid grasp of data Lakehouse and warehousing architecture
Prior experience supporting AI/ML workflows, including training data pipelines and model deployment support
Familiarity with infrastructure-as-code tools like Terraform or CloudFormation
Strong analytical and troubleshooting skills in a fast-paced, agile environment
Excellent collaboration skills for interfacing with both technical and non-technical customer stakeholders
Clear communicator with strong documentation habits
Comfortable leading discussions, offering strategic input, and mentoring others

Company

Risepoint

twittertwitter
company-logo
Risepoint partners with universities to create online degree programs and offers recruitment marketing and admissions services.

H1B Sponsorship

Risepoint has a track record of offering H1B sponsorships. Please note that this does not guarantee sponsorship for this specific role. Below presents additional info for your reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (1)
2024 (3)

Funding

Current Stage
Late Stage
Company data provided by crunchbase