ExecutivePlacements.com · 5 hours ago
Databricks Data Engineer - REMOTE
United States
Full-time
Remote
Mid, Senior Level
5+ years expExecutivePlacements.com is seeking a Databricks Data Engineer to develop and support data pipelines and analytics environments within an Azure cloud-based data lake. The role involves translating business requirements into scalable data engineering solutions and maintaining high standards for data quality and performance.
Human ResourcesOnline PortalsRecruiting
Responsibilities
Design, build, and optimize scalable data solutions using Databricks and Medallion Architecture
Develop and manage ingestion pipelines for structured, unstructured, and streaming data, processing multi-terabyte datasets across multiple projects and Databricks workspaces
Integrate data from diverse sources to enable high-quality analytics and business insights
Ensure data integrity, availability, and accessibility through effective data management practices
Identify and implement cost-optimization strategies for data storage, processing, and analytics
Monitor and support platform operations, including cluster stability, Spark performance tuning, and configuration management
Respond to user and client requests, resolving platform, performance, and data issues
Collaborate with cross-functional teams to enable advanced AI-driven analytics and data science workflows
Integrate Databricks with Azure services such as Azure Data Factory, Azure Functions, Azure Storage, Log Analytics, and user management tools
Provision and manage cloud infrastructure using Infrastructure-as-Code (IaC)
Apply best practices for data security, governance, and compliance, including support for federal regulations and public trust standards
Translate business and technical requirements into well-documented data architectures and solutions
Qualification
Required
Bachelors degree in computer science or a related field with + years of experience, or a masters degree with + years of experience
+ years of experience designing and developing data ingestion pipelines with built-in data quality checks on cloud platforms
Databricks Data Engineer certification and + years of hands-on Databricks and Apache Spark experience
Strong proficiency in Python and Spark (R experience required; .NET experience is a plus)
Experience supporting clients directly and serving as a front-line technical resource
Ability to clearly document solutions using architecture and interface diagrams
Strong understanding of data governance concepts, including metadata management, data catalogs, data quality frameworks, and data security
Experience working in Agile environments, with exposure to CI/CD automation and cloud-based development (Azure preferred; AWS a plus)
Benefits
Medical
Dental
Vision
Flexible Spending Account (FSA)
Dependent Care Savings Account (DCA)
K plan
Paid Sick Leave as required by Federal, State, or local laws
Company
ExecutivePlacements.com
Online recruitment
11-50 employees
Funding
Current Stage
Early StageCompany data provided by crunchbase