The Computer Merchant, LTD (TCM) · 1 day ago
Databricks Engineer
United States
Full-time
Remote
Mid Level
$60/hr - $65/hr
3+ years expThe Computer Merchant, LTD (TCM) is seeking a Databricks Data Engineer to develop and support data pipelines and analytics environments in Azure cloud-based data lakes. The role involves translating business requirements into data engineering solutions, ensuring data quality, and collaborating with teams to enable advanced analytics and data science workflows.
Consumer ElectronicsHuman ResourcesInformation TechnologyStaffing Agency
Responsibilities
Develop/support new/existing data pipelines and data analytics environments in Azure cloud-based data lake
Translate business requirements to data engineering solutions to support an enterprise scale Microsoft Azure based data analytics platform
Support continued maintenance of ETL operations and development of new pipelines ensuring data quality and data management
Design, build, and optimize scalable data solutions using Databricks and Medallion Architecture
Manage ingestion routines for processing multi-terabyte datasets efficiently for multiple projects simultaneously, where each project may have multiple Databricks workspaces
Integrate data from various structured and unstructured sources to enable high-quality business insights
Implement effective data management strategies to ensure data integrity, availability, and accessibility
Identify opportunities for cost optimization in data storage, processing, and analytics operations
Monitor and support user requests, addressing platform or performance issues, cluster stability, Spark optimization, and configuration management
Collaborate with the team to enable advanced AI-driven analytics and data science workflows
Integrate with various Azure services including Azure Functions, Storage Services, Data Factory, Log Analytics, and User Management for seamless data workflows
Qualification
Required
BS degree in Computer Science or related field and 3+ years or Master's degree with 2+ years of experience
3+ years of experience developing and designing Ingestion flows (structured, streaming, and unstructured data) using cloud platform services with data quality
Databricks Data Engineer certification and 2+ years of experience maintaining Databricks platform and development in Spark
Ability to work directly with clients and act as front line support for requests coming in from clients. Clearly document and express the solution in form of architecture and interface diagrams
Proficient at Python, Spark and R are essential. .NET based development is a plus
Knowledge and experience with data governance, including metadata management, enterprise data catalog, design standards, data quality governance, and data security
Experience with Agile process methodology, CI/CD automation, and cloud-based developments (Azure, AWS)
Preferred
Certifications in Azure cloud
Knowledge of FinOps principles and cost management
Benefits
Medical, dental and vision benefits
Dependent care flexible spending account
401(k) plan
Voluntary life/short term disability/whole life/term life/accident and critical illness coverage
Employee assistance program
Sick leave in accordance with regulation
Company
The Computer Merchant, LTD (TCM)
The Computer Merchant, LTD®, (TCM) is a Veteran-Owned, nationally recognized Information Technology & Software Engineering staffing and services firm.
501-1000 employees
H1B Sponsorship
The Computer Merchant, LTD (TCM) has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (1)
2024 (1)
Funding
Current Stage
Late StageLeadership Team
John Danieli
President & CEO
Recent News
2025-08-25
Company data provided by crunchbase