Senior Data Engineer jobs in United States
cer-icon
Apply on Employer Site
company-logo

Arctiq · 4 hours ago

Senior Data Engineer

Arctiq is a leader in professional IT services and managed services, and they are seeking a Senior Data Engineer to lead the development of scalable data pipelines within the Databricks ecosystem. The role involves architecting robust ETL/ELT processes and ensuring the data lakehouse is governed, performant, and production-ready.

Cloud ComputingConsultingEnterprise SoftwareNetwork SecurityVirtualization
check
H1B Sponsor Likelynote

Responsibilities

Pipeline Architecture: Design and implement declarative data pipelines using Lakeflow and Databricks Asset Bundles (DABs) to ensure seamless CI/CD
Data Ingestion: Build efficient, scalable ingestion patterns using AutoLoader and Change Data Capture (CDC) to handle high-volume data streams
Governance & Security: Manage metadata, lineage, and access control through Unity Catalog
Orchestration: Develop and maintain complex workflows using Databricks Jobs and orchestration tools
Infrastructure as Code: (Asset) Utilize Terraform to manage AWS resources (S3, EC2) and Databricks workspaces

Qualification

PySparkSQLDatabricksAWSData GovernanceInfrastructure as Code

Required

Deep mastery of PySpark and advanced SQL
Extensive experience in the Databricks environment (Workflows, Delta Lake)
Familiarity with AWS infrastructure and cloud-native data patterns

Company

Arctiq

twittertwittertwitter
company-logo
Arctiq is a leader in professional IT services and managed services across three practices: Enterprise Security, Modern Infrastructure and Platform Engineering.

H1B Sponsorship

Arctiq has a track record of offering H1B sponsorships. Please note that this does not guarantee sponsorship for this specific role. Below presents additional info for your reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2021 (1)
2020 (3)

Funding

Current Stage
Public Company
Total Funding
unknown
Key Investors
Gallant Capital Partners
2023-08-15Post Ipo Equity
2012-01-11IPO
Company data provided by crunchbase