Arctiq · 3 hours ago
Senior Data Engineer
Arctiq is a leader in professional IT services and managed services, and they are seeking a Senior Data Engineer to lead the development of scalable data pipelines within the Databricks ecosystem. The role involves architecting robust ETL/ELT processes and ensuring the data lakehouse is governed, performant, and production-ready.
Cloud ComputingConsultingEnterprise SoftwareNetwork SecurityVirtualization
Responsibilities
Pipeline Architecture: Design and implement declarative data pipelines using Lakeflow and Databricks Asset Bundles (DABs) to ensure seamless CI/CD
Data Ingestion: Build efficient, scalable ingestion patterns using AutoLoader and Change Data Capture (CDC) to handle high-volume data streams
Governance & Security: Manage metadata, lineage, and access control through Unity Catalog
Orchestration: Develop and maintain complex workflows using Databricks Jobs and orchestration tools
Infrastructure as Code: (Asset) Utilize Terraform to manage AWS resources (S3, EC2) and Databricks workspaces
Qualification
Required
Deep mastery of PySpark and advanced SQL
Extensive experience in the Databricks environment (Workflows, Delta Lake)
Familiarity with AWS infrastructure and cloud-native data patterns
Company
Arctiq
Arctiq is a leader in professional IT services and managed services across three practices: Enterprise Security, Modern Infrastructure and Platform Engineering.
H1B Sponsorship
Arctiq has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2021 (1)
2020 (3)
Funding
Current Stage
Public CompanyTotal Funding
unknownKey Investors
Gallant Capital Partners
2023-08-15Post Ipo Equity
2012-01-11IPO
Recent News
Company data provided by crunchbase