eTeam · 20 hours ago
BDP Platform Engineer — Contractor Lead
eTeam is seeking a BDP Platform Engineer — Contractor Lead to lead and operate an Azure-based Big Data Platform using open-source tools. The role involves hands-on coding, onsite-offshore coordination, and building reusable ETL frameworks to ensure reliable operations.
Information Technology
Responsibilities
Design, build, and run Azure data platform components with reliability, security, and cost efficiency
Develop reusable ETL/ELT libraries; standardize ingestion, transformation, testing, and deployment
Author/maintain Airflow DAGs; implement and optimize Spark jobs; manage SLAs, retries, autoscaling
Establish handoffs, runbooks, and cadences; lead release orchestration and incident response
Build pipelines (GitHub Actions/Azure DevOps) and provision infra (HelmCharts) across environments
Implement logging/metrics/tracing; enforce IAM/RBAC, secrets (Key Vault), and compliance
Qualification
Required
4-8+ years in platform/data engineering with production ownership
Experience with Azure: ADLS Gen2, AKS, ACR, Event Hubs/Service Bus, Key Vault; Databricks or Synapse
Experience with open source tools: Airflow, Apache Spark, Hive (metastore, table formats); strong SQL
Proficient in Python, Scala, and Java
Experience with DevOps/IaC: GitHub Actions/Azure DevOps; Terraform or Bicep; Docker/Kubernetes (AKS)
Proven leadership across time zones; vendor/stakeholder management; clear communication and documentation
Preferred
Delta Lake
Iceberg
Company
eTeam
eTeam is a staffing agency that also provides payrolling services.
H1B Sponsorship
eTeam has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (36)
2024 (205)
2023 (11)
2022 (7)
2021 (24)
2020 (25)
Funding
Current Stage
Late StageTotal Funding
unknown2023-12-04Acquired
Recent News
2025-11-19
2025-08-21
Company data provided by crunchbase