Apply on Employer Site

Apolis · 1 hour ago

Databricks Engineer | Local to Englewood Cliffs, NJ or New York City, NY

Englewood Cliffs, NJ

Full-time

Hybrid

Senior Level

$72/hr - $75/hr

5+ years exp

Apolis is a company seeking a Databricks Engineer to work onsite in Englewood Cliffs, NJ or New York City, NY. The role involves designing and implementing ETL/ELT pipelines using Databricks and Apache Spark, as well as collaborating with data scientists and analysts to deliver high-quality data solutions.

ConsultingEnterprise ApplicationsEnterprise Resource Planning (ERP)Information TechnologyIT InfrastructureIT ManagementMobileSoftwareWeb Hosting

Growth Opportunities

H1B Sponsor Likely

Responsibilities

5+ Years of Design and implement ETL/ELT pipelines using Databricks and Apache Spark

Strong proficiency in Python, SQL, and PySpark

Knowledge of Delta Lake, data lakehouse concepts, and streaming data

Familiarity with CI/CD pipelines, version control (Git), and DevOps practices

Understanding of data modeling, data warehousing, and performance tuning

Develop and maintain data lakehouse architectures for structured and unstructured data

Optimize data workflows for performance, scalability, and cost efficiency

Collaborate with data scientists, analysts, and business stakeholders to deliver high-quality data solutions

Monitor and troubleshoot data pipelines, ensuring reliability and accuracy

Integrate Databricks with cloud services (AWS, Azure, or GCP) and other enterprise systems

Hands-on experience with cloud platforms (AWS, Azure, or GCP)

Qualification

DatabricksApache SparkPythonSQLPySparkDelta LakeCI/CD pipelinesGitDevOps practicesData modelingData warehousingPerformance tuningCloud platformsAWSAzureGCPData lakehouseData workflowsMonitoringTroubleshootingCollaboration

Required