107 applicants

Company

Accion Labs · 8 hours ago

Databricks Engineer

United States

Contract

Remote

Senior Level, Lead/Staff

$100K/yr - $140K/yr

10+ years exp

Maximize your interview chances

Big DataBusiness Intelligence

H1B Sponsor Likely

Hiring Manager

Praveen kumar

Insider Connection @Accion Labs

Discover valuable connections within the company who might provide insights and potential referrals.
Get 3x more responses when you reach out via email instead of LinkedIn.

Responsibilities

Design and Architecture of Databricks Lakehouse :

Architect and implement end-to-end Databricks Lakehouse solutions.

Design and implement data lakehouse layers (bronze, silver, gold).

Databricks Setup and Installation :

Setup and install Databricks environments in Azure .

Setup Business Continuity (BC) and Disaster Recovery (DR) environments for Databricks.

Unity Catalog :

Implement Unity Catalog for centralized data governance.

Workspace & Cluster Management :

Create and manage Databricks workspaces, access controls, and compute clusters.

Delta Lake & Delta Live Tables :

Implement and manage Delta Lake and Delta Live Tables .

Metadata-Driven Data Ingestion :

Design and implement a metadata-driven data ingestion framework.

PySpark Expertise :

Utilize advanced PySpark programming for data cleansing and transformation tasks.

Airflow Installation and Management :

Setup and install Airflow , and create DAGs to trigger pipelines.

Automation & Optimization :

Implement automation, optimization, and scaling techniques to ensure efficient pipeline performance.

Qualification

Find out how your skills align with this job's requirements. If anything seems off, you can easily click on the tags to select or unselect skills to reflect your actual expertise.

Databricks Lakehouse DesignAzure DatabricksPySparkData Quality FrameworkEntity ResolutionData IngestionDelta LakeAirflowAutomation SolutionsDatabricks CertificationData ArchitectureProblem-Solving MindsetCollaborative Team Player

Required

Design and Architecture of Databricks Lakehouse

Azure Databricks

Pyspark

Entity Resolution

Data Quality Framework

Data Ingestion

Excellent communication skills

Databricks Certification: Strong preference for Databricks certified professionals

10-15 years of experience in data architecture, engineering, and implementation

Expertise in Azure Databricks implementations and PySpark programming

Proven experience in implementing Delta Lake, Airflow, and automation solutions

Strong interpersonal skills to interact with business stakeholders and technical teams

Ability to think independently and execute projects with minimal oversight

Bachelor's degree in Computer Science or a related field

Preferred

Innovative thinking with a strong problem-solving mindset

Self-starters who can take ownership of projects and deliver high-quality solutions

Collaborative team players who can coordinate effectively within cross-functional teams

Benefits

Comprehensive benefits package

Accion covering 65% of the medical, dental, and Vision Premiums for employees, their spouses, and dependent children enrolling in the Accion-provided plans.

Company

Accion Labs

Glassdoor

4.0

Accion Labs is a global services technology firm focused on building and transforming software products through emerging technologies.

Founded in 2011

Bridgeville, Pennsylvania, USA

1,001-5,000 employees

https://www.accionlabs.com/

H1B Sponsorship

Accion Labs has a track record of offering H1B sponsorships. Please note that this does not guarantee sponsorship for this specific role. Below presents additional info for your reference. (Data Powered by US Department of Labor)

Distribution of Different Job Fields Receiving Sponsorship

Represents job field similar to this job

Trends of Total Sponsorships

2023 (24)

2022 (22)

2021 (29)

2020 (42)