70 applicants

Company

Original Job Post

Pacific Northwest National Laboratory · 2 days ago

Azure Databricks Engineer

United States

Full-time

Hybrid

Mid Level

$125K/yr - $197K/yr

3+ years exp

Wonder how qualified you are to the job?

Maximize your interview chances

Biomass EnergyEnergy

Growth Opportunities

Insider Connection @Pacific Northwest National Laboratory

Discover valuable connections within the company who might provide insights and potential referrals, giving your job application an inside edge.

Responsibilities

Collaborate with internal teams and consultants to design and implement a modern data architecture using Azure Databricks.

Develop and maintain data pipelines in Data Factory and Databricks.

Create and maintain data models to support Power BI semantic layers.

Ensure data integration and warehousing needs for ERP systems are met efficiently.

Monitor and optimize data workflows to ensure performance and cost-effectiveness.

Provide technical guidance and support during the migration of data to the new architecture.

Ensure the security and compliance of data solutions in accordance with lab standards.

Create and follow best practices and standards for data engineering, including version control, code reviews, and documentation.

Stay updated with the latest developments in Azure and Databricks technologies and apply them to improve the architecture.

Troubleshoot and resolve issues with data pipelines and workflows.

Provide on-call and off-hours support as needed to ensure the continuous operation of data systems.

Work closely with business analysts and stakeholders to gather requirements and ensure data solutions meet business needs

Qualification

Find out how your skills align with this job's requirements. If anything seems off, you can easily click on the tags to select or unselect skills to reflect your actual expertise.

Software DevelopmentArchitectingProgrammingScientific ResearchConsumer Digital Product DevelopmentProblem-SolvingCommunicationTeamworkAzure DatabricksAzure Data FactoryData WarehousingETL ProcessesPower BIPythonSQLScala

Required

BS/BA and 5 years of relevant experience -OR-

MS/MA or higher and 3 years of relevant experience -OR-

PhD and 1 year of relevant experience -OR-

AA and 14 years of relevant experience -OR-

HS/GED and 16 years of relevant experience

Qualifying software development experience in designing, architecting, programming, deploying, and automating software solutions in support of scientific research or consumer digital product development may be counted

Preferred

Proven experience with Azure Databricks and Data Factory (Azure or Fabric), certifications are a plus (e.g., Databricks Certified Data Engineer Associate/Professional)

Strong understanding of data warehousing principles and ETL processes

Experience with supporting Power BI use cases

Proficiency in programming languages such as Python, SQL, and Scala