Principal Specialist - Databricks Developer jobs in United States
cer-icon
Apply on Employer Site
company-logo

Energy Transfer · 6 hours ago

Principal Specialist - Databricks Developer

Energy Transfer, recognized by Forbes as one of America's best large employers, is dedicated to responsibly and safely delivering America’s energy. The Principal Specialist - Databricks Developer will design and implement data solutions, maintain data pipelines, and collaborate with cross-functional teams to enhance the BI landscape within the company.

EnergyOil and GasRenewable Energy
check
H1B Sponsor Likelynote
Hiring Manager
Cheryl Krey, PHR
linkedin

Responsibilities

Design and implement end-to-end data solutions using Microsoft Azure Data Factory (ADF) and Azure Data Lake Storage (ADLS), Azure Databricks, Power BI/Fabric
Develop, monitor, and maintain scalable data pipelines to support analytics and data science projects
Utilize Azure Databricks to perform complex data transformation, aggregation, and machine learning tasks
Assist with designing the architecture and workflow for an Enterprise Data Warehouse in Databricks that leverages a growing Citizen Development population who wish to build their own Data Marts
Maintain and enhance existing ETL Pipelines, Warehouses, and Reporting leveraging traditional MS SQL Stack
Primarily SQL Server, SSIS, and SSRS
Assist with server and system administration of On-Prem BI infrastructure such as Power BI/Azure Gateway servers, Business Objects, Tableau, and SSRS
Collaborate with cross-functional teams to translate business needs into technical specifications and data models
Ensure data quality and integrity by implementing best practices and data governance standards
Provide ongoing support and enhancements to existing data structures and reporting environments
Stay current with industry trends and advancements in BI and data analytics technologies
Lead prototype efforts in various BI tools for capability assessment and demonstrations
Leverage AI tools to assist with the creation, maintenance, and updating of comprehensive documentation for all data solutions and processes
Implement and manage source control practices using GIT within Azure DevOps to ensure code integrity and facilitate collaboration
Participate in the development and maintenance of CI/CD pipelines for automated testing and deployment of BI solutions
Provide general support to BI customers, addressing queries and issues in a timely and effective manner

Qualification

Azure Data FactoryAzure DatabricksSQLETL processesData warehousingPython/SparkData visualizationProblem-solvingCommunicationTime-managementCollaboration

Required

Bachelor's degree in Computer Science, Management Information Systems, or related field
Minimum 3 years of experience in Databricks and Azure stack
Proficient in Azure Data Factory, Azure Data Lake Storage, and Azure Databricks
Skilled in Python/Spark
Understanding of cloud and distributed systems principles, including load balancing, networks, scaling etc
Minimum 3 years of experience in traditional SQL BI Stack
Strong understanding of SQL, data warehousing concepts, and ETL processes
Experience with data modeling, data visualization, and reporting tools
Ability to write clean, well-documented, and efficient code
Excellent problem-solving skills and attention to detail
Strong communication and collaboration skills to work effectively in a team environment
Must be able to work on multiple simultaneous tasks with limited supervision. Able to follow change management procedures and internal guidelines
Strong time-management skills, initiative, commitment, and ability to work under pressure to meet tight deadlines while maintaining high quality standards and best practices

Preferred

Experience in Oil & Gas industry, particularly Midstream
Experience warehousing or reporting against SAP/S4/HANA
Experience with consuming and developing REST API, JSON, XML, and/or JavaScript
Confidence in several programming languages such as R, Python, Scala, or Java, with the ability to pick up new languages and technologies quickly
ITIL Certification or experience using Remedy application is a plus

Benefits

Industry leading compensation
Comprehensive benefits
401(k) match with additional profit sharing
PTO
Abundant career opportunities

Company

Energy Transfer

company-logo
Energy Transfer LP (NYSE: ET) owns and operates one of the largest and most diversified portfolios of energy assets in the United States, with more than 125,000 miles of pipeline and associated energy infrastructure.

H1B Sponsorship

Energy Transfer has a track record of offering H1B sponsorships. Please note that this does not guarantee sponsorship for this specific role. Below presents additional info for your reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (12)
2024 (15)
2023 (7)
2022 (3)
2021 (4)
2020 (10)

Funding

Current Stage
Public Company
Total Funding
$17.24B
Key Investors
Stephens Group
2025-08-11Post Ipo Debt· $2B
2025-02-18Post Ipo Debt· $3B
2024-08-09Post Ipo Secondary· $611.57M

Leadership Team

T
Thomas Long
Co-Chief Executive Officer
linkedin
L
Leanne Campbell
Vice President Legal
linkedin
Company data provided by crunchbase