Databricks Data Engineer jobs in United States
cer-icon
Apply on Employer Site
company-logo

Think Consulting · 6 hours ago

Databricks Data Engineer

Think Consulting is seeking a Databricks Data Engineer to develop and support new and existing data pipelines in an Azure cloud-based data lake. The role involves translating business requirements into data engineering solutions and maintaining ETL operations while ensuring data quality and management.

ConsultingInformation Technology
badNo H1BnoteU.S. Citizen Onlynote
Hiring Manager
Angie Clems
linkedin

Responsibilities

Develop/support new/existing data pipelines
Translate business requirements to data engineering solutions
Support continued maintenance of ETL operations
Development of new pipelines ensuring data quality and data management
Work directly with clients and act as front line support for requests coming in from clients
Clearly document and express the solution in form of architecture and interface diagrams

Qualification

DatabricksPythonSpark/PySparkETL operationsAzure cloudData governanceAgile methodologyCI/CD automationData qualityClient supportArchitecture diagrams

Required

BS degree in Computer Science or related field and 3+ years or Master's degree with 2+ years of experience
3+ years of experience developing and designing Ingestion flows (structured, streaming, and unstructured data) using cloud platform services with data quality
Databricks Data Engineer certification and 2+ years of experience maintaining Databricks platform and development in Spark
Ability to work directly with clients and act as front line support for requests coming in from clients. Clearly document and express the solution in form of architecture and interface diagrams
3+ years of experience with Python, Spark/PySpark and R are essential. .NET based development is a plus
Knowledge and experience with data governance, including metadata management, enterprise data catalog, design standards, data quality governance, and data security
Experience with Agile process methodology, CI/CD automation, and cloud-based developments (Azure, AWS)
Candidate must be a U.S. citizen
Fully Remote Position- Quarterly travel to Gaithersburg is required

Preferred

Not required, but additional education, certifications, and/or experience are a plus: Certifications in Azure cloud, Knowledge of FinOps principles and cost management

Company

Think Consulting

twittertwittertwitter
company-logo
Founded in 2004, Think is a national technology and operations management consulting practice, providing services to commercial customers as well as state/federal public customers.

Funding

Current Stage
Growth Stage

Leadership Team

leader-logo
Tony Gruebl
Chief Executive Officer
linkedin
leader-logo
Bob Holtkamp
Fractional CTO : Technology Sales Consultant, Education
linkedin
Company data provided by crunchbase