Think Consulting · 6 hours ago
Databricks Data Engineer
Think Consulting is seeking a Databricks Data Engineer to develop and support new and existing data pipelines in an Azure cloud-based data lake. The role involves translating business requirements into data engineering solutions and maintaining ETL operations while ensuring data quality and management.
Responsibilities
Develop/support new/existing data pipelines
Translate business requirements to data engineering solutions
Support continued maintenance of ETL operations
Development of new pipelines ensuring data quality and data management
Work directly with clients and act as front line support for requests coming in from clients
Clearly document and express the solution in form of architecture and interface diagrams
Qualification
Required
BS degree in Computer Science or related field and 3+ years or Master's degree with 2+ years of experience
3+ years of experience developing and designing Ingestion flows (structured, streaming, and unstructured data) using cloud platform services with data quality
Databricks Data Engineer certification and 2+ years of experience maintaining Databricks platform and development in Spark
Ability to work directly with clients and act as front line support for requests coming in from clients. Clearly document and express the solution in form of architecture and interface diagrams
3+ years of experience with Python, Spark/PySpark and R are essential. .NET based development is a plus
Knowledge and experience with data governance, including metadata management, enterprise data catalog, design standards, data quality governance, and data security
Experience with Agile process methodology, CI/CD automation, and cloud-based developments (Azure, AWS)
Candidate must be a U.S. citizen
Fully Remote Position- Quarterly travel to Gaithersburg is required
Preferred
Not required, but additional education, certifications, and/or experience are a plus: Certifications in Azure cloud, Knowledge of FinOps principles and cost management
Company
Think Consulting
Founded in 2004, Think is a national technology and operations management consulting practice, providing services to commercial customers as well as state/federal public customers.
Funding
Current Stage
Growth StageLeadership Team
Recent News
Company data provided by crunchbase