Apply on Employer Site

Infinitive · 4 months ago

Data Engineer (Databricks Experience)

McLean, VA

Full-time

Onsite

Senior Level

Infinitive is a data and AI consultancy that helps clients modernize and operationalize their data. They are seeking a highly skilled Senior Data Engineer to design, implement, and maintain data infrastructure while ensuring scalability, reliability, and efficiency.

AdvertisingInformation TechnologyInternetMarketing

No H1B

Responsibilities

Data Engineering: Design, build, and maintain scalable data pipelines and ETL processes using Databricks and other relevant technologies

DevOps Integration: Implement continuous integration and continuous deployment (CI/CD) pipelines using Jenkins and Terraform to automate deployment, monitoring, and scaling of data infrastructure

Data Modeling: Develop and implement data models based on business requirements, including 3NF, Dimensional, and Data Vault models. Ensure data models adhere to best practices for efficiency, scalability, and maintainability

Performance Optimization: Identify and address performance bottlenecks in data pipelines and queries. Optimize data processing and storage to improve overall system performance

Data Quality Assurance: Implement data quality checks and monitoring processes to ensure data accuracy, completeness, and consistency

Collaboration: Work closely with cross-functional teams including data scientists, analysts, and software engineers to understand data requirements and deliver high-quality solutions

Documentation and Best Practices: Document data pipelines, infrastructure configurations, and data models. Define and enforce best practices for data engineering and DevOps processes

Training and Mentorship: Provide guidance and mentorship to junior team members. Conduct training sessions to promote knowledge sharing and skill development within the team