Apply on Employer Site

Mindlance · 13 hours ago

Lead Data Engineer

Boston, MA

Contract

Hybrid

Senior Level, Lead/Staff

$70/hr - $80/hr

Mindlance is seeking a Lead Data Engineer for a hybrid role in Boston, MA. The primary responsibilities include designing and maintaining data pipelines, managing relational databases, and ensuring data quality and security while collaborating with cross-functional teams.

Human Resources

No H1B

Hiring Manager

★ Nitesh Kumar Nihale

Responsibilities

Data Pipeline Development: Design, implement, and maintain robust, scalable, and efficient data pipelines using Jenkins for automated data extraction, transformation, and loading (ETL) processes

Relational Database Management: Manage and optimize relational databases (e.g., MySQL, PostgreSQL) to ensure data integrity, availability, and performance for diverse applications and analytical purposes

API Integration: Collaborate with software developers to integrate data from various sources through APIs, ensuring seamless data flow between systems and applications

Data Modeling and Architecture: Create and maintain data models and data architecture to support analytics and reporting needs, ensuring data consistency and proper documentation

Data Analysis and Insights: Utilize Python and RDS to perform advanced data analysis, interpret complex data sets, and deliver actionable insights to key stakeholders and decision-makers

Performance Optimization: Identify and resolve performance bottlenecks within data pipelines, databases, and queries to improve system efficiency and response times

Data Quality Assurance: Implement data quality checks and validation processes to ensure the accuracy and reliability of data throughout the data ecosystem

Data Security and Compliance: Maintain data security standards and compliance with data protection regulations, implementing necessary measures to safeguard sensitive information

Collaboration and Communication: Work closely with cross-functional teams, including data scientists, business analysts, and IT, to understand data requirements, develop solutions, and present findings effectively

Qualification

Data Pipeline DevelopmentRelational Database ManagementAPI IntegrationData ModelingArchitecturePythonJenkinsCloud TechnologiesData Quality AssuranceData SecurityData VisualizationCollaborationCommunicationProblem-solving

Required

Bachelor's degree or relevant experience in Computer Science, Data Science, Information Technology, or a related field

Proven experience as a Data Engineer, Data Analyst, or a related role with a strong technical background in Jenkins, Relational Databases, APIs, Python, and RDS

Solid understanding of data modeling, database design principles, and data warehousing concepts

Proficiency in programming languages like Python, SQL, and RDS for data manipulation, analysis, and automation tasks

Familiarity with cloud-based technologies, such as AWS, GCP, or Azure, and the ability to leverage cloud services for data management

Experience with Jenkins for automated build, test, and deployment processes

Strong problem-solving skills and the ability to troubleshoot data-related issues efficiently

Excellent communication and collaboration skills to work effectively in a team-oriented environment

A passion for data-driven decision-making and a keen eye for detail

The client is looking for data-security experience within data engineering, not a traditional cybersecurity role

They want someone who has secured cloud-based ETL pipelines, handled IAM/RBAC, protected data in S3 and RDS, secured Jenkins pipelines, and implemented encryption, access controls, and basic compliance practices as part of their data engineering work