Data Trust · 18 hours ago
Deputy Director of Data Integrations
Data Trust is a company specializing in political data, providing a premier national voter file and consumer data inventories. The Deputy Director of Data Integrations is responsible for managing data ingestion and integration workflows, overseeing a team of data engineers, and ensuring the reliability and quality of data pipelines.
Big DataInformation TechnologyDatabaseData ManagementInformation Services
Responsibilities
Manage and support members of the data integration team, including performance reviews, goal setting, and professional development
Assist with interviewing, onboarding, and training new team members
Provide ongoing guidance and feedback to ensure consistent execution and quality
Oversee the ingestion and integration of multiple data sources into the lakehouse environment
Coordinate and maintain data pipelines using Azure Data Factory and Databricks Lakeflow Jobs
Monitor pipeline execution, troubleshoot issues, and escalate complex problems as needed
Ensure data quality, consistency, and auditability across integrated datasets
Apply established data integration standards, documentation practices, and coding guidelines
Support the implementation of data governance, security, and compliance requirements within pipelines
Identify operational improvements to AB/EV, voter file, and consumer data workflows
Ensure timely delivery of data products to cloud storage, data marts, and third-party platforms
Coordinate with data engineering, analytics, and operations teams to align schedules and dependencies
Provide regular status updates and technical explanations to managers and stakeholders
Participate in code reviews and provide technical input on data engineering tasks
Assist with ad hoc data projects and priority requests from leadership
Support off-hours or weekend work during peak processing periods as required
Qualification
Required
Bachelor's degree in data science, statistics, computer science, political science, or a related field
3+ years of experience with Databricks or Spark-based platforms
3+ years of SQL experience
2+ years of experience with Azure Data Factory or a similar orchestration tool
Prior experience managing or leading technical staff
Experience with Databricks or other Apache Spark–based platforms
Proficiency with Azure Data Factory or comparable orchestration tools
Working knowledge of Python, Scala, or similar data engineering languages
Understanding of lakehouse architecture and data modeling concepts
Familiarity with CI/CD and DevOps practices in a data environment
Strong organizational skills and ability to manage multiple priorities
Clear written and verbal communication skills for technical and non-technical audiences
Preferred
Familiarity with political, election, or campaign data preferred