TwinStar Credit Union · 4 hours ago

Data Engineer 3

Lacey, WA

Full-time

Remote

Senior Level, Lead/Staff

$128K/yr - $192K/yr

9+ years exp

Maximize your interview chances

Banking

Growth Opportunities

No H1B

Insider Connection @TwinStar Credit Union

Discover valuable connections within the company who might provide insights and potential referrals.
Get 3x more responses when you reach out via email instead of LinkedIn.

Responsibilities

Designs, implements, and maintains scalable data pipelines using modern tools like Azure Data Factory.

Automates and orchestrates complex data workflows, ensuring reliability and fault tolerance.

Implements change data capture and master data management mechanisms for efficient data replication and synchronization.

Leverages streaming technologies for real-time data processing.

Administers and optimize databases to ensure high performance, availability, and data integrity.

Monitors and tunes database performance, including indexing, query optimization, and caching.

Implements data validation and cleansing pipelines using techniques like data profiling, constraint enforcement, and anomaly detection.

Develops data quality monitoring and alerting systems to ensure timely issue resolution.

Establishes data governance frameworks like Microsoft Purview and enforce data quality standards across the organization.

Collaborates with DevOps teams to establish CI/CD pipelines, infrastructure as code (Terraform, etc), and automated testing and deployment strategies for data pipelines.

Participates in the development and implementation of data governance policies, standards, and processes.

Ensures compliance with data privacy regulations and industry-specific standards.

Implements data security measures, such as encryption, access controls, and auditing mechanisms.

Mentors and provides guidance to junior data engineers, fostering their professional growth and skill development.

Contributes to knowledge-sharing initiatives by conducting training.

Develops and optimizes data pipelines for real-time data ingestion, processing, and analysis.

Leverages machine learning techniques for data quality monitoring, anomaly detection, and predictive maintenance.

All other duties as assigned.

Qualification

Find out how your skills align with this job's requirements. If anything seems off, you can easily click on the tags to select or unselect skills to reflect your actual expertise.

Azure Data FactoryData EngineeringSQLPythonETL processesAzure DatabricksData GovernanceData Science principlesAgile methodologiesScrum methodologiesAWS Data CertificationsAzure Cloud CertificationsData quality monitoringData security measuresDatabase programming languagesReal-time data processingPerformance tuningData replication mechanismsMachine learning techniques