SRS Consulting Inc · 3 hours ago
Data Engineer - DBT
McLean, VA
Contract
Remote
Senior Level
7+ years exp
Maximize your interview chancesConsultingInformation Services
Insider Connection @SRS Consulting Inc
Get 3x more responses when you reach out via email instead of LinkedIn.
Responsibilities
Develop data pipelines for streaming and batch data processing needs to move data in and out of Snowflake data warehouse
Collaborate with engineering and DevOps team members to implement, test, deploy, and operate data pipelines and ETL solutions
Develop scripts to Extract, Load and Transform data and other utility functions
Hands-on experience with Snowflake, including schema design, query optimization, and data load techniques.
Strong experience with DBT, including model development, testing, and documentation.
Familiarity with ETL/ELT tools and processes
Troubleshoot issues such data load problems, transformation translation problems raised by team members, investigating and providing effective solutions
Optimize data pipelines, ETL processes, and data integrations for large-scale data analytics use cases
Ensure data quality, integrity, and governance standards are maintained in data processing workflows
Qualification
Find out how your skills align with this job's requirements. If anything seems off, you can easily click on the tags to select or unselect skills to reflect your actual expertise.
Required
Strong in Python, Snowflake
Develop data pipelines for streaming and batch data processing needs to move data in and out of Snowflake data warehouse
Collaborate with engineering and DevOps team members to implement, test, deploy, and operate data pipelines and ETL solutions
Develop scripts to Extract, Load and Transform data and other utility functions
Hands-on experience with Snowflake, including schema design, query optimization, and data load techniques.
Strong experience with DBT, including model development, testing, and documentation.
Familiarity with ETL/ELT tools and processes
Troubleshoot issues such data load problems, transformation translation problems raised by team members, investigating and providing effective solutions
Optimize data pipelines, ETL processes, and data integrations for large-scale data analytics use cases
Ensure data quality, integrity, and governance standards are maintained in data processing workflows
Bachelor's degree in Computer Science, Information Systems, or related field
7+ years of experience in building and maintaining data pipelines and ETL/ELT processes in data-intensive organizations
Design, build, and maintain scalable data pipelines using Snowflake and DBT.
Develop and manage ETL processes to ingest data from various sources into Snowflake.
Optimize and tune data pipelines for performance and cost efficiency.
Able to build data integrations and ingestion pipelines for streaming and batch data
Competence in Cloud database systems including 3+ years with Snowflake
Hands-on experience with data movement using Snowpipe, Snow SQL, etc.
Strong coding skills with Python and SQL for manipulating and analyzing data
Knowledge of data governance and data security best practices.
Hands-on experience with cloud platforms such as AWS and Google Cloud
Minimum 5 years of designing and implementing operational production grade large-scale data pipelines, ETL/ELT and data integration solutions
Hands on experience with product ionized data ingestion and processing pipelines
Strong understanding of Snowflake Internals and integration of Snowflake with other data processing and reporting technologies
Proficiency with Kafka, AWS S3, SQS, Lambda, Pub/Sub, AWS DMS, Glue
Experience working with structured, semi-structured, and unstructured data
Preferred
Background in healthcare data especially patient centric clinical data and provider data is a plus
Familiarity with API security frameworks, token management and user access control including
Company
SRS Consulting Inc
SRS Consulting Inc.
501-1000 employees
H1B Sponsorship
SRS Consulting Inc has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2023 (119)
2022 (163)
2021 (157)
2020 (222)
Funding
Current Stage
Late StageLeadership Team
Santhi Kanumuri
DIRECTOR – Client Relations & Recruitment
Company data provided by crunchbase
