Data Engineer jobs in United States
cer-icon
Apply on Employer Site
company-logo

Tata Consultancy Services · 10 hours ago

Data Engineer

Tata Consultancy Services is seeking a Data Engineer to design, develop, and maintain data pipelines for efficient data processing and integration. The role involves implementing data governance policies, optimizing performance, and collaborating with cross-functional teams to support data-driven initiatives.

Business Information SystemsConsultingInformation TechnologyIT Management
check
H1B Sponsor Likelynote

Responsibilities

Design, develop, and maintain data pipelines for efficient data processing and integration for real-time and batch-processing
Implement and optimize ETL processes to extract, load, transform and integrate data from various sources
Enhance data flows and storage solutions for improved performance
Design and implement data warehouse structures
Ensure data quality and consistency within the data warehouse
Apply data modeling techniques for efficient data storage and retrieval
Implement data governance policies and procedures
Implement data quality frameworks, standards and documentation
Ensure compliance with relevant data regulations and standards
Implement data security measures and access controls
Maintain data protection protocols
Analyze and optimize system performance for large-scale data operations
Troubleshoot data issues and implement robust solutions
Write unit test cases, validate the data integrity & consistency requirements, adopt automated data pipelines using GitLab, Github, CICD tools
Adopt release management processes to promote code deployment to various environments including production, disaster recovery, and support activities
Collaborate with data scientists, analysts, and other teams to understand and meet data requirements
Participate in cross-functional projects to support data-driven initiatives

Qualification

Data PipelinesData WarehousingData GovernancePerformance OptimizationPythonSQLData SecurityAWS ServicesDBT CloudRelease ManagementData IntegrityCross-Functional CollaborationSoft Skills

Required

BACHELOR OF COMPUTER SCIENCE
Hands-on experience in building robust metadata-driven, automated data pipeline solutions leveraging modern cloud-based data technologies, tools for large data platforms
Hands-on experience leveraging data security, governance methodologies meeting data compliance requirements
Experience building automated ELT data pipelines, snowpipe frameworks leveraging Qlik Replicate, DBT Cloud, snowflake with CICD
Hands-on experience building data integrity solutions across multiple data sources and targets like SQL Server, Oracle, Mainframe-DB2, files, Snowflake
Experience working with various structured & semi-structured data files - CSV, fixed width, JSON, XML, Excel, and mainframe VSAM
Experience using S3, Lambda, SQS, SNS, Glue, RDS AWS services
Proficiency in Python, Pyspark, advanced SQL for ingestion frameworks and automation
Hands-on data orchestration experience using DBT cloud, Astronomer Airflow
Experience in implementing logging, monitoring, alerting, observability, performance tuning techniques
Implement and maintain sensitive data protection strategies – tokenization, snowflake data masking policies, dynamic & conditional masking, and role based masking rules
Strong experience designing, implementing RBAC, data access controls, adopting governance standards across Snowflake and supporting systems
Strong experience in adopting release management guidelines, code deployment to various environments, implementing disaster recovery strategies, leading production activities
Experience implementing schema drift detection and schema evolution patterns
Must have one or more certifications in the relevant technology fields

Preferred

Nice to have Financial banking experience

Company

Tata Consultancy Services

company-logo
Tata Consultancy Services is a business solutions company that specializes on information technology services and consulting.

H1B Sponsorship

Tata Consultancy Services has a track record of offering H1B sponsorships. Please note that this does not guarantee sponsorship for this specific role. Below presents additional info for your reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (7880)
2024 (9690)
2023 (8537)
2022 (11159)
2021 (9813)
2020 (11984)

Funding

Current Stage
Public Company
Total Funding
unknown
2004-08-25IPO

Leadership Team

leader-logo
K. Krithivasan
Chief Executive Officer & Managing Director
linkedin
leader-logo
Aarthi Subramanian
President and Chief Operating Officer
Company data provided by crunchbase