Tata Consultancy Services · 21 hours ago
Data Engineer ( Bigdata with AWS & Snowflake)
Bethesda, MD
Full-time
Onsite
Mid Level
$100K/yr - $130K/yrTata Consultancy Services is a leading global IT services, consulting, and business solutions organization. They are seeking a Data Engineer to gather business requirements, design and implement large-scale data ingestion systems, and optimize the data lifecycle in a Big Data environment.
Business Information SystemsConsultingInformation TechnologyIT Management
Responsibilities
Involved in the Study of the business logic and coordinate with the client to gather the requirements
Experience with Hive, Nifi, Airflow, Snowflake and Kafka
Experience in Cloud environments, particularly AWS - EC2, S3, Lambda
Experience in Unit testing, integration testing for Spark scripts
Scripting with Bash, CSH, Shell, or Python
Designing and implementing large-scale ingest systems in a Big Data environment
Optimizing all stages of the data life cycle, from initial planning, to ingest, through final display and beyond
Designing and implementing data extraction, cleansing, transformation, loading, and replication/distribution capabilities
Developing custom solutions/code to ingest and exploit new and existing data sources
Working with Sponsor development teams to improve application performance
Providing support to maintain, optimize, troubleshoot, and configure the AWS/spark/Hadoop environment as needed
Collaborating with team-mates, other service providers, vendors, and users to develop new and more efficient method
Experience with CI/CD pipelines, unit tests, integration, and regression testing
Significant experience with Airflow
Strong ability to manage competing priorities and communication to multiple stakeholders
Qualification
Required
Involved in the Study of the business logic and coordinate with the client to gather the requirements
Experience with Hive, Nifi, Airflow, Snowflake and Kafka
Experience in Cloud environments, particularly AWS - EC2, S3, Lambda
Experience in Unit testing, integration testing for Spark scripts
Scripting with Bash, CSH, Shell, or Python
Designing and implementing large-scale ingest systems in a Big Data environment
Optimizing all stages of the data life cycle, from initial planning, to ingest, through final display and beyond
Designing and implementing data extraction, cleansing, transformation, loading, and replication/distribution capabilities
Developing custom solutions/code to ingest and exploit new and existing data sources
Working with Sponsor development teams to improve application performance
Providing support to maintain, optimize, troubleshoot, and configure the AWS/spark/Hadoop environment as needed
Collaborating with team-mates, other service providers, vendors, and users to develop new and more efficient method
Experience with CI/CD pipelines, unit tests, integration, and regression testing
Significant experience with Airflow
Strong ability to manage competing priorities and communication to multiple stakeholders
Bachelor's degree in computer science, Computer Engineering, or a related discipline with experience in software design and development
Benefits
Discretionary Annual Incentive.
Comprehensive Medical Coverage: Medical & Health, Dental & Vision, Disability Planning & Insurance, Pet Insurance Plans.
Family Support: Maternal & Parental Leaves.
Insurance Options: Auto & Home Insurance, Identity Theft Protection.
Convenience & Professional Growth: Commuter Benefits & Certification & Training Reimbursement.
Time Off: Vacation, Time Off, Sick Leave & Holidays.
Legal & Financial Assistance: Legal Assistance, 401K Plan, Performance Bonus, College Fund, Student Loan Refinancing.
Company
Tata Consultancy Services
Tata Consultancy Services is a business solutions company that specializes on information technology services and consulting.
Founded in 1968
10001+ employees
H1B Sponsorship
Tata Consultancy Services has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (7880)
2024 (9690)
2023 (8537)
2022 (11159)
2021 (9813)
2020 (11984)
Funding
Current Stage
Public CompanyTotal Funding
unknown2004-08-25IPO
Leadership Team
K. Krithivasan
Chief Executive Officer & Managing Director
Aarthi Subramanian
President and Chief Operating Officer
Recent News
Trak.in - Indian Business of Tech, Mobile & Startups
2026-01-06
Business News Americas
2026-01-06
Company data provided by crunchbase