Lead Data Engineer - AWS jobs in United States
cer-icon
Apply on Employer Site
company-logo

Tiger Analytics ยท 5 months ago

Lead Data Engineer - AWS

Tiger Analytics is a fast-growing advanced analytics consulting firm that specializes in Data Science, Machine Learning, and AI. As a Lead Data Engineer, you will design, build, and maintain scalable data pipelines on AWS, collaborating with cross-functional teams to support data analytics and business intelligence initiatives.

AdvertisingAnalyticsBig DataConsultingMachine LearningNews
check
H1B Sponsor Likelynote

Responsibilities

Design, develop, and deploy end-to-end data pipelines on AWS cloud infrastructure using services such as Amazon S3, AWS Glue, AWS Lambda, Amazon Redshift, etc
Implement data processing and transformation workflows using Databricks, Apache Spark, and SQL to support analytics and reporting requirements
Build and maintain orchestration workflows using Apache Airflow to automate data pipeline execution, scheduling, and monitoring
Lead the migration of legacy data systems to modern cloud-based architectures
Develop and maintain CI/CD pipelines for data workflows
Collaborate with data scientists, analysts, and business stakeholders to understand data requirements and deliver scalable data solutions
Optimize data pipelines for performance, reliability, and cost-effectiveness, leveraging AWS best practices and cloud-native technologies

Qualification

AWS servicesDatabricksApache AirflowApache SparkSQLCI/CD pipelinesCommunication skillsProblem-solving skills

Required

10+ years of experience building and deploying large-scale data processing pipelines in a production environment
Hands-on experience in designing and building data pipelines on AWS cloud infrastructure
Strong proficiency in AWS services such as Amazon S3, AWS Glue, AWS Lambda, Amazon Redshift, etc
Lead the design, development, and optimization of large-scale data pipelines and data lakehouse architectures using Databricks
Architect and implement batch and real-time streaming solutions leveraging Apache Spark on Databricks
Hands-on experience with Apache Airflow for orchestrating and scheduling data pipelines
Solid understanding of data modeling, database design principles, and SQL and Spark SQL
Experience with version control systems (e.g., Git) and CI/CD pipelines
Excellent communication skills and the ability to collaborate effectively with cross-functional teams
Strong problem-solving skills and attention to detail

Benefits

This position offers an excellent opportunity for significant career development in a fast-growing and challenging entrepreneurial environment with a high degree of individual responsibility.
Tiger Analytics provides equal employment opportunities to applicants and employees without regard to race, color, religion, age, sex, sexual orientation, gender identity/expression, pregnancy, national origin, ancestry, marital status, protected veteran status, disability status, or any other basis as protected by federal, state, or local law.

Company

Tiger Analytics

company-logo
Tiger Analytics offers data analytics and predictive modeling solutions for retail, social media, and online advertising sectors.

H1B Sponsorship

Tiger Analytics has a track record of offering H1B sponsorships. Please note that this does not guarantee sponsorship for this specific role. Below presents additional info for your reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (259)
2024 (158)
2023 (93)
2022 (176)
2021 (123)
2020 (64)

Funding

Current Stage
Late Stage

Leadership Team

M
Mahesh Kumar
Founder and CEO
linkedin
Company data provided by crunchbase