200+ applicants

This job has closed.

Company

Original Job Post

Lyft · 5 days ago

Data Engineer

San Francisco County, CA

Full-time

Onsite

Mid Level

$144K/yr - $180K/yr

3+ years exp

Wonder how qualified you are to the job?

Maximize your interview chances

AppsMobile Apps

H1B Sponsorship

Insider Connection @Lyft

Discover valuable connections within the company who might provide insights and potential referrals, giving your job application an inside edge.

Responsibilities

Design and implement insurance and claim-related data pipeline to help optimize insurance operation strategies

Tune ETL and MapReduce job to improve data processing performance

Partner with external insurance partners and Lyft business stakeholders to ensure seamless execution within established timelines

Owner of the core company data pipeline, responsible for converting the business and engineering need to efficient & reliable data pipelines

Main contributor to the team roadmap and lead the team to make the right technical decisions

Qualification

Find out how your skills align with this job's requirements. If anything seems off, you can easily click on the tags to select or unselect skills to reflect your actual expertise.

SparkHadoopS3DynamoDBMapReduceYarnHDFSHivePrestoPigHBaseParquetPythonRubyBashSQLMySQLPostgreSQLSQLServerOracleAirflowOozieAzkabanUC4Data PipelineInsurance DataLarge Organizations

Required

3+ years of relevant professional experience

Strong experience with Spark

Experience with Hadoop (or similar) Ecosystem, S3, DynamoDB, MapReduce, Yarn, HDFS, Hive, Spark, Presto, Pig, HBase, Parquet

Strong skills in a scripting language (Python, Ruby, Bash)

Good understanding of SQL Engine and able to conduct advanced performance tuning

Proficient in at least one of the SQL languages (MySQL, PostgreSQL, SqlServer, Oracle)

Experience with workflow management tools (Airflow, Oozie, Azkaban, UC4)

Comfortable working directly with data and business partners to bridge Lyft’s business goals with data engineering

Preferred

Preferred to have experience of building and maintaining insurance related data pipeline for large organizations

Benefits

Great medical, dental, and vision insurance options

Mental health benefits

Family building benefits

In addition to 12 observed holidays, salaried team members have unlimited paid time off, hourly team members have 15 days paid time off

401(k) plan to help save for your future

18 weeks of paid parental leave. Biological, adoptive, and foster parents are all eligible

Pre-tax commuter benefits

Lyft Pink - Lyft team members get an exclusive opportunity to test new benefits of our Ridership Program

Company

Lyft

Glassdoor

3.6

Lyft designs, markets, and operates a mobile application that matches drivers with passengers who request rides.

Founded in 2012

San Francisco, California, USA

5,001-10,000 employees

http://lyft.com

H1B Sponsorship

Lyft has a track record of offering H1B sponsorships. Please note that this does not guarantee sponsorship for this specific role. Below presents additional info for your reference. (Data Powered by US Department of Labor)

Distribution of Different Job Fields Receiving Sponsorship

Trends of Total Sponsorships

2023 (69)

2022 (282)

2021 (268)

2020 (261)