200+ applicants

Company

Original Job Post

Spotter · 6 days ago

Senior Data Engineer

Culver City, CA

Full-time

Hybrid

Senior Level

$100K/yr - $500K/yr

3+ years exp

Wonder how qualified you are to the job?

Maximize your interview chances

Digital MediaFinance

H1B Sponsorship

Insider Connection @Spotter

Discover valuable connections within the company who might provide insights and potential referrals, giving your job application an inside edge.

Responsibilities

Develop and maintain scalable data pipelines, including: ETL pipelines, both single and multi-node solutions, Build data quality assurance steps for new and existing pipelines, Create derived datasets with augmented properties, Work on analytics ready datasets to power internal and creator facing tools, Troubleshoot issues when they arise, working directly with internal data consumers, Automate pipeline runs with scheduling and orchestration tools

Work with large scale datasets

Work with/use various external APIs to enhance data

Setup database tables for analytics users to consume the data collected by the Data Engineering team

Work with big data technologies to improve data availability and data quality in the cloud (AWS)

Mentor members of the team

Qualification

Find out how your skills align with this job's requirements. If anything seems off, you can easily click on the tags to select or unselect skills to reflect your actual expertise.

PythonScalaApache SparkApache FlinkCloud ServicesDataFrame APIsPandasParquetAvroSQLRDBMSRedshiftYouTube APIsData acquisitionData-LakeAWS Glue metastoreData-Mesh approachesData catalogingData lineageData governance toolsVector databases

Required

Bachelor’s degree, preferably in Computer Science or Computer Information Systems

4+ years of software engineering experience

3+ years of data engineering experience with Apache Spark or Apache Flink

3+ years of experience running software and services in the cloud

Proficiency in working with DataFrame APIs (Pandas and Spark) for parallel and single node processing

Proficiency using advanced languages and techniques with Python, Scala, etc. with modern data optimized file formats such as Parquet and Avro

Proficiency with SQL on RDBMS and data warehouse solutions like Redshift

Preferred

Experience with YouTube APIs

Experience with data acquisition from external APIs at large scale / in parallel processing

Experience with Data-Lake technologies

Experience with AWS Glue metastore

Experience with Data-Mesh approaches

Experience with data cataloging, data lineage and data governance tools and approaches

Experience with vector databases

Benefits

Medical and vision insurance covered up to 100%

Dental insurance

401(k) matching

Stock options

Complimentary gym access

Autonomy and upward mobility

Diverse, equitable, and inclusive culture, where your voice matters.

Company

Spotter

Spotter provides a financial solution for independent content creators across digital platforms.

Founded in 2019

Los Angeles, California, USA

51-200 employees

https://www.spotter.la/

H1B Sponsorship

Spotter has a track record of offering H1B sponsorships. Please note that this does not guarantee sponsorship for this specific role. Below presents additional info for your reference. (Data Powered by US Department of Labor)

Distribution of Different Job Fields Receiving Sponsorship

Trends of Total Sponsorships

2023 (4)

2022 (12)

2021 (2)

2020 (2)