74 applicants

This job has closed.

Company

Original Job Post

SiriusXM · 1 week ago

Senior Data Engineer, Data Ingestion

Oakland, CA

Full-time

Hybrid

Senior Level

$128K/yr - $170K/yr

5+ years exp

Wonder how qualified you are to the job?

BroadcastingInternet Radio

Insider Connection @SiriusXM

Discover valuable connections within the company who might provide insights and potential referrals, giving your job application an inside edge.

Responsibilities

Build cloud-based data pipeline frameworks and operations to power business intelligence.

Build and improve workflow orchestration tooling to support efficient data pipelines. E.g. airflow plugins, systems integration, deployments.

Implement data governance through proper structure, access controls, and safeguards Build command line tools that improve user experience and encourage best practices in the cloud.

Build monitoring dashboards for stakeholders to better understand the health, performance, and cost of the platform.

Write documentation to encourage adoption of platform tools and support users in their use.

Strengthen corporate best practices around data engineering software development processes.

Qualification

Find out how your skills align with this job's requirements. If anything seems off, you can easily click on the tags to select or unselect skills to reflect your actual expertise.

ScalaPythonData ETL pipelinesData toolsData warehouse technologiesMapReduceHDFSHiveTezSparkSqoopStreaming technologiesKafkaKafka ConnectKStreamsKSQLBeamFlinkSQL applicationsCloud computingGoogle Cloud PlatformAmazon Web ServicesLinux-based deployment platformsServer-side softwareService-oriented architecturesAPI designRPCRESTJSONUnit testing

Required

5+ years’ experience developing data ETL pipelines and data tools in Scala and/or Python.

BS/MS or above in Computer Science or relevant experience

Experience with data warehouse technologies: MapReduce, HDFS, Hive, Tez, Spark, Sqoop.

Experience with streaming technologies - Kafka, Kafka Connect, KStreams, KSQL, Beam, Flink, Spark.

Experience developing SQL applications of significant complexity

Experience with cloud computing - Google Cloud Platform, Amazon Web Services.

Experience developing for Linux-based deployment platforms, developing scalable, multithreaded server-side software for deployment.

Experience developing service-oriented architectures / orchestration.

Experience with API design/development – RPC, REST, JSON.

Experience with unit and integration testing frameworks.

Experience with CI/CD, build and deployment technologies such as Jenkins.

Experience with Data Visualization or Data Notebook tools (i.e Zeppelin, Tableau, etc.).

Experience working in a Cloud Environment (AWS, GCP, etc.).

Experience developing and deploying machine learning algorithms.

Experience developing with additional languages - R, Scala.

Experience with workflow tools – Airflow/Composer/Luigi.

Experience with data serialization system - Avro, Protobuf.

Good public speaking and presentation skills.

Interpersonal skills and ability to interact and work with staff at all levels.

Excellent written and verbal communication skills.

Ability to work independently and in a team environment.

Ability to pay attention to details and be organized.

Ability to project professionalism over the phone and in person.

Ability to handle multiple tasks in a fast-paced environment.

Commitment to “internal client” and customer service principles.

Willingness to take initiative and to follow through on projects.

Creative writing ability.

Excellent time management skills, with the ability to prioritize and multi-task, and work under shifting deadlines in a fast-paced environment.

Must have legal right to work in the U.S.

Company

SiriusXM

Glassdoor

3.5

SiriusXM and its brands (Pandora, SXM Media, AdsWizz, Simplecast, and SiriusXM Connected Vehicle Services) are leading a new era of audio entertainment and services by delivering the most compelling subscription and ad-supported audio entertainment experience for listeners -- in the car, at home, and anywhere on the go with connected devices.

Founded in 1990

New York, New York, USA

1,001-5,000 employees