64 applicants

Company

Prophecy · 4 hours ago

Senior Data Engineer

United States

Full-time

Remote

Senior Level

Maximize your interview chances

AnalyticsBusiness Intelligence

H1B Sponsor Likely

Insider Connection @Prophecy

Discover valuable connections within the company who might provide insights and potential referrals.
Get 3x more responses when you reach out via email instead of LinkedIn.

Responsibilities

Be a resident expert in data engineering using Prophecy with Spark & Airflow

Solve complex problems and educate

Address complex customer issues related to Apache Spark and Data Warehouses

Build automated tooling to solve repeatable problems

Demonstrate ownership to drive to solution, be pro-active

Participate in on-call rotation

Educate

Help our customers (Fortune 500) onboard to the product, answering queries about Prophecy, Spark, and Airflow

Provide best practices and guidance around pipeline runtime performance, usage of third-party libraries, CI/CD, and scheduling

Build product packages

Build reusable Spark, SQL, and Airflow packages that solve repeated problems in data engineering (e.g., data quality, auditing, and connectors)

Write high-performance Spark code

Qualification

Find out how your skills align with this job's requirements. If anything seems off, you can easily click on the tags to select or unselect skills to reflect your actual expertise.

Apache SparkApache AirflowData WarehousesData EngineeringPythonScalaETLPerformance OptimizationCustomer-facing ExperienceTechnical Customer-facing RoleCI/CD

Required

Solid data engineering skills with experience in Apache Spark and Airflow

Ability to write high-quality Spark code

Articulate communication skills

Experience in complex data engineering (ETL) and solving performance issues with Spark jobs

Ability to educate and help customers onboard to the product

Demonstrate ownership to drive to solution and be pro-active

Participate in on-call rotation

Preferred

Customer-facing experience

Experience in a technical customer-facing role - preferably solution engineering

Ability to form relationships with executives and influencers

Ability to present a convincing point-of-view to important decision-makers

Experience in writing Python or Scala code

Bachelor in CS (preferred)

Be a resident expert in data engineering using Prophecy with Spark & Airflow

Solve complex problems and educate

Address complex customer issues related to Apache Spark and Data Warehouses

Build automated tooling to solve repeatable problems

Provide best practices and guidance around pipeline runtime performance, usage of third-party libraries, CI/CD, and scheduling

Build product packages

Build reusable Spark, SQL, and Airflow packages that solve repeated problems in data engineering (e.g., data quality, auditing, and connectors)

Write high-performance Spark code

Benefits

Prophecy covers 99% of employee health insurance and 75% for dependents

We offer $200 per month towards wellness, gyms, massages, facials, and more!

Celebrate your birthday and anniversary with a day off!

Flexible PTO

Prophecy provides employees with a $500 professional development reimbursement every year

Company sponsored Long Term Disability and Life Insurance

FSA/HSA

Ability to have your fingerprint on an innovative platform

End-to-end ownership of your projects

And more!

Company

Prophecy

Prophecy is the data copilot company.

Founded in 2017

Palo Alto, California, USA

51-200 employees

http://www.prophecy.io

H1B Sponsorship

Prophecy has a track record of offering H1B sponsorships. Please note that this does not guarantee sponsorship for this specific role. Below presents additional info for your reference. (Data Powered by US Department of Labor)

Distribution of Different Job Fields Receiving Sponsorship

Represents job field similar to this job

Trends of Total Sponsorships

2021 (1)

2020 (1)