Apply on Employer Site

Red Ventures · 2 weeks ago

Data Engineer | Home Services

Charlotte, NC

Full-time

Hybrid

Entry, Mid Level

$80K/yr - $120K/yr

2+ years exp

Red Ventures is a company that helps millions of people worldwide make life’s most important decisions through its diverse portfolio of brands. As a Data Engineer, you will build data products and create the foundation that powers machine learning and business analytics efforts, collaborating with various stakeholders to create end-to-end solutions.

ContentDigital MediaE-CommerceHigher EducationHome ServicesMedia and EntertainmentPersonal HealthTravel

No H1B

Responsibilities

Iterate - Red tape doesn’t get in our way. We believe that "Speed Trumps Perfection" so we test and deploy daily

Autonomy – Aspiring entrepreneurs succeed here because you will have full-ownership over your work from beginning to end

Innovate – With the belief that “Everything is Written in Pencil”, we encourage our teams to test new frameworks, learn new languages and challenge the “status quo” to make us better

Design and build data pipelines from various sources to data warehouse using batch or incremental loading strategies utilizing cutting edge cloud technologies

Conceptualizing and generating infrastructure that allows data to be accessed and analyzed effectively

Your primary responsibility will involve hands-on tasks to transform existing data from diverse enterprise systems into a unified data platform housing robust datasets ready for analytics and reporting

This entails mastering upstream processes, pipelines, and source systems

Moreover, you will collaborate with various functional units to ensure the successful deployment, operation, and maintenance of solutions

Qualification

AWSSpark/SparkSQLPythonSQLETLGitHubCI/CDData WarehousingOrchestrationOperational SupportDimensional ModelingSaaS Familiarity

Required

2+ years of experience performing production data engineering/ETL work

2+ years of experience with one of the major cloud providers (we use AWS but we welcome candidates with experience in Azure or GCP)

2+ years of experience working on Spark/SparkSQL using Scala/Python to build and maintain complex ETL pipelines

2+ years of experience working with SQL

Experience with GitHub and CI/CD processes

Experience working on Orchestration (Databricks Workflows / Airflow)

Experience with one of the major data warehousing solutions (we use Databricks but we welcome candidates with experience in BigQuery, Snowflake, Oracle or Redshift)

Conceptual understanding of data warehousing and dimensional modeling

Experience providing operational support for the production data pipelines and data triaging