Be an early applicantLess than 25 applicants
WorkatHome-JobBoard ยท 2 days ago
Sr Data Engineer
Pittsburgh, PA
Part-time
Remote
Senior Level
$97K/yr - $227K/yr
5+ years exp
Wonder how qualified you are to the job?
Maximize your interview chancesAdvertising Services
Insider Connection @WorkatHome-JobBoard
Responsibilities
Collaborates with project stakeholders to identify product and technical requirements. Conducts analysis to determine integration needs.
Designs and builds data processing pipeline using cutting edge AWS services, 3rd party open-source/commercial software, and internally developed software to ingest, process, and deliver data at scale.
Continually acquires new data sources to develop an increasingly rich dataset that characterizes audiences.
Collaborates with the serving team, report team, and Data engineers to translate complex product requirements into working high-quality cloud-native data solutions.
Works with Lead Engineers and Architects to share and contribute to the broader technical vision.
Continually works on improving the codebase and has active participation and oversight in all aspects of the team, including agile ceremonies.
Displays in-depth knowledge of and ability to apply, process design, and redesign skills. Presents and defends architectural, design, and technical choices to internal audiences.
Oversees the documentation of all development activities.
Provides guidance and support to other Engineers.
Other duties and responsibilities as assigned.
Qualification
Find out how your skills align with this job's requirements. If anything seems off, you can easily click on the tags to select or unselect skills to reflect your actual expertise.
Required
SQL, Spark, Snowflake, Databricks, Big Data, AWS, and Scala or Python experience are highly preferred.
Experience with stream processing frameworks such as Flink or Spark Streaming on Kafka or Kinesis is preferable
5+ years of hands-on work in the field of software development.
3+ years of experience with data applications (Spark, Presto, Hive, etc)
3+ years of experience in designing and building ETL pipelines to process data at scale
3+ years of experience with NoSQL implementation (AeroSpike, DynamoDB, etc)
3+ years of experience with a public cloud (AWS, Microsoft Azure, Google Cloud)
3+ years of experience with CI/CD tools such as Jenkins or AWS CodeBuild, Terraform, etc.
Excellent coding skills with Scala/Java, Python.
Must be versatile and an inquisitive problem solver.
Excellent communication and writing skills
Bachelor's or master's degree in Computer Science or similar field of study
Preferred
Experience with stream processing frameworks such as Flink or Spark Streaming on Kafka or Kinesis is preferable
Benefits
Best-in-class Benefits
Array of options for personalized support
Expert guidance
Tools for physical, financial, and emotional support
Company
WorkatHome-JobBoard
WorkAtHome-JobBoard is the leading job search site specializing in the best remote, part-time, freelance, and flexible jobs available.
2-10 employees
Funding
Current Stage
Early StageCompany data provided by crunchbase
