Senior Data Engineer (P3036) jobs in United States
cer-icon
Apply on Employer Site
company-logo

84.51˚ · 2 days ago

Senior Data Engineer (P3036)

84.51° is a retail data science, insights and media company. The role involves collaboration with cross-functional teams to leverage cutting-edge technologies and ensure efficient data engineering practices, primarily working within Azure to create applications for campaign management.

Management Consulting
badNo H1Bnote

Responsibilities

Provide Technical Leadership: Offer technical leadership to ensure clarity between ongoing projects and facilitate collaboration across teams to solve complex data engineering challenges
Build and Maintain Data Pipelines: Design, build, and maintain scalable, efficient, and reliable data pipelines to support data ingestion, transformation, and integration across diverse sources and destinations, using tools such as Kafka, Databricks, and similar toolsets
Drive Innovation: Leverage innovative technologies and approaches to modernize and extend core data assets, including SQL-based, NoSQL-based, cloud-based, and real-time streaming data platforms
Implement Automated Testing: Design and implement automated unit, integration, and performance testing frameworks to ensure data quality, reliability, and compliance with organizational standards
Optimize Data Workflows: Optimize data workflows for performance, cost efficiency, and scalability across large datasets and complex environments
Mentor Team Members: Mentor team members in data principles, patterns, processes, and practices to promote best practices and improve team capabilities
Draft and Review Documentation: Draft and review architectural diagrams, interface specifications, and other design documents to ensure clear communication of data solutions and technical requirements

Qualification

Data DevelopmentSQLNoSQLData PipelinesPythonPysparkDatabricksCI/CDAutomated TestingVersion ControlETLData WarehousingAgile PrinciplesStructured StreamingService Oriented ArchitectureContainerization

Required

Bachelor's degree typically in Computer Science, Management Information Systems, Mathematics, Business Analytics or another STEM degree
Proven experience in leading cross-functional teams and managing complex projects from inception to completion
3+ years of professional Data Development experience
3+ years of experience with SQL and NoSQL technologies
2+ years of experience building and maintaining data pipelines and workflows
2+ years of experience developing with Python & Pyspark
Experience developing within databricks
Experience with CI/CD pipelines and processes
Experience with automated unit, integration, and performance testing
Experience with version control software such as Git
Full understanding of ETL and Data Warehousing concepts
Strong understanding of Agile principles (Scrum)

Preferred

Knowledge of Structured Streaming (Spark, Kafka, EventHub, or similar technologies)
Experience with GitHub SaaS/GitHub Actions
Experience with Service Oriented Architecture
Experience with containerization technologies such as Docker and Kubernetes

Benefits

Medical: with competitive plan designs and support for self-care, wellness and mental health.
Dental: with in-network and out-of-network benefit.
Vision: with in-network and out-of-network benefit.
401(k) with Roth option and matching contribution.
Health Savings Account with matching contribution (requires participation in qualifying medical plan).
AD&D and supplemental insurance options to help ensure additional protection for you.
Paid time off with flexibility to meet your life needs, including 5 weeks of vacation time, 7 health and wellness days, 3 floating holidays, as well as 6 company-paid holidays per year.
Paid leave for maternity, paternity and family care instances.

Company

84.51° helps companies create sustainable growth by putting the customer at the center of everything.

Funding

Current Stage
Late Stage

Leadership Team

leader-logo
Mario DiMercurio
Director, Product - Platform Components
linkedin
Company data provided by crunchbase