Senior Data Engineer jobs in United States
cer-icon
Apply on Employer Site
company-logo

Yassir · 7 hours ago

Senior Data Engineer

Yassir is the leading super App in the Maghreb region set to change the way daily services are provided. The Senior Data Engineer will build a centralized data lake, develop data processing pipelines, and collaborate with cross-functional teams to derive insights from data.

Financial ServicesInformation TechnologyMobile AppsTransportation

Responsibilities

Build a centralized data lake on GCP Data services by integrating diverse data sources throughout the enterprise
Develop, maintain, and optimize SPARK-powered batch and streaming data processing pipelines. Leverage GCP data services for complex data engineering tasks and ensure smooth integration with other platform components
Design and implement data validation and quality checks to ensure data's accuracy, completeness, and consistency as it flows through the pipelines
Work with the Data Science and Machine Learning teams to engage in advanced analytics
Collaborate with cross-functional teams, including data analysts, business users, operational and marketing teams, to extract insights and value from data
Collaborate with the product team to design, implement, and maintain the data models for analytical use cases
Design, develop, and upkeep data dashboards for various teams using Looker Studio
Engage in technology explorations, research and development, POC’s and conduct deep investigations and troubleshooting
Design and manage ETL/ELT processes, ensuring data integrity, availability, and performance
Troubleshoot data issues and conduct root cause analysis when reporting data is in question

Qualification

PySparkGCPNoSQLSQLData GovernanceScala/PythonAirflowTerraformDockerKubernetesLookerAI/ML knowledge

Required

PySpark – Batch and Streaming
GCP – Dataproc, Dataflow, DataStream, Dataplex, Pub/Sub, BigQuery and Cloud Storage
NoSQL (preferably MongoDB)
Programming languages: Scala/Python
Great Expectation, or similar DQ framework
Familiarity with workflow management tools like: Airflow, Prefect or Luigi
Understanding of Data Governance, Data Warehousing and Data Modelling
Good SQL knowledge
Able to communicate effectively, distill technical knowledge into digestible messages in a succinct / visual way
Proactively identify and contribute with team development initiatives, and supporting junior members

Preferred

Infrastructure-as-Code, preferably Terraform
Docker and Kubernetes
Looker
AI / ML engineering knowledge
Lineage, or relevant tools e.g. Atlan
DBT

Company

Yassir

twittertwittertwitter
company-logo
The leading super app offers on-demand services, ride-hailing, delivery, and payment. It's revolutionizing how daily services are provided.

Funding

Current Stage
Late Stage
Total Funding
$180M
Key Investors
BondWndrCoUnpopular Ventures
2022-11-07Series B· $150M
2021-11-29Series A· $30M
2021-03-21Seed
Company data provided by crunchbase