Stefanini North America and APAC · 7 hours ago
Data Engineer
San Francisco, CA
Contract
Hybrid
Mid Level
3+ years expStefanini Group is a global provider of outsourcing and IT consulting services, and they are seeking a Data Engineer to implement and manage data products. The role involves designing and maintaining data pipelines, collaborating with cross-functional teams, and ensuring data quality and security.
Information TechnologyOutsourcing
No H1B
Responsibilities
Design, develop, and maintain robust and efficient data pipelines to ingest, transform, catalog, and deliver curated, trusted, and quality data from disparate sources into our Common Data Platform
Actively participate in Agile rituals and follow Scaled Agile processes as set forth by the CDP Program team
Deliver high-quality data products and services following Safe Agile Practices
Proactively identify and resolve issues with data pipelines and analytical data stores
Deploy monitoring and alerting for data pipelines and data stores, implementing auto-remediation where possible to ensure system availability and reliability
Employ a security-first, testing, and automation strategy, adhering to data engineering best practices
Collaborate with cross-functional teams, including product management, data scientists, analysts, and business stakeholders, to understand their data requirements and provide them with the necessary infrastructure and tools
Keep up with the latest trends and technologies, evaluating and recommending new tools, frameworks, and technologies to improve data engineering processes and efficiencies
Qualification
Required
Bachelor's degree in Computer Science, Information Systems, or a related field, or equivalent experience
2+ years' experience with tools such as Databricks, Collibra, and Starburst
3+ years' experience with Python and PySpark
Experience using Jupyter notebooks, including coding and unit testing
Recent accomplishments working with relational and NoSQL data stores, methods, and approaches (STAR, Dimensional Modeling)
2+ years of experience with a modern data stack (Object stores like S3, Spark, Airflow, Lakehouse architectures, real-time databases) and cloud data warehouses such as RedShift, Snowflake
Overall data engineering experience across traditional ETL & Big Data, either on-prem or Cloud
Data engineering experience in AWS (any CFS2/EDS) highlighting the services/tools used
Experience building end-to-end data pipelines to ingest and process unstructured and semi-structured data using Spark architecture
Preferred
Databricks - PySpark
SQL (Starburst is a bonus)
Gitlab - CI/CD Pipelines
Tableau
Company
Stefanini North America and APAC
Global Tech Consulting Company All in One. Stefanini is a Brazilian multinational company with 37 years of experience and presence in 41 countries.
10001+ employees
Funding
Current Stage
Late StageLeadership Team
Spencer Gracias
CEO, North America/APAC
David Gawenda
Chief Operating Officer NA/APAC Region
Recent News
DBusiness Magazine
2025-12-30
Business News Americas
2025-12-13
2025-11-04
Company data provided by crunchbase