Learning Commons · 3 hours ago
Senior Software Engineer, Data
Learning Commons is Mark Zuckerberg and Priscilla Chan’s education initiative, which aims to scale proven teaching and learning practices to benefit every learner. As a Senior Software Engineer, Data, you will design, build, and scale software systems that assist educators in addressing challenges and tailoring learning experiences to individual student needs.
Non-profit Organization Management
Responsibilities
Create new CDC pipelines to support the launch of new products
Collaborate with the infra team on improving the monitoring and scalability of the CDC pipelines
Triage and investigate Debezium or Kafka issues in collaboration with the infra team
Maintain key data pipelines
Ingest external data sets for use by the team
Improve data usability and data quality in our data warehouse
Launch new ETL (extract, transform, load) processes in production
Set up roles & access permissions for Databricks, following best practices
Set up ETL pipelines or orchestration workflows within AWS & Databricks ecosystems
Collect and organize knowledge through various sources, maintaining and updating data to ensure accuracy
Transform, integrate, aggregate, annotate, and enrich data to enhance its value
Derive and continuously update student attributes for personalization use cases
Qualification
Required
Hands-on experience with AWS services and Kubernetes
Experience with Databricks / Spark ecosystem
Knowledge of CDC, Debezium, and Kafka
Experience in Software Engineering or Data Engineering
Expertise in writing efficient and optimized SQL
Experience with dimensional data modeling and schema design in a database or data warehouse
Expertise with scripting languages such as Python
Experience with ETL tooling such as Airflow
Experience with large-scale cloud data warehouses such as Snowflake
Passion for education and bringing technology to improve education
Experience working with large data sets
Love for collaborating and working with people in understanding data needs, as well as scoping and executing on projects
Benefits
Provides a generous employer match on employee 401(k) contributions to support planning for the future.
Paid time off to volunteer at an organization of your choice.
Funding for select family-forming benefits.
Relocation support for employees who need assistance moving
Company
Learning Commons
Learning Commons is the name of the Chan Zuckerberg Initiative's long-standing work and investment in education, which aims to scale proven teaching and learning practices to benefit every learner.
Funding
Current Stage
Growth StageCompany data provided by crunchbase