Senior Software Development Engineer, Big Data jobs in United States
cer-icon
Apply on Employer Site
company-logo

Zillow · 1 month ago

Senior Software Development Engineer, Big Data

Zillow is a leading real estate platform in the U.S., dedicated to reshaping how people navigate the housing market. The role involves processing vast amounts of data to produce insights and indicators for businesses and policymakers, while collaborating with data science teams to enhance data products and processing frameworks.

MarketplaceOnline PortalsPropTechReal Estate
check
Comp. & Benefits
check
H1B Sponsor Likelynote

Responsibilities

Build data systems to link raw data and concrete Housing Trends insights
Build and extend our internal forecasting model development framework
Develop and maintain scalable data products and deliver pipelines built for speed, accuracy, and consistency that will scale as our stakeholders’ need
Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability and performance, etc
Collaborate with data scientists to understand their data requirements and build systems/tools that enable efficient model training and experimentation
Implement feature stores and ETL pipelines to streamline feature engineering and model development
Build and maintain infrastructure for deploying machine learning models into production environments
Be a trusted partner for our stakeholders, such as Forecasting, Zestimates, and the ML teams within the AI organization to assist them for data investigation/publication, ML model development and infrastructure support

Qualification

Python programmingBig data ecosystemsData pipeline orchestrationDatabricksSparkSQLPostgreSQLAgile/DevOpsRoot cause analysisMachine learning conceptsCommunication skillsProblem-solving skillsCollaboration

Required

Strong proficiency in Python programming
Hands-on experience with big data ecosystems, architectures and modern data platforms, including AWS cloud data services and Lakehouse/Lakebase platforms
Proven ability to design, build, and orchestrate batch and real-time data pipelines, processing large-scale datasets from diverse sources
Practical experience with cutting-edge data engineering technologies such as SparkSQL and Spark Streaming, PostgreSQL, EKS, and Kubernetes
Familiarity with Agile/DevOps software development processes and tools such as GitLab and CI/CD
A good understanding of data science concepts, fundamental machine learning algorithms/libraries, and development lifecycle is a must-to-have
Strong ability in performing root cause analysis to address operational issues and identify opportunities for improvement
Exceptional communication skills to drive effective customer engagement, collaborate with cross-functional teams, and clearly articulate technical concepts to technical and non-technical stakeholders
Strong problem-solving skills and the ability to work in a fast-paced, collaborative environment
5+ years of experience in Big Data Engineering or Machine Learning Engineering roles

Preferred

Hands-on experience with Databricks is a significant advantage
Familiarity with LLM and Agentic AI technologies and engineering patterns is a big advantage

Benefits

Equity awards based on factors such as experience, performance and location

Company

Zillow is an online real estate marketplace for finding and sharing information about homes, real estate, and mortgages. It is a sub-organization of Zillow Group.

H1B Sponsorship

Zillow has a track record of offering H1B sponsorships. Please note that this does not guarantee sponsorship for this specific role. Below presents additional info for your reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (179)
2024 (150)
2023 (171)
2022 (256)
2021 (239)
2020 (195)

Funding

Current Stage
Public Company
Total Funding
$96.63M
Key Investors
Legg MasonPAR Capital Management
2016-08-01Post Ipo Equity
2014-04-01Post Ipo Equity
2012-12-12Post Ipo Equity· $4.13M

Leadership Team

leader-logo
Lloyd Frink
Co-Founder & Co-Executive Chair
linkedin
leader-logo
Rich Barton
Co-founder and Co-Executive Chair
linkedin
Company data provided by crunchbase