Real-Time Data Engineer II jobs in United States
cer-icon
Apply on Employer Site
company-logo

AppFolio · 2 hours ago

Real-Time Data Engineer II

AppFolio is the technology leader powering the future of the real estate industry. The Real-Time Data Engineer II will develop infrastructure for real-time data processing, ensuring high-quality data access for various users, while collaborating with engineers and data scientists.

AnalyticsComputerInformation TechnologyProperty ManagementPropTechSaaSSoftwareWeb Hosting
check
H1B Sponsor Likelynote

Responsibilities

Design, build and operate on next generation data pipeline infrastructure based on Apache Kafka and its ecosystem
Improve data architecture, quality, discoverability and access policies to enable and enforce data governance
Collaborate with engineers, data analysts and scientists to ensure that our data infrastructure meets the SLOs of our data-intensive customers
Develop techniques for monitoring the completeness, correctness and reliability of our data sets
Leverage agile practices, encourage collaboration, prioritization, and urgency to develop at a rapid pace
Research, share, and recommend new technologies and trends

Qualification

Apache KafkaData warehouse technologyAWS primitivesPythonRubyStreaming processing technologiesSQL skillsInfrastructure as CodeData LakesDistributed SQL enginesContainer orchestrationData science skills

Required

3+ years of experience with Apache Kafka, Kafka Connect and its ecosystem
2+ years of experience in streaming processing technologies, such as Apache Flink
2+ years of experience with AWS primitives (IAM, VPC, S3, MSK, EKS, etc.)
3+ years of experience working with programming languages like Python or Ruby
Excellent SQL skills with working knowledge of query optimization
2+ years of experience working with Infrastructure as Code, configuration management, and monitoring tools
Bachelors in Computer Science or other quantitative fields
You have hands-on experience with using Apache Kafka in production and have a passion for building a reliable, scalable and fault-tolerant infrastructure
You have industry experience with working with real time transformation technologies such as Apache Flink
You have worked with a variety of data sources, including change data capture systems, data streaming and event sourcing in production
You have hands-on experience with data warehouse technology
You embrace the platform-first approach to build standard solutions and self-serve capabilities for engineering teams
You want to work with a high degree of autonomy, while at the same time working on initiatives of high importance to the company
You care about work-life balance and want your company to care about it too; you'll put in the extra hour when needed but won't let it become a habit

Preferred

Experience with Debezium connectors
Experience with large scale Data Lakes and Lake Houses, especially with Apache Iceberg is a plus
Experience with distributed SQL query engines, such as Trino is a plus
Experience with containers and container orchestration tools. Docker and Kubernetes experience is desirable
Data science skills for analyzing data and communicating with ML engineers are a plus

Company

AppFolio

company-logo
AppFolio is a cloud business management solutions provider for the real estate industry.

H1B Sponsorship

AppFolio has a track record of offering H1B sponsorships. Please note that this does not guarantee sponsorship for this specific role. Below presents additional info for your reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (15)
2024 (24)
2023 (22)
2022 (34)
2021 (51)
2020 (35)

Funding

Current Stage
Public Company
Total Funding
$30M
Key Investors
Investment Group of Santa BarbaraHeadline
2015-06-26IPO
2013-11-01Series Unknown
2009-08-18Series C· $8M

Leadership Team

leader-logo
Shane Trigg
President and CEO
linkedin
leader-logo
Tim Eaton
Chief Financial Officer
linkedin
Company data provided by crunchbase