Software Engineer II, Data Lake jobs in United States
cer-icon
Apply on Employer Site
company-logo

Klaviyo · 1 day ago

Software Engineer II, Data Lake

Klaviyo is a company that empowers creators to own their destiny by making first-party data accessible and actionable. The Software Engineer II on the Data Lake Team will be responsible for designing, implementing, and optimizing large-scale data processing systems and pipelines, ensuring scalability and reliability while mentoring team members.

AdvertisingAnalyticsE-CommerceMarketing AutomationSoftware
check
Comp. & Benefits
check
H1B Sponsor Likelynote

Responsibilities

Implement scalable, fault-tolerant data pipelines using distributed processing frameworks like Apache Spark and Flink on AWS EMR, optimizing for throughput and latency
Design batch and real-time, event-driven data workflows to process billions of data points daily, leveraging streaming technologies like Kafka and Flink
Optimize distributed compute clusters and storage systems (e.g., S3, HDFS) to handle petabyte-scale datasets efficiently, ensuring resource efficiency and cost-effectiveness
Develop robust failure recovery mechanisms, including checkpointing, replication, and automated failover, to ensure high availability in distributed environments
Optimize data storage and processing systems to handle petabyte-scale datasets efficiently, ensuring performance and cost-effectiveness
Collaborate with cross-functional teams to deliver actionable datasets that power analytics and AI capabilities
Implement data governance policies and security measures to maintain data quality and compliance
Own the technical direction of highly visible data systems, improving monitoring, failure recovery, and performance
Mentor engineers, review technical documentation, and articulate phased approaches to achieving the team’s technical vision
Contribute to the evolution of internal data processing tools and frameworks, enhancing their scalability and usability

Qualification

PythonApache SparkAWSETL/ELT pipelinesApache FlinkAirflowKafkaSQLData governanceProblem-solvingCommunicationMentoringCollaboration

Required

4+ years of experience in software development, with at least 2 years focused on data engineering and distributed systems
Hands on with Python and SQL, with experience in backend development
Experience with distributed data processing frameworks such as Apache Spark and Flink
Proven track record of designing and implementing scalable ETL/ELT pipelines, ideally using AWS services like EMR
Strong knowledge of cloud platforms, particularly AWS (e.g., EMR, S3, Redshift), and optimizing data workflows in the cloud
Experience with data pipeline orchestration tools like Airflow
Familiarity with real-time data streaming technologies such as Kafka or Pulsar
Understanding of data modeling, database design, and data governance best practices
Excellent problem-solving skills and the ability to thrive in a fast-paced, collaborative environment
Strong communication skills with experience mentoring or leading engineering teams
Bachelor's degree in Computer Science, Engineering, or a related field, or equivalent experience
You've already experimented with AI in work or personal projects, and you're excited to dive in and learn fast. You're hungry to responsibly explore new AI tools and workflows, finding ways to make your work smarter and more efficient

Benefits

Participation in the company’s annual cash bonus plan
Variable compensation (OTE) for sales and customer success roles
Equity
Sign-on payments
A comprehensive range of health, welfare, and wellbeing benefits based on eligibility

Company

Klaviyo is an automation and email platform designed to help grow businesses.

H1B Sponsorship

Klaviyo has a track record of offering H1B sponsorships. Please note that this does not guarantee sponsorship for this specific role. Below presents additional info for your reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (47)
2024 (29)
2023 (24)
2022 (27)
2021 (21)
2020 (8)

Funding

Current Stage
Public Company
Total Funding
$1.35B
Key Investors
ShopifySands Capital VenturesAccel
2025-08-13Post Ipo Secondary· $195.06M
2025-05-14Post Ipo Secondary· $372.95M
2023-09-20IPO

Leadership Team

leader-logo
Andrew Bialecki
CEO
linkedin
leader-logo
Ed Hallen
Co-Founder, Chief Strategy Officer, Board Member
linkedin
Company data provided by crunchbase