Qloo · 1 day ago
Data Engineer
New York, NY
Full-time
Hybrid
Mid LevelQloo is a company that harnesses large-scale behavioral and catalog data to power recommendations and insights across various sectors. They are seeking an experienced Data Engineer to design, build, and operate data pipelines that integrate data from multiple sources into their S3-based data lake for analytics and machine learning purposes.
Artificial Intelligence (AI)Consumer ResearchDeveloper APIsMachine LearningPersonalization
Hiring Manager
Andy Bujarski
Responsibilities
Design, develop, and maintain batch data pipelines using Python, Spark (EMR), and AWS Glue, loading data from S3, RDS, and external sources into Hive/Athena tables
Model datasets in our S3/Hive data lake to support analytics (Hex), API use cases, Elasticsearch indexes, and ML models
Implement and operate workflows in Airflow (MWAA), including dependency management, scheduling, retries, and alerting via Slack
Build robust data quality and validation checks (schema validation, freshness/volume checks, anomaly detection) and ensure issues are surfaced quickly with monitoring and alerts
Optimize jobs for cost and performance (partitioning, file formats, join strategies, proper use of EMR/Glue resources)
Collaborate closely with data scientists, ML engineers, and application engineers to understand data requirements and design schemas and pipelines that serve multiple use cases
Contribute to internal tooling and shared libraries that make working with our data platform faster, safer, and more consistent
Document pipelines, datasets, and best practices so the broader team can easily understand and work with our data
Qualification
Required
Bachelor's degree in Computer Science, Software Engineering, or a related field, or equivalent practical experience
Experience with Python and distributed data processing using Spark (PySpark) on EMR or a similar environment
Hands-on experience with core AWS data services, ideally including: S3 (data lake, partitioning, lifecycle management), AWS Glue (jobs, crawlers, catalogs), EMR or other managed Spark platforms, Athena/Hive and SQL for querying large datasets, Relational databases such as RDS (PostgreSQL/MySQL or similar)
Experience building and operating workflows in Airflow (MWAA experience is a plus)
Strong SQL skills and familiarity with data modeling concepts for analytics and APIs
Solid understanding of data quality practices (testing, validation frameworks, monitoring/observability)
Comfortable working in a collaborative environment, managing multiple projects, and owning systems end-to-end
Benefits
Health insurance
Retirement plan
Paid time off
Company
Qloo
Qloo develops an AI-based cultural platform to predict consumer taste data and recommendations for companies in various sectors.
Founded in 2012
11-50 employees
H1B Sponsorship
Qloo has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (1)
2024 (1)
Funding
Current Stage
Growth StageTotal Funding
$77MKey Investors
Bluestone Equity PartnersAI VenturesAVP
2024-07-02Private Equity· $20M
2024-02-21Series C· $25M
2022-08-23Series B· $15M
Leadership Team
Alex Elias
Founder and CEO
Jay Alger
Co-Founder and Chief Operating Officer
Recent News
2025-07-19
Company data provided by crunchbase