Next Ventures · 17 hours ago
Data Platform Engineer
United States
Full-time
Remote
Mid Level
$130K/yr - $160K/yr
3+ years expNext Ventures is a company that has developed an integrated technology platform for managing connected spaces. They are seeking a Data Platform Engineer to build and maintain production data pipelines for sports and entertainment venues, ensuring the delivery of high-quality data for various applications.
Staffing & Recruiting
Responsibilities
Build, deploy, and maintain production data pipelines using Azure Data Factory and Synapse Analytics following established architectural patterns
Ingest high-volume data from venue event streams, ticketing platforms, and POS systems using Azure Event Hubs and Stream Analytics
Write and optimize data transformations in PySpark and Spark SQL within Azure Databricks to process millions of records per hour
Implement and manage data storage across Azure Data Lake Gen2, Synapse, and SQL Server based on existing data models
Deploy Azure data services using Terraform within established infrastructure patterns
Build automated validation and unit testing to ensure pipeline reliability and data quality across multi-tenant environments
Own pipeline monitoring, troubleshoot failures, and resolve data issues to meet SLA commitments
Collaborate with Senior Data Engineers to turn technical designs into performant, production-ready code
Qualification
Required
3-5 years building and deploying production data pipelines in a cloud environment
Strong Python skills, specifically PySpark and pandas, for building reusable transformation modules
Solid SQL skills with a focus on writing efficient queries against large datasets
Production experience with a major cloud data stack (Azure preferred; equivalent AWS or GCP experience is fine since patterns transfer)
Familiarity with CI/CD practices and pushing code through automated pipelines (GitHub Actions, Azure DevOps, or similar)
Track record of owning pipeline reliability, not just initial builds but ongoing monitoring and incident response
Builder mindset: you care about code quality, performance, and shipping on schedule
Experience with ticketing, point-of-sale, or venue management data systems
Knowledge of sports and entertainment industry data
Experience with real-time analytics and dashboard development (Power BI, Tableau)
Company
Next Ventures
Next Ventures is a multi-award winning, global I.T recruitment business, supplying specialist project teams to the Large Enterprise.
51-200 employees
Funding
Current Stage
Growth StageCompany data provided by crunchbase