Interactive Resources - iR · 11 hours ago
Senior Data Platform Engineer
Tempe, AZ
Full-time
Hybrid
Senior Level, Lead/Staff
$130K/yr - $140K/yr
8+ years expInteractive Resources - iR is seeking a seasoned Databricks Data Engineer with deep expertise in Azure cloud services and the Databricks Lakehouse platform. In this role, you will design and optimize large-scale data pipelines and modernize cloud-based data ecosystems to enable secure, governed data solutions that support analytics and reporting.
Human ResourcesInformation Technology
Responsibilities
Design, build, and optimize large-scale data pipelines on the Databricks Lakehouse platform with a focus on reliability, scalability, and governance
Modernize an Azure-based data ecosystem, contributing to cloud architecture, distributed data engineering, data modeling, security, and CI/CD automation
Develop and optimize ETL/ELT pipelines using Python, PySpark, Spark SQL, and Databricks notebooks
Design and optimize Delta Lake data models for performance, scalability, and data quality
Implement and manage Unity Catalog for role-based access control, lineage, governance, and secure data sharing
Build reusable frameworks using Databricks Workflows, Repos, and Delta Live Tables
Create scalable ingestion pipelines for APIs, databases, files, streaming sources, and master data systems
Automate API ingestion and workflows using Python and REST APIs
Utilize Apache Airflow or similar tools for orchestration and workflow automation
Support data governance, metadata management, cataloging, and lineage initiatives
Enable downstream consumption for BI, analytics, data science, and application workloads
Write and optimize complex SQL/T-SQL queries, stored procedures, and curated datasets
Automate deployments, DevOps workflows, testing pipelines, and workspace configurations
Qualification
Required
8+ years of experience designing and developing scalable data pipelines in modern data warehousing or lakehouse environments
Strong end-to-end ownership of data engineering solutions, from design through production support
Advanced proficiency in SQL, Python, and ETL/ELT frameworks, including performance tuning and optimization
Hands-on experience with Azure, Databricks, and cloud-based data platforms
Experience integrating data platforms with enterprise systems and downstream analytics tools
Ability to lead and coordinate data initiatives across cross-functional and matrixed teams
Preferred
Experience working with regulated or highly governed datasets is a plus
Benefits
401(k) and health insurance options
Opportunities for professional development, training, and long-term career growth
Tuition reimbursement for qualified education and certification expenses
Company
Interactive Resources - iR
Interactive Resources is an information technology company that provides staffing and talent acquisition services.
201-500 employees
Funding
Current Stage
Growth StageLeadership Team
Bryan Carter
Founder & CEO
Derek Gaff
CFO
Company data provided by crunchbase