INSPYR Solutions · 10 hours ago
Lead AWS Data Engineer
Houston, TX
Full-time
Hybrid
Lead/Staff
8+ years expINSPYR Solutions is a national expert in delivering flexible technology and talent solutions. They are seeking a hands-on Lead Data Engineer to modernize an enterprise data platform from legacy systems to a cloud-native AWS lakehouse, focusing on design, code reviews, and mentorship while developing end-to-end data pipelines.
Information TechnologyProfessional ServicesStaffing Agency
No H1B
U.S. Citizen Only
Responsibilities
Design, build, and operate end-to-end, production-grade data pipelines in AWS
Re-engineer legacy ETL into a lakehouse architecture (Bronze/Silver/Gold) on S3
Work hands-on with open table formats in AWS (S3 Tables / Apache Iceberg) and understand their metadata, snapshots, schema evolution, and performance characteristics
Develop pipelines using Python, PySpark, and Spark on AWS Glue and/or EMR
Orchestrate workloads using Airflow or AWS Step Functions
Partner with data architects to translate business requirements into data products
Perform code reviews, mentor engineers, and contribute hands-on in production
Support agile development practices, including planning, demos, and reviews
Qualification
Required
BA/BS in Computer Science, Engineering, or a related field plus at least 8 years of hands-on data engineering experience, or demonstrated equivalent experience and education
Strong, current hands-on experience with AWS data services, including S3 and Spark-based processing
Hands-on experience with an open table format (such as Apache Iceberg, Delta Lake, or Hudi), with a clear understanding of table metadata, schema evolution, partitioning, and performance tradeoffs
Proficiency in Python and PySpark for production data pipelines
Experience designing, building, and operating data pipelines end-to-end in AWS
Experience orchestrating data pipelines using Airflow or AWS Step Functions
Strong communication skills and ability to operate as a hands-on technical lead
Preferred
Master's degree in a relevant field
Experience working with AWS S3 Tables or native Apache Iceberg in AWS environments
Experience modernizing on-prem or legacy data warehouse platforms
Familiarity with lakehouse performance tuning, schema evolution, and partitioning
Experience with data pipeline orchestration frameworks
Exposure to AI/ML data readiness or downstream analytics use cases
Experience working in large, complex enterprise environments
Benefits
Leadership Impact: Shape the direction of our enterprise data platform and mentor the next generation of data engineers
Enterprise Reach: Work with diverse, large-scale datasets from critical business systems.
Modern Tech Stack: AWS-first environment with continuous improvement and best-practice adoption.
Career Growth: Opportunities to advance into architecture or senior leadership roles.
Company
INSPYR Solutions
INSPYR Solutions is a information technology staffing service providers.
501-1000 employees
Funding
Current Stage
Late StageLeadership Team
Gregg Straus
Executive Vice President & Chief Financial Officer
Michelle Wren
Chief Operating Officer
Recent News
2025-09-12
Company data provided by crunchbase