This job has closed.

INSPYR Solutions · 15 hours ago

Data Engineer II

Houston, TX

Full-time

Onsite

Senior Level

7+ years exp

INSPYR Solutions is a national expert in delivering flexible technology and talent solutions, and they are seeking a Senior Data Engineer (Level II) to design, build, and optimize large-scale data pipelines and lakehouse architectures. The ideal candidate will lead core architectural decisions and deliver scalable data systems while collaborating with various stakeholders.

Information TechnologyProfessional ServicesStaffing Agency

No H1B

U.S. Citizen Only

Responsibilities

Design, build, and maintain ELT pipelines across ingestion, transformation, modeling, and delivery layers (bronze → silver → gold)

Implement incremental loads, change-data-capture (CDC), merge/upsert, and idempotent pipeline patterns to ensure reliability and repeatability

Define and apply data architectural patterns (e.g., layered lakehouse, domain-oriented datasets, and semantic models) aligned to business objectives

Engineer physical data designs including partitioning strategies, partition key selection, clustering/micro-partitioning, and compaction for performance and cost efficiency

Develop curated datasets and data marts that enable analytics and self-service BI

Implement data quality, observability, and lineage (validations, profiling, SLAs, monitoring, and alerting)

Optimize performance on cloud data platforms (e.g., Snowflake tasks/streams, compute sizing, query optimization)

Design and manage Lakehouse table formats (e.g., Apache Iceberg or Delta) on object storage including schema evolution and maintenance

Collaborate with Data Architects, Analytics Engineering, and business stakeholders to translate requirements into scalable data solutions

Mentor junior engineers, lead design reviews, and contribute to engineering standards and reusable frameworks

Automate and optimize the data lifecycle using CI/CD and infrastructure-as-code; apply DevOps principles to data pipelines

Qualification

Data EngineeringSQLPythonELT/ETL PipelinesData Quality FrameworksLakehouse Table FormatsCloud Data PlatformsData ModelingCommunication SkillsMentoring

Required

7–10+ years of experience in Data Engineering or closely related Software Engineering roles with a data focus

Expert-level SQL development and data analysis skills, including advanced query optimization and debugging

Strong Python engineering skills and familiarity with software design principles and patterns (e.g., SOLID), unit testing, refactoring, and version control

Hands-on experience building ELT/ETL pipelines and orchestration with tools such as Astronomer/Airflow; proficiency with GIT and CI/CD

Deep understanding of core data engineering patterns: ingestion, transformation, modeling (dimensional/SCDs), and delivery

Proven experience with database physical design including partitioning and effective partition key selection; exposure to clustering and micro-partitioning on MPP/cloud data platforms

Experience implementing data quality frameworks, observability/monitoring, and robust operational SLAs

Experience with Lakehouse table formats (Apache Iceberg/Delta/Hudi) and columnar storage (Parquet) on object storage (e.g., AWS S3)

Strong communication skills with the ability to present complex technical concepts to both technical and business stakeholders