PTR Global · 5 hours ago
Software Engineer 4 - Contingent
Irving, TX
Contract
Onsite
Senior Level
$70/hr - $76/hr
5+ years expPTR Global is a leading provider of information technology and workforce solutions, seeking a Lead GCP Data Engineer. The role involves consulting on complex software engineering initiatives, designing and developing data pipelines, and collaborating with teams to ensure alignment with target-state architecture.
Information Technology & Services
Responsibilities
Design and develop ETL/ELT workflows and data pipelines for batch and real-time processing
Build and maintain data pipelines for reporting and downstream applications using open-source frameworks and cloud technologies
Implement operational and analytical data stores leveraging Delta Lake and modern database concepts
Optimize data structures for performance and scalability across large datasets
Collaborate with architects and engineering teams to ensure alignment with target-state architecture
Apply best practices for data governance, lineage tracking, and metadata management, including integration with Google Dataplex for centralized governance and data quality enforcement
Develop, schedule, and orchestrate complex workflows using Apache Airflow, with strong proficiency in designing and managing Airflow DAGs
Troubleshoot and resolve issues in data pipelines to ensure high availability and reliability
Qualification
Required
5 years of Software Engineering experience or equivalent, demonstrated through work, consulting experience, training, military experience, or education
Strong understanding of data structures, modeling, and lifecycle management
Hands-on experience designing and managing ETL/ELT data pipelines
Advanced skills in distributed data processing and transformation using PySpark
Experience implementing open table formats for analytics, such as NetApp Iceberg
Knowledge of the Hadoop ecosystem, including HDFS and Hive
Experience with cloud platforms such as GCP (BigQuery, Dataflow), Delta Lake, and Dataplex for governance and metadata management
Proficiency in programming languages such as Python, Spark, and SQL
Strong experience with Apache Airflow, including authoring and maintaining DAGs for complex workflows
Strong understanding of relational and distributed database systems
Benefits
Medical
Dental
Vision
401K contributions
PTO
Sick leave
Other benefits mandated by applicable state or localities where you reside or work
Company
PTR Global
Engage with the largest Latina-owned IT & Professional staffing provider in the U.S.
201-500 employees
Funding
Current Stage
Growth StageCompany data provided by crunchbase