Apply on Employer Site

Waste Connections · 1 month ago

Platform Architect Manager - Cloud Data Solutions

The Woodlands, TX

Full-time

Onsite

Senior Level

7+ years exp

Waste Connections is seeking an experienced Platform Architect Manager - Cloud Data Solutions to design, build, and optimize their cloud-based data platforms. This strategic role involves collaborating with cross-functional teams to deliver scalable, secure, and high-performance data solutions that drive business innovation.

Environmental ConsultingEnvironmental EngineeringRecycling

Responsibilities

Architect and implement robust data lake solutions on AWS, leveraging services such as S3, Glue, Databricks, and advanced AI/ML tools like Polly, Transcribe, and Bedrock for scalable analytics, machine learning, and generative AI workflows

Design and automate ETL pipelines using AWS Glue and Databricks, ensuring efficient data ingestion, transformation, and integration across diverse sources, including speech-to-text and text-to-speech capabilities

Lead the adoption and implementation of Infrastructure-as-Code (IaC) using Terraform to provision, manage, and scale cloud resources securely and efficiently

Develop and maintain CI/CD pipelines for data engineering and analytics projects, integrating tools such as Jenkins, GitHub Actions, or AWS CodePipeline to streamline deployment and testing

Establish and enforce data governance frameworks, including policies for data quality, security, privacy, and compliance (e.g., SOC 2, HIPAA, GDPR)

Collaborate with engineering, data science, and DevOps teams to optimize platform architecture for performance, reliability, and cost-effectiveness

Evaluate and integrate emerging technologies—including AWS Polly, Transcribe, and Bedrock—to enhance platform capabilities and operational workflows

Provide technical leadership and mentorship to team members, fostering a culture of innovation and continuous improvement

Qualification

AWSDatabricksETL GlueTerraformCI/CD pipelinesData governanceData lake architectureAWS AI/ML servicesScripting languagesTeam-buildingLeadershipCommunicationProblem-solving

Required

Bachelor's or Master's degree in Computer Science, Engineering, or related field

7+ years of experience in cloud data architecture, with a focus on AWS and Databricks

Hands-on expertise in AWS services (S3, Glue, IAM, Lambda, Redshift, Polly, Transcribe, Bedrock, etc.) and Databricks for big data analytics, machine learning, and generative AI

Proficient in designing and automating ETL workflows using AWS Glue and Databricks

Strong experience with Terraform for Infrastructure-as-Code and cloud resource management

Deep understanding of CI/CD pipeline design and implementation for data platforms

Proven track record in data governance, security, and compliance for cloud environments

Experience architecting and managing large-scale data lake solutions

Proficiency in scripting languages (Python, Bash, etc.) and containerization/orchestration tools (Docker, Kubernetes)