Comcast · 1 day ago
Platform Software Engineer, Kubernetes
West Chester, OH
Full-time
Onsite
Mid, Senior Level
$115K/yr - $172K/yr
5+ years expComcast is a Fortune 30 global media and technology company seeking a Platform Engineer responsible for building and managing the infrastructure for large-scale data processing workloads. The role focuses on optimizing environments for data engineers and data scientists, ensuring robust and cost-efficient execution of Spark jobs.
Telecom & CommunicationsCloud ComputingVideoInternetTelecommunicationsTVWeb Hosting
Responsibilities
Architecting and managing the platforms where Spark runs, such as Kubernetes clusters, or cloud services like AWS (EKS)
Packaging Spark workloads (often via Docker/Kubernetes) and integrating them with orchestration systems like Apache Flyte
Deploying Infrastructure via Terraform/Ansible
Troubleshooting and resolving job failures, memory/resource issues, and execution anomalies. This includes optimizing Spark configurations to reduce cloud compute and storage costs
Building automation and tools in languages like Python, Java, or Scala, Linux Scripting (Bash) to increase the productivity of development teams
Write medium to complex SQL Queries as needed
Implementing and maintaining systems for monitoring, logging, and alerting (e.g., Prometheus, Grafana) to ensure platform stability and reliability
Working closely with data engineers, data scientists, and other engineering teams to define requirements, advise on best practices, and ensure successful delivery of data objectives
Engaging with open-source communities (like Apache Spark, Delta Lake, or Apache Iceberg) to discuss technical challenges and contribute improvements
Create and maintain comprehensive documentation for Kubernetes infrastructure, processes, and procedures. Provide training and support to team members as needed
Qualification
Required
Bachelor's degree in computer science or a related field, or equivalent experience, typically 5 years in a DevOps or Systems Engineering role
Expertise in Apache Spark: Deep understanding of Spark architecture, including RDDs, DataFrames, execution hierarchy, lazy evaluation, shuffling, and fault tolerance
Proficiency in languages used for Spark development and automation, such as Python, Pyspark and Scala/Java
Proficient in Linux Scripting (Bash)
Proficient in writing SQL
Experience in CI/CD tools, Github
Experience in setting up and using observability tools like Prometheus, Grafana etc
Knowledge on networking concepts like TCP/IP, DNS, Load Balancer etc
Automation via Terraform/Ansible
Hands-on experience with on-prem and major cloud providers (AWS, Azure, GCP) and container orchestration tools like Docker and Kubernetes
Hands-on experience setting up IAM, VPC, EC2 etc
Familiarity with related technologies and formats like Delta Lake, Apache Iceberg, Apache Kafka, Hadoop, and various data storage systems (S3, HDFS, etc.)
Strong analytical skills for debugging complex distributed systems issues
Strong communication and collaboration abilities
Preferred
Nice to have experience with Catalogs like Hive Metastore, Unity Catalog (Databricks and Open Source)
Nice to have experience setting up, maintaining caching layers like Alluxio
Benefits
Commission under the terms of an applicable plan
Bonus
Best-in-class Benefits
Company
Comcast
Comcast is a media and technology company that provides broadband internet, mobile services, and entertainment platforms. It is a sub-organization of SkyShowtime.
10001+ employees
H1B Sponsorship
Comcast has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (705)
2024 (561)
2023 (624)
2022 (750)
2021 (588)
2020 (583)
Funding
Current Stage
Public CompanyTotal Funding
$4.92BKey Investors
California Public Utilities CommissionMassachussetts Broadband InstituteMaine Connectivity Authority
2025-11-13Grant· $3.2M
2024-07-02Grant· $2.69M
2023-04-24Grant· $0.28M
Leadership Team
Neil Smit
President and Chief Executive Officer
Candy Lawson
SVP, Chief Compliance Officer and Senior Deputy General Counsel
Recent News
Bizjournals.com Feed (2025-11-12 15:43:17)
2026-02-09
2026-02-07
2026-02-05
Company data provided by crunchbase