Programmers.io · 19 hours ago
GCP Data Engineer
United States
Contract
Remote
Mid, Senior LevelProgrammers.io is looking for a highly skilled and motivated Data Engineer to join their team. The ideal candidate will be responsible for designing, building, and maintaining scalable data infrastructure that supports business intelligence, advanced analytics, and machine learning initiatives.
Enterprise SoftwareInformation TechnologyManufacturingSoftware
No H1B
Responsibilities
Design and Optimization: Design, implement, and optimize clean, well-structured, and performant analytical datasets to support high-volume reporting, business analysis, and data science model development
Pipeline Development: Architect, build, and maintain scalable and robust data pipelines for diverse applications, including business intelligence and advanced analytics
Big Data & Streaming: Implement and support Big Data solutions for both batch (scheduled) and real-time/streaming analytics
Collaboration: Work closely with product managers and business teams to understand data requirements and translate them into technical solutions
DevOps Integration: Collaborate with DevOps teams to ensure smooth deployment, monitoring, and maintenance of data pipelines and infrastructure in cloud environments
Qualification
Required
Extensive hands-on experience working in dynamic cloud environments, with a strong preference for Google Cloud Platform (GCP) services
Expert-level skills in data ingestion, performance optimization, and data modeling within a petabyte-scale environment using BigQuery
Experience with other relevant GCP services like Cloud Storage, Cloud Dataflow/Beam, or Pub/Sub
Expert-level programming proficiency in Python, including experience with relevant data engineering libraries
A solid command of advanced SQL for complex querying, data processing, and performance tuning
Prior experience using workflow management and orchestration tools (e.g., Apache Airflow, Cloud Composer, Dagster, or similar)
Strong understanding of DevOps principles and practices
Experience with CI/CD pipelines, automation tools, and deployment strategies
Familiarity with version control systems (Git) and tools like GitLab CI/CD, GitHub Actions, or Jenkins
Ability to implement monitoring solutions and automate operational tasks to ensure reliability and scalability
Preferred
Knowledge of containerization (Docker) and orchestration tools (Kubernetes) is a plus
Company
Programmers.io
IBM i is evolving. And so are we.
Founded in 2012
1001-5000 employees
Funding
Current Stage
Late StageLeadership Team
Anshul Choudhry
President
Recent News
linkedin.com
2025-12-12
linkedin.com
2025-12-08
Company data provided by crunchbase