Algotale Group · 2 months ago
Algotale- GCP Data engineer
United States
Full-time
Remote
Mid LevelAlgotale Group is seeking a highly skilled Data Engineer / Integration Engineer to join their team. The role involves designing, developing, and maintaining scalable data pipelines while ensuring data quality and consistency across platforms.
Human Resources
Responsibilities
Design, build, and maintain scalable data pipelines and workflows
Develop and optimize ETL/ELT processes using Python and workflow automation tools
Implement and manage data integration between various systems, including APIs and Oracle EBS
Work with Google Cloud Platform (GCP) or Google BigQuery (GBQ) for data storage, processing, and analytics
Utilize Apache Spark or similar big data frameworks for efficient data processing
Develop robust API integrations for seamless data exchange between applications
Ensure data accuracy, consistency, and security across all systems
Monitor and troubleshoot data pipelines, identifying and resolving performance issues
Collaborate with data analysts, engineers, and business teams to align data solutions with business goals
Document data workflows, processes, and best practices for future reference
Qualification
Required
Strong proficiency in Python for data engineering and workflow automation
Experience with workflow orchestration tools (e.g., Apache Airflow, Prefect, or similar)
Hands-on experience with Google Cloud Platform (GCP) or Google BigQuery (GBQ)
Expertise in big data processing frameworks, such as Apache Spark
Experience with API integrations (REST, SOAP, GraphQL) and handling structured/unstructured data
Strong problem-solving skills and ability to optimize data pipelines for performance
Experience working in an agile environment with CI/CD processes
Strong communication and collaboration skills
Preferred
Experience with Ascend.io platform for data pipeline automation
Knowledge of SQL and NoSQL databases
Familiarity with Docker and Kubernetes for containerized workloads
Exposure to machine learning workflows is a plus
Benefits
Competitive compensation and benefits.
Company
Algotale Group
Algotale is a premier IT staffing and software solutions provider, delivering top-tier talent and custom-built technology to drive business success.
Founded in 2016
201-500 employees
Funding
Current Stage
Growth StageCompany data provided by crunchbase