Apetan Consulting LLC · 3 hours ago
Data Engineer/Python Developer/Remote
United States
Full-time
Remote
Mid LevelApetan Consulting LLC is seeking a Data Engineer/Python Developer to design, build, and maintain ETL/ELT data pipelines. The role involves developing Python-based data processing applications and collaborating with data scientists and analysts to ensure data quality and optimize workflows.
Information Technology
Responsibilities
Design, build, and maintain ETL/ELT data pipelines
Develop Python-based data processing applications
Work with structured and unstructured data at scale
Integrate data from multiple sources (APIs, databases, files, streams)
Optimize data workflows for performance and reliability
Ensure data quality, validation, and monitoring
Collaborate with data scientists, analysts, and backend teams
Manage and maintain data warehouses/lakes
Implement logging, error handling, and automation
Follow best practices for security and compliance
Qualification
Required
Strong Python (Pandas, NumPy, PySpark)
Writing clean, modular, and testable code
SQL (PostgreSQL, MySQL, SQL Server)
Data Warehouses (Snowflake, Redshift, BigQuery)
Apache Spark, Hadoop (preferred)
Batch and streaming data processing
AWS / Azure / GCP
S3, Lambda, Glue, Dataflow, BigQuery, etc
Airflow, Prefect, Luigi (orchestration)
Git, CI/CD
Linux basics
Preferred
Apache Spark, Hadoop (preferred)
Batch and streaming data processing
NoSQL (MongoDB, Cassandra – optional)
Kafka / PubSub (streaming – optional)
Docker, Kubernetes (nice to have)
Company
Apetan Consulting LLC
We are a prominent executive search & selection company, providing a wide range of recruitment solutions for various requirements.
Founded in 2012
201-500 employees
Funding
Current Stage
Growth StageCompany data provided by crunchbase