CloudApper AI · 1 month ago
Data Engineer (Contract) (Remote)
CloudApper AI is at the forefront of cloud technology, pioneering advanced, AI-driven solutions. They are seeking a skilled Data Engineer to develop and optimize data pipelines and contribute to cloud-based projects in a remote environment.
Information TechnologySaaSSoftware
Responsibilities
Design, build, and optimize data pipelines, architectures, and data sets
Work with big data technologies to solve complex data processing challenges
Implement ETL processes and data warehousing solutions
Attend meetings, providing pre-sales support and technical insights
Collaborate with cross-functional teams to integrate data solutions into broader projects
Engage in cloud-based data solutions using AWS, Azure, or GCP
Ensure data integrity, efficiency, and scalability in all solutions
Qualification
Required
Strong proficiency in Python
Experience with SQL and NoSQL databases (e.g., MongoDB, Cassandra, DynamoDB)
Expertise in ETL processes and tools
Proficiency in one or more cloud platforms: AWS, Azure, or GCP, with specific technologies including: AWS: Glue, Redshift, EMR, Lambda, S3, Kinesis, Athena; Azure: Databricks, Data Factory, Azure SQL Database, Blob Storage, Event Hubs; GCP: BigQuery, Dataflow, Dataproc, Pub/Sub, Cloud Storage
Familiarity with big data tools like Hadoop, Spark, or Airflow
Experience with Snowflake for cloud data warehousing
Strong problem-solving skills and attention to detail
Excellent English communication skills for client-facing roles and technical discussions
Previous consulting or startup environment experience
Ability to independently handle customer interactions and lead projects
Preferred
Experience with Looker, PowerBI, Tableau, or Grafana for data visualization
Experience with machine learning and analytics
Familiarity with containerization technologies like Docker, Kubernetes, and Infrastructure as Code (IaC) tools like Terraform or AWS CloudFormation
Knowledge of API development and integration
Experience with streaming technologies such as Kafka or Flink
Understanding of data privacy and compliance regulations (e.g., GDPR, HIPAA)
Benefits
Flexible work arrangements to accommodate project needs and personal preferences.
Growth potential in a dynamic environment focusing on AI and cloud technologies.
A culture that values innovation, communication, and proactive problem-solving.
Opportunity to work on innovative projects with significant real-world impact.