SoTalent ยท 9 hours ago
Data Engineer
SoTalent is seeking a Data Engineer to design and build scalable data solutions that power advanced analytics and cloud-based applications. The role involves collaborating with Agile teams to develop data solutions, optimizing data pipelines, and working with big data technologies.
Responsibilities
Collaborate with Agile teams to design, develop, test, and implement data solutions using modern tools and technologies
Build and optimize data pipelines for large-scale processing and analytics
Work with Python, Java, Scala, relational and NoSQL databases, and cloud data warehousing platforms like Redshift and Snowflake
Develop distributed data systems using Hadoop, Spark, Kafka, Hive, EMR, and other big data technologies
Partner with product teams to deliver secure, high-performance data solutions
Stay ahead of emerging technologies and share knowledge within the engineering community
Qualification
Required
Bachelor's degree
3+ years of experience in data engineering or application development
1+ year of experience with big data technologies
Preferred
Extensive programming experience in data engineering or application development using Python, SQL, Scala, or Java
Cloud expertise with at least 2+ years working on AWS, Azure, or GCP, and strong knowledge of data warehousing tools like Redshift or Snowflake
Big data and distributed systems experience with tools such as Hadoop, Spark, Kafka, Hive, and EMR, plus real-time data and streaming applications
Database and OS proficiency, including relational databases (MySQL, PostgreSQL, SQL Server), UNIX/Linux systems, and shell scripting
Agile practices with 2+ years applying Agile methodologies in engineering projects
Company
SoTalent
At SoTechTalent, we specialise in connecting forward-thinking tech companies with world-class talent.
Funding
Current Stage
Early StageCompany data provided by crunchbase