Apply on Employer Site

Presight · 1 month ago

Senior Data Engineer (ETL, Clickhouse)

European Union

Full-time

Onsite

Senior Level

6+ years exp

Presight is a leading big data analytics company powered by Artificial Intelligence, focusing on creating business and societal impact. They are seeking a Senior Data Engineer to assess and analyze complex data sources, providing insights and supporting the integration of these data sources into the Presight AI platform.

AnalyticsArtificial Intelligence (AI)ConsultingInformation Technology

Hiring Manager

Arvin J.

Responsibilities

Solve challenging problems, using python/java/sql coding skills

Design, build and launch new data extraction, transformation & loading processes in production

Strong understanding of Traditional and Modern Data Platforms

Reading and collating complex data sets

Design and Implement complex ETL solutions for Large Datasets

Optimize and Fine Tune SQL and Python code for Performance

Continual focus on process improvement to drive efficiency and productivity within the team

Provide insights into key business performance metrics by building analytical tools that utilize the data pipeline, modelling data for efficient storage and retrieval

Support the wider business with their data needs on an ad hoc basis

Comply with QHSE (Quality Health Safety and Environment), Business Continuity, Information Security, Privacy, Risk, Compliance Management and Governance of Organizations policies, procedures, plans and related risk assessments

Qualification

PythonETLSQLJavaData ModelingBig Data ProcessingProcess ImprovementCommunication SkillsProblem Solving

Required

Bachelor's degree in computer engineering, Computer Science, or Electrical Engineering and Computer Sciences

6+ years of programming experience, solid coding skills in Python, Shell, and Java

Good corporate capacity, good communication skills

Experience with solution architecture, data modelling, query optimization, ETL, ELT concepts

Working knowledge of data platform concepts - data lake, data warehouse, ETL, big data processing (designing and supporting variety/velocity/volume), real time processing architecture for data platforms, scheduling and monitoring of ETL/ELT jobs

Proficiency in SQL/PLSQL (preferably in Clickhouse or any other Column Based Databases) and programming (preferably Java, Python), proficiency in understanding data, entity relationships, structured & unstructured data, SQL and NoSQL databases

Knowledge of best practice in optimizing columnar and distributed data processing system and infrastructure

Experienced in handling Big Data

Knowledge of machine learning and data mining techniques in one or more areas of statistical modelling, text mining and information retrieval