Novia Infotech · 5 hours ago
Data Engineer
Novia Infotech is looking for a skilled Data Engineer to join their team. The ideal candidate will be responsible for building and managing data pipelines, developing scalable data solutions, and working with large datasets to support data analytics and business intelligence initiatives.
Responsibilities
Design, develop, and maintain ETL pipelines using Databricks, PySpark, and Python
Write efficient SQL queries for data extraction, transformation, and loading from various data sources
Work with structured and unstructured data from multiple sources
Optimize data workflows for performance and scalability
Collaborate with Data Scientists, Analysts, and Business teams to understand data requirements
Monitor and troubleshoot data pipeline performance and data quality issues
Implement best practices for data security, quality, and governance
Qualification
Required
Strong experience in Databricks and PySpark for data processing
Proficient in Python for scripting and automation
Good knowledge of SQL for querying relational databases
Experience in building and managing ETL processes
Understanding of distributed data processing frameworks
Strong problem-solving and analytical skills
Preferred
Knowledge of cloud platforms like AWS, Azure, or GCP
Familiarity with data modeling and warehousing concepts
Company
Novia Infotech
At Novia Infotech, we’re more than just a service provider — we’re your partner in professional growth.
Funding
Current Stage
Growth StageCompany data provided by crunchbase