Innovatix Technology Partners · 2 hours ago
Data Engineer
Innovatix Technology Partners is seeking a Data Engineer to build real-time, scalable data pipelines using tools like Spark and Kafka. The role involves designing and maintaining ETL/ELT data pipelines, optimizing data architectures, and ensuring data quality for analytics and machine learning.
Responsibilities
Design, develop, and maintain ETL/ELT data pipelines for batch and real-time data ingestion, transformation, and loading using Spark (PySpark/Scala) and streaming technologies (Kafka, Flink)
Build and optimize scalable data architectures, including data lakes, data warehouses (BigQuery), and streaming platforms
Performance Tuning: Optimize Spark jobs, SQL queries, and data processing workflows for speed, efficiency, and cost-effectiveness
Data Quality: Implement data quality checks, monitoring, and alerting systems to ensure data accuracy and consistency
Qualification
Required
Strong proficiency in Python
Strong proficiency in SQL
Potentially Scala/Java proficiency
Expertise in Apache Spark (Spark SQL, DataFrames, Streaming)
Experience with messaging queues like Apache Kafka, or Pub/Sub
Familiarity with GCP, Azure data services
Knowledge of data warehousing (Snowflake, Redshift) and NoSQL databases
Experience with Airflow, Databricks, Docker, Kubernetes
Minimum 8 years of total IT experience
4+ years of recent GCP experience
Company
Innovatix Technology Partners
Innovatix delivers AI, cloud, and modernization solutions that drive enterprise innovation and enable digital transformation.
H1B Sponsorship
Innovatix Technology Partners has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (23)
2024 (30)
2023 (16)
2022 (51)
2021 (19)
2020 (39)
Funding
Current Stage
Growth StageCompany data provided by crunchbase