AllianceIT Inc · 6 hours ago
Senior Data Engineer
AllianceIT Inc is seeking a Senior Data Engineer to build real-time, scalable data pipelines using tools like Spark, Kafka, and cloud services (GCP) for analytics and machine learning. The role involves designing, developing, and maintaining ETL/ELT data pipelines and optimizing data architectures for performance and quality.
Responsibilities
Design, develop, and maintain ETL/ELT data pipelines for batch and real-time data ingestion, transformation, and loading using Spark (PySpark/Scala) and streaming technologies (Kafka, Flink)
Build and optimize scalable data architectures, including data lakes, data warehouses (BigQuery), and streaming platforms
Performance Tuning: Optimize Spark jobs, SQL queries, and data processing workflows for speed, efficiency, and cost-effectiveness
Data Quality: Implement data quality checks, monitoring, and alerting systems to ensure data accuracy and consistency
Qualification
Required
Strong proficiency in Python, SQL, and potentially Scala/Java
Expertise in Apache Spark (Spark SQL, DataFrames, Streaming)
Experience with messaging queues like Apache Kafka, or Pub/Sub
Familiarity with GCP, Azure data services
Knowledge of data warehousing (Snowflake, Redshift) and NoSQL databases
Preferred
Experience with Airflow, Databricks, Docker, Kubernetes is a plus
Company
AllianceIT Inc
AllianceIT is an IT company that provides staffing and recruiting services.
H1B Sponsorship
AllianceIT Inc has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (1)
2024 (1)
2023 (1)
Funding
Current Stage
Early StageCompany data provided by crunchbase