Senior Data Engineer jobs in United States
cer-icon
Apply on Employer Site
company-logo

AllianceIT Inc · 7 hours ago

Senior Data Engineer

AllianceIT Inc is seeking a Senior Data Engineer to build real-time, scalable data pipelines using tools like Spark, Kafka, and cloud services (GCP) for analytics and machine learning. The role involves designing, developing, and maintaining ETL/ELT data pipelines and optimizing data architectures for performance and quality.

Human ResourcesStaffing Agency
check
Growth Opportunities
check
H1B Sponsor Likelynote
Hiring Manager
Gaurav Sharma
linkedin

Responsibilities

Design, develop, and maintain ETL/ELT data pipelines for batch and real-time data ingestion, transformation, and loading using Spark (PySpark/Scala) and streaming technologies (Kafka, Flink)
Build and optimize scalable data architectures, including data lakes, data warehouses (BigQuery), and streaming platforms
Performance Tuning: Optimize Spark jobs, SQL queries, and data processing workflows for speed, efficiency, and cost-effectiveness
Data Quality: Implement data quality checks, monitoring, and alerting systems to ensure data accuracy and consistency

Qualification

Apache SparkPythonSQLApache KafkaGCPData WarehousingScalaAirflowDatabricksDockerKubernetes

Required

Strong proficiency in Python, SQL, and potentially Scala/Java
Expertise in Apache Spark (Spark SQL, DataFrames, Streaming)
Experience with messaging queues like Apache Kafka, or Pub/Sub
Familiarity with GCP, Azure data services
Knowledge of data warehousing (Snowflake, Redshift) and NoSQL databases

Preferred

Experience with Airflow, Databricks, Docker, Kubernetes is a plus

Company

AllianceIT Inc

twittertwittertwitter
company-logo
AllianceIT is an IT company that provides staffing and recruiting services.

H1B Sponsorship

AllianceIT Inc has a track record of offering H1B sponsorships. Please note that this does not guarantee sponsorship for this specific role. Below presents additional info for your reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (1)
2024 (1)
2023 (1)

Funding

Current Stage
Early Stage

Leadership Team

leader-logo
Purushothama Polkampalli
President & CEO
linkedin
Company data provided by crunchbase