Senior Data Engineer jobs in United States
cer-icon
Apply on Employer Site
company-logo

InfoVision Inc. ยท 11 hours ago

Senior Data Engineer

InfoVision Inc. is seeking a Senior Data Engineer to build ETLs using Spark and SQL, as well as real-time and batch pipelines using Kafka and Firehose. The role involves implementing and maintaining high-performance data structures and managing data pipelines for analytics and operational use.

Information Technology & Services
check
Growth Opportunities
check
H1B Sponsor Likelynote
Hiring Manager
Harsha Nagaraj
linkedin

Responsibilities

Building ETLs using Spark and SQL, real-time and batch pipelines using Kafka/firehose
Implementing and maintaining high performance / high availability data structures
Designing and implementing ETL processes
Managing data pipelines for analytics and operational use
Designing and maintaining data schema life-cycles

Qualification

ETL processesPythonSparkSQLKafkaAWS servicesNoSQL databasesData pipeline managementAnalytical skillsData observabilitySoftware engineering toolsData schema managementOrganizational skills

Required

Strong organizational and analytical skills related to working with structured and unstructured data operations
Experience implementing and maintaining high performance / high availability data structures
Experience in relational SQL and NoSQL databases
High proficiency in Python, Spark, SQL and/or Scala
Experience in designing and implementing ETL processes
Experience in managing data pipelines for analytics and operational use
Strong understanding of in-memory processing and data formats (Avro, Parquet, Json etc.)
Experience in AWS cloud services: EC2, MSK, S3, RDS, SNS, SQS
Experience in stream-processing systems: i.e., Storm, Spark-Structured-Streaming, Kafka consumers
Experience in data pipeline and workflow management tools: i.e., Apache Airflow, AWS Data Pipeline
Experience in big data tools: i.e., Hadoop, Spark, Kafka
Experience in software engineering tools/practices: i.e., GitHub, VSCode, CI/CD
Experience in data observability and monitoring
Hands-on experience in designing and maintaining data schema life-cycles

Preferred

Good to have Experience in tools like Databricks, Snowflake and ThoughtSpot

Company

InfoVision Inc.

company-logo
Infovision, founded in 1995, is a leading global IT services company offering enterprise digital transformation and modernization solutions across business verticals.

H1B Sponsorship

InfoVision Inc. has a track record of offering H1B sponsorships. Please note that this does not guarantee sponsorship for this specific role. Below presents additional info for your reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (94)
2024 (59)
2023 (59)
2022 (72)
2021 (65)
2020 (90)

Funding

Current Stage
Late Stage

Leadership Team

leader-logo
Mohit Punj, CFA, CPA
Chief Financial Officer
linkedin
leader-logo
Sampath Paranavitane
Vice President | Senior Client Partner
linkedin
Company data provided by crunchbase