InfoVision Inc. ยท 1 hour ago
Senior Data Engineer
InfoVision Inc. is seeking a Senior Data Engineer to build ETLs using Spark and SQL, as well as real-time and batch pipelines using Kafka and Firehose. The role involves implementing and maintaining high-performance data structures and managing data pipelines for analytics and operational use.
Responsibilities
Building ETLs using Spark and SQL, real-time and batch pipelines using Kafka/firehose
Implementing and maintaining high performance / high availability data structures
Designing and implementing ETL processes
Managing data pipelines for analytics and operational use
Designing and maintaining data schema life-cycles
Qualification
Required
Strong organizational and analytical skills related to working with structured and unstructured data operations
Experience implementing and maintaining high performance / high availability data structures
Experience in relational SQL and NoSQL databases
High proficiency in Python, Spark, SQL and/or Scala
Experience in designing and implementing ETL processes
Experience in managing data pipelines for analytics and operational use
Strong understanding of in-memory processing and data formats (Avro, Parquet, Json etc.)
Experience in AWS cloud services: EC2, MSK, S3, RDS, SNS, SQS
Experience in stream-processing systems: i.e., Storm, Spark-Structured-Streaming, Kafka consumers
Experience in data pipeline and workflow management tools: i.e., Apache Airflow, AWS Data Pipeline
Experience in big data tools: i.e., Hadoop, Spark, Kafka
Experience in software engineering tools/practices: i.e., GitHub, VSCode, CI/CD
Experience in data observability and monitoring
Hands-on experience in designing and maintaining data schema life-cycles
Preferred
Good to have Experience in tools like Databricks, Snowflake and ThoughtSpot
Company
InfoVision Inc.
Infovision, founded in 1995, is a leading global IT services company offering enterprise digital transformation and modernization solutions across business verticals.
H1B Sponsorship
InfoVision Inc. has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (94)
2024 (59)
2023 (59)
2022 (72)
2021 (65)
2020 (90)
Funding
Current Stage
Late StageLeadership Team
Recent News
2023-02-01
2022-04-08
Business Wire India
2022-03-24
Company data provided by crunchbase