Apply on Employer Site

InfoVision Inc. · 11 hours ago

Sr Data Engineer-ETL

Denver, CO

Contract

Onsite

Senior Level, Lead/Staff

10+ years exp

InfoVision Inc. is seeking a Senior Data Engineer with expertise in ETL processes. The role involves building data pipelines using various technologies and leading projects while mentoring team members.

Information Technology & Services

Growth Opportunities

H1B Sponsor Likely

Hiring Manager

Siva Reddy

Responsibilities

Over 10+ years of experience in the Software Development Industry

We need data Engineering exp - building ETLS using spark and sql, real time and batch pipelines using Kafka/firehose, experience with building pipelines with data bricks/snowflake, experience with ingesting multiple data formats like json/parquet/delta etc

You work well in a collaborative, team-based environment

You are an experienced engineering with 3+ years of experience

You have a passion for big data structures

You possess strong organizational and analytical skills related to working with structured and unstructured data operations

You have experience implementing and maintaining high performance / high availability data structures

You are most comfortable operating within cloud based eco systems

You enjoy leading projects and mentoring other team members

Experience or knowledge of relational SQL and NoSQL databases

High proficiency in Python, Pyspark, SQL and/or Scala

Experience in designing and implementing ETL processes

Experience in managing data pipelines for analytics and operational use

Strong understanding of in-memory processing and data formats (Avro, Parquet, Json etc.)

Experience or knowledge of AWS cloud services: EC2, MSK, S3, RDS, SNS, SQS

Experience or knowledge of stream-processing systems: i.e., Storm, Spark-Structured-Streaming, Kafka consumers

Experience or knowledge of data pipeline and workflow management tools: i.e., Apache Airflow, AWS Data Pipeline

Experience or knowledge of big data tools: i.e., Hadoop, Spark, Kafka

Experience or knowledge of software engineering tools/practices: i.e., Github, VSCode, CI/CD

Experience or knowledge in data observability and monitoring

Hands-on experience in designing and maintaining data schema life-cycles

Bonus - Experience in tools like Databricks, Snowflake and Thoughtspot

Qualification

ETL processesData pipelinesAWS cloud servicesPythonSparkSQLKafkaData formatsNoSQL databasesData observabilityData schema life-cyclesAnalytical skillsCollaborationOrganizational skills

Required

Over 10+ years of experience in the Software Development Industry

Data Engineering experience - building ETLs using spark and sql, real time and batch pipelines using Kafka/firehose

Experience with building pipelines with data bricks/snowflake

Experience with ingesting multiple data formats like json/parquet/delta etc

BS or MS in Computer Science or similar relevant field

3+ years of experience in engineering

Passion for big data structures

Strong organizational and analytical skills related to working with structured and unstructured data operations

Experience implementing and maintaining high performance / high availability data structures

Comfortable operating within cloud based ecosystems

Enjoy leading projects and mentoring other team members