Be an early applicantLess than 25 applicants

Company

DDN Storage · 2 days ago

Staff Software Engineer – Infinia Data Engineer

United States

Full-time

Remote

Lead/Staff

8+ years exp

Maximize your interview chances

Artificial Intelligence (AI)Big Data

H1B Sponsor Likely

Insider Connection @DDN Storage

Discover valuable connections within the company who might provide insights and potential referrals.
Get 3x more responses when you reach out via email instead of LinkedIn.

Responsibilities

Design and enhance the core components of Infinia to run open-source technologies with high performance and scalability.

Create and implement optimized execution plans to run on Infinia, leveraging its high-performance and scalability capabilities.

Optimize data storage and retrieval using Parquet, ORC, HDFS, and other formats

Contribute to the open-source community when appropriate by collaborating on projects and integrating new features.

Solve complex data processing challenges at scale, pushing the boundaries of what’s possible with distributed data platforms.

Work closely with the wider Infinia organization, including data scientists and other engineers, to deliver high-quality solutions.

Provide technical leadership and mentorship to junior engineers

Qualification

Find out how your skills align with this job's requirements. If anything seems off, you can easily click on the tags to select or unselect skills to reflect your actual expertise.

ScalaJavaPythonApache SparkApache IcebergDelta LakeParquetORCHDFSAvroBig Data TechnologiesReal-time Data ProcessingStreaming FrameworksTechnical Leadership

Required

Bachelor’s or Master’s degree in Computer Science, Software Engineering, or a related field.

8+ years of software engineering experience, with 5+ years in big data technologies

Strong expertise in Scala, Java, and Python

Proven expertise with Apache Spark, Apache Iceberg, and Delta Lake.

Hands-on experience with Parquet, ORC, HDFS, Avro, and other data formats

Preferred

Experience with real-time data processing and streaming frameworks

Previous experience as Apache committer to relevant open-source projects

Proven ability to lead technical projects and mentor other engineers

Company

DDN Storage

DDN is the world’s largest private data storage company and the leading provider of intelligent technology and infrastructure solutions for data-centric organizations.

Founded in 1998

Chatsworth, California, USA

501-1,000 employees

http://www.ddn.com

H1B Sponsorship

DDN Storage has a track record of offering H1B sponsorships. Please note that this does not guarantee sponsorship for this specific role. Below presents additional info for your reference. (Data Powered by US Department of Labor)

Distribution of Different Job Fields Receiving Sponsorship

Represents job field similar to this job

Trends of Total Sponsorships

2023 (1)

2022 (1)

2021 (6)