Data Operations Engineer jobs in United States
cer-icon
Apply on Employer Site
company-logo

Inclusion Cloud ยท 2 months ago

Data Operations Engineer

Inclusion Cloud is seeking a Data Operations Engineer who will be responsible for monitoring and managing the maintenance of multiple data ETL pipelines. The role involves ensuring the integrity, accuracy, and reliability of data across the organization while facilitating the onboarding of new data pipelines and products.

Business DevelopmentCloud ComputingComputerInformation TechnologyMobileSoftwareSoftware EngineeringStaffing Agency
check
Growth Opportunities
check
H1B Sponsor Likelynote

Responsibilities

Contribute to the maintenance, documentation, and monitoring of supported data pipelines
Continuously analyze supported data workflows for opportunities to improve reliability and timeliness against established SLAs
Conceive, develop, and apply improvements to workflows and monitoring to minimize the occurrence and impact of defects
Communicate with stakeholders when data is in error or is delayed, with clear plans and timelines for recovery, and future prevention
Develop modifications to workflows using git and github
Assist with production support tickets and inquiries from consumers of supported data pipelines
Facilitate the onboarding of new products and pipelines into our suite of supported production processes

Qualification

PythonSQLSpark/PySparkShell scriptingLinux environmentsCI/CD principlesData visualizationGit/GithubBig data environmentsAnalytical skillsCommunication skillsCritical thinking

Required

B.S. in computer science or information systems fields required, or 5+ years related work experience
Strong analytical, critical thinking skills used to solve complex problems
Strong technical background with a mix of development and automation skills
Outstanding attention to detail and consistently meets deadlines
Exceptional communication and interpersonal skills
Ability to work alongside a highly collaborative team, but also a self-starter, able to work independently with little guidance
Experience in troubleshooting, performance tuning, and optimization
Proficient in shell scripting, Python, Scala or other programming languages
Knowledge of Spark/PySpark
Excellent SQL knowledge, ability to read/write SQL queries
Skilled in Hive (HQL) and HDFS
Experience working with both unstructured and structured data sets, including flat files, JSON, XML, ORC, Parquet and AVRO
Comfortable working with big data environments and dealing with large diverse data sets
Proficient in Linux environments
Familiarity with source code management/versioning tools such as Github
Understanding of CI/CD principles and best practices in data processing
Experience building data visualization dashboards to capture data quality metrics using tools like Tableau, Big Data Studio

Preferred

Understanding of public cloud technologies such as AWS, GCP and Azure is a plus

Company

Inclusion Cloud

twittertwittertwitter
company-logo
We create amazing cloud experiences. We are providers of technologies that lead the cloud revolution.

H1B Sponsorship

Inclusion Cloud has a track record of offering H1B sponsorships. Please note that this does not guarantee sponsorship for this specific role. Below presents additional info for your reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (3)
2020 (1)

Funding

Current Stage
Growth Stage

Leadership Team

leader-logo
Mariano Baca Storni
CEO & Co-Founder
linkedin
Company data provided by crunchbase