Data Engineer @ CAI | Jobright.ai
JOBSarrow
RecommendedLiked
0
Applied
0
External
0
Data Engineer jobs in United States
152 applicants
company-logo

CAI · 16 hours ago

Data Engineer

ftfMaximize your interview chances
ConsultingSoftware
check
Work & Life Balance
check
H1B Sponsor Likelynote

Insider Connection @CAI

Discover valuable connections within the company who might provide insights and potential referrals.
Get 3x more responses when you reach out via email instead of LinkedIn.

Responsibilities

Takes a lead role for analyzing, designing, coding, testing and implementing more complex application enhancements, as well as providing general production support, meeting defined scope, target dates and budgets with minimal or no defects.
Utilize and participate in the more complex full system development life cycle, per current Highmark SDLC standards.
Take a lead role in collaborating with customers, business analysts, partners, and IT team members to understand business requirements that drive the analysis and design of quality technical solutions.
Concentrate on providing innovative solutions to more complex business needs.
Perform work in compliance with all Highmark and Highmark IT standards, policies and procedures.
Actively take a leading role and participates on project teams in various project roles, including, but not limited to, Developer, Technical Lead and Project Manager, based upon level of experience.
Effectively communicate with team members, customers, partners and management, including assisting with or conducting more complex technical walkthroughs, reporting project status, enabling vendor solutions and providing accurate and concise documentation.
Other duties as assigned or requested.

Qualification

Find out how your skills align with this job's requirements. If anything seems off, you can easily click on the tags to select or unselect skills to reflect your actual expertise.

Google Cloud PlatformDatabricksSparkPythonData EngineeringETLData Quality ValidationData IngestionData TransformationBigQueryPostgreSQLPub/SubDataflowRoot Cause AnalysisIssue ResolutionHealthcare ExperienceSoftware Development Life CycleBusiness ProcessesCertifications PythonCertifications DatabricksCertifications GCP

Required

Bachelor’s degree in Information Technology, Computer Science or closely related field
5 years of experience as a developer
3 years of experience in Databricks technology and be experienced in working with Databricks notebooks, clusters, and jobs. They should be able to optimize and troubleshoot Databricks workflows.
Deep understanding of Spark and its core concepts
Proficient in Spark programming Python, Pyspark
Strong data engineering skills, including experience with data ingestion (batch and streaming), data transformation, and data quality validation.
Familiar with ETL and have hands-on experience with data pipelines and data orchestration tools
Expertise with GCP, including services like Google Cloud Storage, BigQuery, Pub/Sub, and Dataflow
Problem solving, root cause analysis, and issue resolution
Demonstrated leadership skills
Experience in Healthcare or Health Insurance Industry
Experience with Databricks, GCP, application development tools, business processes, software development life cycle used by Highmark enterprise

Preferred

Master’s degree in Information Technology, Computer Science or closely related field
5 years of experience as a developer with demonstrated skills in: Databricks and Python/Pyspark
GCP: Big Query and PostgreSQL
Certifications such as Python, Databricks, GCP

Company

CAI is a global technology services firm with over 8,700 associates worldwide and a yearly revenue of $1 billion+.

H1B Sponsorship

CAI has a track record of offering H1B sponsorships. Please note that this does not guarantee sponsorship for this specific role. Below presents additional info for your reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2023 (24)
2022 (35)
2021 (36)
2020 (46)

Funding

Current Stage
Late Stage

Leadership Team

leader-logo
Tom Salvaggio
President and CEO
linkedin
leader-logo
Tony Salvaggio
Founder and CEO
linkedin
Company data provided by crunchbase
logo

Orion

Your AI Copilot