The Cigna Group · 1 day ago

Application Development, Sr. Advisor

St. Louis, MO

Full-time

Remote

Senior Level

5+ years exp

Maximize your interview chances

CommercialHealth Care

Insider Connection @The Cigna Group

Discover valuable connections within the company who might provide insights and potential referrals.
Get 3x more responses when you reach out via email instead of LinkedIn.

Responsibilities

Perform complex data transformation, aggregation, cleansing, and de-normalization using Databricks, AWS, Spark-SQL, PySpark, and Scala for data pipelines handling millions of records.

Create script to process, assemble and manage large, complex sets of data and ensure that the final data meets non-functional and functional business requirements.

Create custom scripts for data extract, map, transform and load validation in cloud data store S3, RDS, DynamoDB.

Implement process to validate accuracy, consistency, and quality for data pipeline between different source and target system.

Identify risk, assumption, constraint and implement approved action and workaround to minimize the impact of risk on the project.

Work with stakeholders including Product, Data and Design team to support their data needs while assisting with data processing/management validation.

May work remotely.

Qualification

Find out how your skills align with this job's requirements. If anything seems off, you can easily click on the tags to select or unselect skills to reflect your actual expertise.

DatabricksAWSSpark-SQLPySparkData TransformationCloud Big DataHadoopScalaData ValidationS3RDSDynamoDBData Processing

Required

Requires a bachelor’s degree in computer science, electronics engineering, or a related field, and 5 years of IT experience (or a master’s degree and 3 years of IT experience).

Must have experience designing and implementing scripts to validate that data meets the business requirements and industry standards, as well as cloud big data experience, including: Databricks; Hadoop; AWS cloud big data tools; open search clusters to perform complex queries; and, transformations and processing of data.