Prudential plc · 17 hours ago
Lead, Data Engineer
Newark, NJ
Full-time
Onsite
Senior Level, Lead/Staff
$134K/yr - $220K/yrPrudential is a leading financial services institution that focuses on digital transformation and innovation. As a Lead Data Engineer on the Investment reporting team, you will collaborate with various professionals to enhance the Investment Data Lake and develop high-quality data pipelines to solve complex business problems.
Asset ManagementConsultingFinancial ServicesHealth CareInsurance
Responsibilities
Build and optimize data pipelines, logic and storage systems with latest coding practices and industry standards and modern design patterns and architectural principles; remove technical impediments
Develop high quality, well documented and efficient code adhering to all applicable Prudential standards
Conduct complex data analysis and report on results, prepare data for prescriptive and predictive modeling, combine raw information from different sources
Collaborate with data analysts, scientists, and architects on data projects to enhance data acquisition, transformation, organization processes, data reliability, efficiency, and quality
Write unit, integration tests and functional automation, researching problems discovered by quality assurance or product support, developing solutions to address the problems
Bring a strong understanding of relevant and emerging technologies, provide input and coach team members and embed learning and innovation in the day-to-day
Work on complex problems in which analysis of situations or data requires an evaluation of intangible variables
Use programming languages including but not limited to Python, R, SQL, Java, Scala, Pyspark/Apache Spark, Shell scripting
Qualification
Required
Bachelor of Computer Science or Engineering or experience in related fields
Experience in working with DevOps automation tools & practices; Knowledge of full software development life cycle (SDLC)
Ability to coach others with minimal guidance and effectively leverage diverse ideas, experiences, thoughts and perspectives to the benefit of the organization
Knowledge of business concepts tools and processes that are needed for making sound decisions in the context of the company's business
Ability to learn new skills and knowledge on an on-going basis through self-initiative and tackling challenges
Excellent problem solving, communication and collaboration skills; enjoy learning new skills!
Advanced experience and/or expertise with several of the following: Programming Language: Python, R, SQL, Java, Scala, Pyspark/Apache Spark, Shell scripting
Data Ingestion, Integration & Transformation: Moving data from multiple sources, formats, and volumes to analytics platforms through various tools. Preparing data for further analysis; transforming and mapping raw data to generate insights and wrangling data through tools
Database Management System: Storing, organizing, managing, and delivering data using relational DBs, NoSQL DBs, Graph DBs, and data warehouse technologies including AWS Redshift and Snowflake
Database tools: Data architecture to store, organize, and manage data. Experience with SQL and NoSQL based databases for storage and processing of structured, semi-structured & unstructured data
Real-Time Analytics: Spark, Kinesis Data Streams
Data Buffering: Kinesis, Kafka
Workflow Orchestration: Airflow, AppFlow, Austosys, Cloudwatch, Splunk
Data Visualization: Tableau, Power BI, MS Excel
Data Lakes & Warehousing: Building Data Models, Data Lakes and Data Warehousing
Data Protection and Security: Knowledge of data protection, security principles and services; data loss prevention, role based access controls, data encryption, data access capture and core security services
Common Infrastructure as Code (IaC) Frameworks: Ansible, CloudFormation
Cloud Computing: Knowledge of fundamentals of AWS architectural principles and services; Strong ability on cloud formation and to write code; Knowledge of AWS core services
Testing/Quality: Unit, interface and end user testing concepts and tooling inclusive of non-functional requirements (performance, usability, reliability, security/vulnerability scanning, etc.) including how testing integrated into Dev Ops; accessibility awareness
Preferred
Serverless data pipeline development using AWS Glue, Lambda and Step functions
Architecture Patterns
Design Thinking
Financial/Insurance industry experience is a plus, not a must
Benefits
Market competitive base salaries, with a yearly bonus potential at every level.
Medical, dental, vision, life insurance, disability insurance, Paid Time Off (PTO), and leave of absences, such as parental and military leave.
401(k) plan with company match (up to 4%).
Company-funded pension plan.
Wellness Programs including up to $1,600 a year for reimbursement of items purchased to support personal wellbeing needs.
Work/Life Resources to help support topics such as parenting, housing, senior care, finances, pets, legal matters, education, emotional and mental health, and career development.
Education Benefit to help finance traditional college enrollment toward obtaining an approved degree and many accredited certificate programs.
Employee Stock Purchase Plan: Shares can be purchased at 85% of the lower of two prices (Beginning or End of the purchase period), after one year of service.
Company
Prudential plc
We are Prudential. For Every Life, For Every Future.
Founded in 1848Central, Hong Kong Island, HKG
10001+ employees
Funding
Current Stage
Late StageLeadership Team
Thomas W Myers, CLU, ChFC
Chief Executive Officer
Recent News
2025-12-04
Company data provided by crunchbase