Oliver James · 7 hours ago
Data Engineer
Oliver James is a leading insurance carrier looking to expand their data engineering team. The Data Engineer will design, develop, and support scalable data solutions, ensuring data reliability and accessibility for analytics and reporting needs.
Staffing & Recruiting
Responsibilities
Design, build, and maintain robust data pipelines and workflows
Develop ETL/ELT solutions using Python and Spark-based technologies
Optimize data processing jobs for performance and reliability
Integrate data from a variety of sources, including APIs, files, and databases
Support data warehousing and analytics use cases with well-modeled, high-quality data
Implement secure access patterns for internal and external data sources
Apply data governance, security, and compliance best practices
Orchestrate and automate data workflows across cloud and on-prem environments
Qualification
Required
Strong, hands-on experience with Databricks and Apache Spark (PySpark preferred)
Proven background building production data pipelines using Python
Advanced SQL skills and experience working with data warehouses
Hands-on experience with at least one major cloud platform (Azure, AWS, or GCP)
Experience working with large-scale data systems and diverse data sources
Familiarity with secure data connectivity methods (e.g., OAuth, service principals, tokens, or similar)
Solid understanding of data security, encryption, and compliance standards
Experience supporting or implementing data governance and data quality initiatives
Demonstrated expertise using Azure Data Factory for workflow orchestration
Company
Oliver James
At Oliver James, we deliver flexible hiring solutions tailored to your business needs across financial services, professional services, commerce & industry.