AM Best · 1 day ago
Sr. Data Engineer
Oldwick, NJ
Full-time
Hybrid
Senior Level
7+ years expAM Best is seeking a Sr. Data Engineer who will be responsible for ensuring dependable and effective data processes and solutions. This role combines skills from data engineering, software engineering, and IT operations to develop and maintain a sophisticated platform for data and analytics.
Financial Services
Responsibilities
Build high performance data systems including databases, APIs, and data integration pipelines
Implement a metadata-driven architecture and infrastructure as code approach to automate and simplify the design, deployment, and management of data systems
Facilitate the adoption of data and software engineering best practices, including code review, testing, and continuous integration and delivery (CI/CD)
Develop and establish a data governance framework
Continuous monitoring of process performance and implement improvements for efficiency including fine-tuning existing ETL processes, optimizing queries, or refactoring code
Assess and make optimal use of cloud platforms and technologies, especially Azure and Databricks to enhance system architecture
Implement data quality checks and build processes to identify and resolve data issues
Create and maintain documentation for data architecture, standards, and best practices
Contribute designs, code, tooling, testing, and operational support
Identify opportunities for process optimization and automation to enhance data operations efficiency
Provide technical leadership to the data engineering team and actively lead design discussions
Ensure that the new data infrastructure remains modern and efficient by staying knowledgeable of the latest tools, technologies, and methodologies in the data and analytics space
Qualification
Required
7 plus years of experience working as a Data Engineer, Data Architect, Database Developer or similar roles
Bachelor's Degree in Computer Science, Data Science, Engineering or related field
7+ years of experience in programming languages such as Python, Scala, Java, Rust or similar
7+ years of experience in Oracle OLTP database design and development
7+ years of experience in building ETL / ELT data pipelines using Apache Spark, Airflow, dbt or similar
7 years of experience in developing APIs that include REST, SOAP, RPC, GraphQL or similar
7 years of experience in OLAP / data warehouse design and development using dimensional (Kimball star-schema), data vault or Inmon methodologies
5 years of experience in NoSQL database design and development preferably on MongoDB or similar
5 years of experience working with message broker platforms like RabbitMQ, Apache Kafka, Red Hat AMQ or similar
5 years of experience working with Azure or AWS cloud-native technologies / services
Working knowledge of CI/CD automation tools or services like Jenkins, Ansible, Chef, Puppet or similar
Working knowledge of containerized platform or services like Docker, Kubernetes or similar
Must be hands-on, have a passion for data and problem solving, and an innovative mind-set to help deliver results across projects
Preferred
Experience working with Databricks data intelligence platform
Experience working with business intelligence tools / platforms like PowerBI, Cognos, Tableau or similar
Experience working with caching databases: Memcache, Redis or similar
Experience working with search databases and platforms: Elasticsearch, Apache Solr or similar
Experience working with data modeling tools: ERwin, ERStudio, Navicat, SqlDBM or similar
Knowledge of data governance tools: Colibra, Alation or similar
Knowledge of master data management tools: Informatica, TIBCO, Riversand, Ataccama or similar
Benefits
Flexible and hybrid work arrangements
Paid time off/Paid company holidays
Medical plan options/prescription drug plan
Dental plan/vision plan options
Flexible spending and health savings accounts
401(k) retirement savings plan with a Roth savings option and company matching contributions
Educational assistance program
Company
AM Best
AM Best is a global provider of data analytics, news publishing, and credit rating services with a focus on the insurance sector
501-1000 employees
Funding
Current Stage
Late StageLeadership Team
Alfred Magilton Best
Founder
Recent News
2025-12-08
Company data provided by crunchbase