Apply on Employer Site

Bestow · 5 hours ago

Data Engineer II

United States

Full-time

Remote

Mid Level

4+ years exp

Bestow is a leading vertical technology platform focused on modernizing life insurance. The Data Engineer II role involves building robust data solutions, improving data architecture, and collaborating with various teams to enhance data reliability and efficiency within the company's platform.

Developer APIsFinTechInsuranceInsurTechLife Insurance

Comp. & Benefits

Responsibilities

Build robust solutions for transferring data from first and third-party applications to and from our data warehouse

Making decisions as a team. The things you build will be maintained and improved upon by others; there is a shared responsibility to make defensible design considerations and high collaboration

Develop hardened and repeatable (CI/CD) data models and pipelines to enable reporting, modeling and machine learning

Improve data availability to our enterprise clients through a mix of traditional push delivery, cloud, and event-driven (eg: API, grpc) data sharing methods

Ensure data quality through automated monitoring and alerting, and occasionally serving within an on-call rotation

Leverage Google Cloud (GCP) tools (eg: Cloud Run, Cloud Functions, Vertex AI, App Engine, Cloud Storage, IAM, etc.) and services (eg: Astronomer - Apache Airflow) to bring data workloads to production

Drive and support MLOps to improve Data Science monitoring and governance

Enable and support Generative AI (eg: LLM) pipelines, allowing internal teams to quickly prototype. Support the architecture and rollout of GenAI products and features into the marketplace

Collaborate with product, engineering, stakeholders and data teams to deliver informed solutions to platform and client needs

Qualification

Data pipeline designGoogle Cloud (GCP)Python programmingMachine Learning (ML)SQL expertiseCI/CD pipelinesData orchestration toolsInfrastructure as Code (IAC)Data governanceAdaptabilityCollaboration

Required

4+ years working in a data engineering role that supports incoming/outgoing products supporting internal and external customers

2+ years demonstrated expertise in designing an end-to-end data pipeline in cloud frameworks (such as GCP, AWS, Azure) with requirements from multiple stakeholders

2+ years of Python or similar experience writing efficient, testable, and readable code

2+ years experience in building streaming data ingestion pipelines

1+ year of ML (Machine Learning) support and implementation or MLOps

Deep SQL experience with columnar databases such as Google BigQuery, Snowflake, or Amazon Redshift

Demonstrated experience with AI Coding assistants – AI tools are heavily engrained in Bestow culture

Experience building CICD pipelines for data processing using tools such as Docker, CircleCI, dbt, git, etc

Able to manage infrastructure using IAC tools such as Terraform or Pulumi

Experience with common data orchestration tools such as Apache Airflow (or similar) to manage SLOs and processing dependencies

Experience with creating alerts and monitoring pipelines which contribute to overall data governance

Experience with containerization and container orchestration technologies with cloud architecture and implementation features (single- and multi-tenancy, orchestration, elastic scalability)

Familiarity with standard IT security practices such as identity and access management (IAM), data protection, encryption, certificate, and key management

Adaptability to learn new technologies and products as the job demands