Snowrelic Inc ยท 5 months ago
Sr. Data Engineer with Insurance Domain(W2)
United States
Full-time
Remote
Senior Level, Lead/Staff
15+ years expSnowrelic Inc is seeking a Senior Data Engineer with extensive experience in the insurance domain. The role involves designing, developing, and maintaining data pipelines, implementing Delta Lake architecture, and collaborating with data scientists and analysts to create scalable data solutions.
Cloud ComputingInformation TechnologySoftware Engineering
Responsibilities
Design, develop, and maintain data pipelines using Python, PySpark, and Spark SQL to process and transform large-scale datasets
Implement Delta Lake architecture to ensure data reliability, consistency, and integrity for large, distributed datasets
Utilize serverless data infrastructure (e.g., AWS Lambda, Azure Functions, Databricks) to build scalable and cost-efficient data solutions
Collaborate with Data Scientists and Analysts by creating reusable Jupyter Notebooks for data exploration, analysis, and visualization
Optimize and manage data storage and retrieval processes, ensuring high performance and low latency
Implement best practices for data security, governance, and compliance within the data infrastructure
Work closely with cross-functional teams to understand data requirements and deliver solutions aligned with business objectives
Continuously monitor, troubleshoot, and improve the performance of data processing pipelines and infrastructure
Qualification
Required
15+ years of experience in data engineering or related fields
Strong programming skills in Python with experience in data processing frameworks like PySpark
Extensive hands-on experience with Apache Spark and Spark SQL for processing and querying large datasets
Expertise with Delta Lakes for implementing scalable data lakehouse architectures
Experience with Jupyter Notebooks for prototyping and collaboration with data teams
Familiarity with serverless data technologies such as AWS Lambda, Azure Functions, or similar platforms
Proficient in working with cloud platforms such as AWS, Azure, or Google Cloud
Experience with data pipeline orchestration tools (e.g., Apache Airflow, Prefect, or similar)
Solid understanding of data warehousing, ETL/ELT pipelines, and modern data architectures
Strong problem-solving skills and ability to work in a collaborative environment
Experience with CI/CD pipelines and DevOps practices is a plus
Preferred
Experience with Databricks for data engineering workflows
Familiarity with modern data governance practices and tools like Apache Atlas or AWS Glue
Knowledge of machine learning workflows and how data engineering supports AI/ML models
Company
Snowrelic Inc
Snowrelic Inc was founded by technology professionals with a vision to provide quality and cost-effective Modern IT solutions.
11-50 employees
H1B Sponsorship
Snowrelic Inc has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (2)
2024 (5)
2023 (10)
2022 (3)
Funding
Current Stage
Early StageLeadership Team
Raja Saleru
Global IT Sales Head - North America and India
Company data provided by crunchbase