Saransh Inc ยท 2 months ago
Lead Data Engineer (Snowflake, Airflow and Graph RAG) - W2 Role
Saransh Inc is seeking a Lead Data Engineer with expertise in Snowflake and Airflow. The role involves data integration and management, implementing architectural blueprints, and ensuring robust data quality and governance for AI-driven analytics.
EmploymentInformation TechnologyStaffing Agency
Responsibilities
Identify and integrate structured, unstructured, and semi-structured data sources
Implement RBAC and develop logical data models, ensuring compliance and data lineage
Document business transformations and establish data quality rules
Create a comprehensive data catalog and register data assets with metadata
Translate and implement the architectural blueprint for the Data Factory
Ensure robust data management and quality to support automated investment processes and AI-driven analytics
Implement Neo4j-powered Knowledge Graph and ensure investment decision traceability
Develop and maintain multi-dimensional asset ontology and temporal versioning
Incorporate GraphRAG for transforming unstructured documents into queryable graph entities
Implement property-based access control and oversee real-time data ingestion pipelines
Oversee scalable data warehousing solutions using Snowflake
Develop frameworks for data quality and governance, including metadata registration and sensitivity/security considerations
Qualification
Required
Strong proficiency in Snowflake and Airflow (mandatory)
Deep knowledge of GraphRAG and Graph Data Structures
Strong background in Data Architecture/Design with experience in market data sources
Experience integrating heavy AI-driven architectures
Ability to share knowledge with project and client teams on Cypher, Graph, and RAG traversals
Identify and integrate structured, unstructured, and semi-structured data sources
Implement RBAC and develop logical data models, ensuring compliance and data lineage
Document business transformations and establish data quality rules
Create a comprehensive data catalog and register data assets with metadata
Translate and implement the architectural blueprint for the Data Factory
Ensure robust data management and quality to support automated investment processes and AI-driven analytics
Implement Neo4j-powered Knowledge Graph and ensure investment decision traceability
Develop and maintain multi-dimensional asset ontology and temporal versioning
Incorporate GraphRAG for transforming unstructured documents into queryable graph entities
Implement property-based access control and oversee real-time data ingestion pipelines
Oversee scalable data warehousing solutions using Snowflake
Develop frameworks for data quality and governance, including metadata registration and sensitivity/security considerations
Preferred
AWS experience is a plus
Visa Independent candidates are preferred
Company
Saransh Inc
We provide recruitment, consulting and IT services for our clients, which focus on maximizing their revenue generation, enhancing business productivity and improving cost management.