Senior Data Engineer – AI Solutions jobs in United States
cer-icon
Apply on Employer Site
company-logo

Quisitive · 1 day ago

Senior Data Engineer – AI Solutions

Quisitive is a global Microsoft services and solutions partner known for delivering award-winning Microsoft solutions. They are seeking a Senior Data Engineer with strong AI experience to build and maintain data-driven solutions, focusing on large-scale data processing and optimizing pipelines for intelligent applications.

ConsultingInformation TechnologyProfessional Services
badNo H1Bnote

Responsibilities

Building and maintaining backend data ingestion and embedding pipelines
Setting up environments, clone repositories, and running pipelines in JupyterHub
Working on large-scale ETL processes, including converting Iceberg tables to Parquet and exporting data to S3 buckets
Designing and optimizing schemas for Neo4j-based graph solutions
Integrating knowledge workflows and KB articles into graph structures for advanced retrieval
Troubleshooting data quality issues and optimizing Spark jobs for efficiency
Implementing retry mechanisms and debugging full-stack issues related to large file operations
Managing secure access using JWT and Kerberos authentication
Handling credentials for Oracle DB and API clients via HashiCorp Vault
Working with GitLab for source control and Jira for project tracking
Supporting migration efforts from Azure DevOps to GitLab/Jira environments

Qualification

PythonSparkNeo4jOracle DBPower BIJupyterHubHashiCorp VaultETL processesAI-driven solutionsGitLab

Required

Strong proficiency in Python for data processing and pipeline development
Hands-on experience with Spark
Familiarity with Neo4j, LangChain, and LLM integration for AI-driven solutions
Experience with Oracle DB, PostgreSQL, and PGVector for embedding strategies
Comfortable working with S3 buckets, Parquet, and CSV formats
Exposure to embedding models like BGEM 3 and Nomic
Understanding of AI-powered retrieval and recommendation systems
Power BI for dashboard development and reporting
Knowledge of Kerberos authentication and secrets management with HashiCorp Vault

Preferred

Experience with Iceberg and large-scale data frameworks
Experience with IOMETE
JupyterHub for testing/debugging

Company

Quisitive

twittertwittertwitter
company-logo
Microsoft technology consulting. AI, cloud innovation, data and analytics, application development, cybersecurity & managed IT services.

Funding

Current Stage
Public Company
Total Funding
$125.69M
Key Investors
Fax Capital
2024-12-31Acquired
2023-06-21Post Ipo Equity· $4.56M
2021-11-17Post Ipo Equity· $31.72M

Leadership Team

leader-logo
Mike Reinhart
Chief Executive Officer & Director
linkedin
leader-logo
Dan Kunz
Executive Vice President Global Delivery
linkedin
Company data provided by crunchbase