Horizontal Talent · 8 hours ago
Sr Data Engineer
Horizontal Talent is seeking a Senior Data Engineer in a dynamic remote role that leverages Python and AI expertise to develop scalable solutions. The role involves designing services focused on automation, enhancing AI communication, and managing data pipelines while collaborating with cross-functional teams.
Responsibilities
Design and develop services using Python that focus on automation and optimization
Enhance agent communication in AI systems with MCP frameworks
Transform and manage data pipelines to expand AI capabilities
Deploy and optimize solutions on major cloud platforms to ensure efficiency
Work closely with diverse teams to deliver integrated solutions
Maintain high standards of code quality, security, and maintainability
Qualification
Required
High proficiency in Python, including API development and async processing
Experience designing AI agents and implementing coordination frameworks
Strong background in managing SQL and NoSQL databases
Competence in using cloud technologies like Azure, AWS, or Google Cloud
Skilled in CI/CD processes and deployment in cloud-native environments
Preferred
Knowledge of vector databases and embedding techniques
Understanding of MLOps or LLMOps for operational efficiency
Experience with streaming data and event-driven architecture
Familiarity with security and compliance for AI systems
Background in regulated sectors like healthcare