Apply on Employer Site

Lilypad CRM · 6 days ago

Data Engineer - AI/ML

Tampa, FL

Full-time

Hybrid

Senior Level

5+ years exp

Lilypad CRM is seeking a Data Engineer with strong AI/ML expertise to modernize and scale their Business Intelligence capabilities. This role will design and build data pipelines, deploy machine learning solutions, and operationalize intelligent analytics to drive decision-making across the organization.

Computer Software

Responsibilities

End-to-end data pipelines and integrations

Advanced SQL optimization and complex query design

Kafka streaming applications and connector development

Databricks workflow development with medallion architecture

Data governance implementation and compliance

Performance tuning for large-scale data processing

Data security and privacy best practices

Apache NiFi pipeline development for invoice and PO processing

Integration with purpose-built data stores (Druid, MongoDB, OpenSearch, Postgres)

Build and maintain end-to-end ML pipelines for training, deployment, and monitoring of models

Design and optimize data architectures for large-scale ML workloads

Explore and implement LLM-based solutions, RAG architectures, and generative AI for business use cases

Cross-functional collaboration with product and engineering teams

Technical mentoring for junior data engineers

Analytical thinking for complex data problems

Stakeholder communication for data requirements

Process improvement and efficiency focus

Quality mindset for data accuracy and reliability

Direct communication with data platform vendors

Evaluates vendor tools for specific data use cases

Provides technical feedback on vendor product roadmaps

Coordinates with vendors for data integration projects

Qualification

Advanced SQLKafkaDatabricksData governancePerformance tuningData securityApache NiFiData integrationML pipelinesData architectureLLM-based solutionsAnalytical thinkingStakeholder communicationProcess improvementQuality mindsetVendor managementCross-functional collaborationTechnical mentoring