Fluent, Inc · 2 days ago

Sr. Data Architect (Databricks)

United States

Full-time

Remote

Senior Level, Lead/Staff

$180K/yr - $215K/yr

8+ years exp

Maximize your interview chances

Ad ServerAd Targeting

Growth Opportunities

No H1B

Insider Connection @Fluent, Inc

Discover valuable connections within the company who might provide insights and potential referrals.
Get 3x more responses when you reach out via email instead of LinkedIn.

Responsibilities

Collaborate closely with product managers and other engineers to understand business priorities, business workflows, and architect data solutions.

You will go well beyond bespoke tables to solve one-off use cases. You will model the enterprise business lines with robust, crisp documentation with target gold tables and pipeline flow.

Evaluate and recommend appropriate tech, tools, and methodologies for data modeling if required. (ERwin, SQLDBM etc).

Develop, deploy, and manage scalable pipelines on Databricks, ensuring robust integration with Databricks Feature Store leveraging online tables for machine learning models.

Investigate and leverage Databricks' capabilities to implement real-time data processing and streaming, potentially using Spark Streaming, Online Tables, Delta Live Tables.

Contribute and maintain the high quality of the code base with comprehensive data observability, metadata standards, and best practices.

Partner with data science and reporting teams to understand data requirements and translate them into models.

Keep track of emerging tech and trends within the Databricks ecosystem

Mentor Junior Data Engineers as the team grows.

Share your knowledge by giving brown bags, tech talks, and evangelizing appropriate tech and engineering best practices.

Define success, utilizing quantitative and qualitative data.

Empower internal teams by providing communication on architecture, target gold tables, execution plans, releases and training.

Qualification

Find out how your skills align with this job's requirements. If anything seems off, you can easily click on the tags to select or unselect skills to reflect your actual expertise.

Data ArchitectureData ModelingDatabricksSQLSparkReal-time ML SystemsProgramming LanguagesData EngineeringData PipelinesFeature StoreEmerging Tech AwarenessMentoringDocumentation