This job has closed.

BTI360 · 1 day ago

Databricks Data Engineer - Clearance Required

Herndon, VA

Full-time

Onsite

Senior Level

5+ years exp

BTI360 is a data discovery company that leverages AI/ML to turn proprietary data into actionable insights for national security customers. They are seeking a Databricks Data Engineer to design and optimize data pipelines on the Databricks platform, provide technical leadership, and support customer teams in classified environments.

Information TechnologySoftwareSoftware Engineering

Growth Opportunities

No H1B

Security Clearance Required

U.S. Citizen Only

Responsibilities

Design & Optimize Data Pipelines: Build and refine large-scale data pipelines on the Databricks platform to enable data discovery and enrichment for mission-critical applications

Technical Leadership & Advisory: Serve as a Databricks subject-matter expert and trusted advisor to customer teams, providing guidance on architecture, Spark best practices, performance tuning, and innovative big data solutions

Customer Engagements: Deliver short to medium-term professional services engagements in classified or unclassified environments, adapting quickly to new project domains and requirements while delivering solutions on time and to specification

Solution Implementation: Integrate Databricks solutions with complex client systems and workflows, collaborating with BTI360 and customer engineering teams to ensure successful deployment and adoption of new data capabilities

Enablement & Support: Provide hands-on support and training to customer engineers and data teams, helping them maximize platform value (including creating how-to guides, reference architectures, and troubleshooting as needed)

Qualification

Spark & Databricks ExpertiseData Engineering ExperienceCloud & CI/CD ProficiencyConsulting SkillsAdaptabilityActive TS/SCI with PolygraphDatabricks Certified Data Engineer Professional

Required

Active Secret clearance or above, with the ability to be cleared at the TS/SCI with Polygraph level

Spark & Databricks Expertise: Hands-on experience with Apache Spark and the Databricks platform, including building and scaling data pipelines

Data Engineering Experience: 5+ years of experience in data engineering or big data analytics, with strong coding skills in Python and/or Scala/Java for data processing

Cloud & CI/CD Proficiency: Experience developing solutions in cloud environments (AWS and/or Azure) and familiarity with CI/CD pipelines and DevOps practices for deploying data workflows

Consulting Skills: Client-facing communication and problem-solving skills, with the ability to translate complex data challenges into actionable solutions and effectively guide customer teams

Adaptability: Proven ability to thrive in a dynamic environment, capable of juggling multiple projects and quickly learning new datasets, tools, and mission domains as engagements rotate