Databricks Developer (Java & Apache Spark) with IRS MBI Clearance required jobs in United States
cer-icon
Apply on Employer Site
company-logo

3M Consultancy · 3 days ago

Databricks Developer (Java & Apache Spark) with IRS MBI Clearance required

positionUnited States
timeFull-time
remoteRemote
senioritySenior Level, Lead/Staff
date8+ years exp

3M Consultancy is seeking a Databricks Developer who can design, build, and support large-scale data processing solutions. This role involves working with complex, high-volume data in a secure environment, requiring proficiency in Java and Apache Spark to build reliable data pipelines that meet security and compliance standards.

ConsultingRecruitingStaffing Agency
badNo H1BnoteSecurity Clearance Requirednote

Responsibilities

Build and maintain data pipelines using Apache Spark on Databricks
Write clean and efficient Java (Java 8 or higher) following best coding practices
Work with large structured and semi-structured data sets
Tune Spark jobs to improve performance, stability, and cost
Partner with other teams to understand requirements and deliver solutions
Make sure data handling follows security and governance standards
Investigate and fix issues in production environments

Qualification

Java 8NewerApache SparkData engineeringETL pipelinesPerformance tuningBig Data ToolsAgile teamsData cleansingUnit testingDocumentation

Required

NEED IRS MBI Clearance
Bachelor's degree in Computer Science or a related field
8+ years of hands-on experience in data engineering or big data development
Experience working with large enterprise or government data systems
Good understanding of data structures, security, and compliance
Strong experience with Java 8 or newer
Comfortable with Streams, Lambdas, and object-oriented design
Hands-on experience with Spark Core, Spark SQL, and DataFrames
Understanding of RDDs and when to use them
Experience with batch processing and streaming
Strong skills in Spark performance tuning
Able to debug jobs using Spark UI and logs
Experience with tools like HDFS, Hive, or HBase
Familiar with Kafka, S3, or cloud-based data lakes
Experience with Parquet, Avro, or ORC formats
Experience building batch and real-time ETL pipelines
Skilled in data cleansing, transformation, and enrichment
Experience running Spark on YARN, Kubernetes, or cloud platforms
Familiar with CI/CD tools like Jenkins or GitHub Actions
Experience with monitoring tools and production logs
Unit testing using JUnit or TestNG
Experience with Mockito or similar tools
Comfortable validating data and testing Spark jobs
You're used to working in Agile teams
You document your work clearly
You stay calm and focused when troubleshooting production issues

Preferred

Experience with Scala or Python in Spark
Hands-on experience with Databricks or Google Dataproc
Knowledge of Delta Lake or Apache Iceberg
Background in data modeling and performance design

Company

3M Consultancy

twittertwittertwitter
company-logo
3M Consultancy is a staffing firm that offers contract, temporary, hire, and permanent placement services.
dateFounded in 2018
location
Sheridan, Wyoming, USA
people-size2-10 employees
web-link
https://www.3m-consultancy.com

Funding

Current Stage
Early Stage

Leadership Team

leader-logo
Jonathan Brunt
Co-Founder
linkedin

Recent News

SNS Insider pvt ltd
Global Skin Cancer Treatment Market Size to Reach USD 19.27 Billion by 2032, Driven by Rising Melanoma Cases and Advancements in Immunotherapy | SNS Insider
2025-07-31
Research and Markets
U.S. Residential Water Treatment Systems Market Trends and Growth Drivers Through 2031
2025-07-30
The Gross Law Firm
The Gross Law Firm Reminds Shareholders of a Lead Plaintiff Deadline of September 16, 2025 in Neogen Corporation Lawsuit – NEOG
2025-07-30
Company data provided by crunchbase