28 applicants

Company

Original Job Post

Maximus · 4 days ago

Senior Databricks Developer

United States

Full-time

Remote

Senior Level

5+ years exp

Wonder how qualified you are to the job?

Maximize your interview chances

Business Process Automation (BPA)Consulting

Actively Hiring

Insider Connection @Maximus

Discover valuable connections within the company who might provide insights and potential referrals, giving your job application an inside edge.

Responsibilities

Provide design and implementation expertise to a cross-functional software development team.

Design and develop software applications from business requirements in collaboration with other team members.

Support testing and remediate defects.

May mentor entry and mid-level developers.

Develop scalable and re-usable frameworks for ingestion and transformation of large data sets.

Work with other members of the project team to support delivery of additional project components (API interfaces, Search).

Work with Batch processes in Databricks.

Work within an Agile delivery / DevOps methodology to deliver proof of concept and production implementation in iterative sprints.

Convert existing Informatica ETL code to Databricks code whenever it is feasible/required.

Create and maintain Databricks queries to support dashboarding and/or reporting activities.

SQL query development and optimization as required to support various reporting needs.

Performance monitoring and diagnosis of the ingest pipeline and suggest continual improvement.

Qualification

Find out how your skills align with this job's requirements. If anything seems off, you can easily click on the tags to select or unselect skills to reflect your actual expertise.

DatabricksCloud Solutions (Azure/AWS)Data ManagementETLPerformance TuningPySparkPythonSQLT-SQLPL/SQLStructured DataUnstructured DataRelational Databases SQL ServerRelational Databases PostgreSQLAnalyticalProblem-SolvingAgileIRS Business SystemsNoSQL Data RepositoriesData IngestionStreaming TechnologiesCommand LineRed Hat LinuxDatabricks CertificationFedRAMPFISMAIT Security GuidelinesMBI ClearanceGreen Card StatusFederal Tax Compliance

Required

Bachelor's degree in related field.

5-7 years of related experience required.

At least two (2) years of experience with Databricks

Expertise in designing and deploying data applications on cloud solutions, such as Azure or AWS

Comprehensive understanding of data management best practices including demonstrated experience with data profiling, sourcing, and cleansing routines utilizing typical data quality functions involving standardization, transformation, rationalization, linking and matching.

Experience in building ETL / data warehouse transformation processes

Hands on experience in performance tuning and optimizing code running in programming languages such as PySpark and Python

Good understanding of SQL, T-SQL and/or PL/SQL

Demonstrated analytical and problem-solving skills particularly those that apply to a big data environment

Experience working with structured and unstructured data

Experience working in an Agile environment

Experience of working with relational databases: (SQL Server, PostgreSQL)

Preferred

Knowledge of IRS business systems and data

Experience with non-relational / NoSQL data repositories (incl. MongoDB, Cassandra, Neo4J)

Design and implement data ingestion pipelines from multiple sources ensuring the quality and consistency of data is always maintained.

Work with event based / streaming technologies to ingest and process data.

Experience working in a command line environment and a general understanding of Red Hat Linux OS, or other Unix-like OS.

Databricks certification

Knowledge of FedRAMP, FISMA and other Federal IT security guidelines.

Equivalent combination of education and experience considered in lieu of degree.

Candidates must meet requirements to obtain and maintain an IRS Minimum Background Investigation (MBI) clearance (active IRS Moderate Risk MBI clearance is a plus).

Candidates must be a US Citizen or a Legal Permanent Resident (Green Card status) for at least three (3) years, and Federal Tax compliant