75 applicants

Company

Maximus · 2 days ago

Senior Databricks Developer

United States

Full-time

Remote

Senior Level

$150K/yr - $170K/yr

5+ years exp

Maximize your interview chances

Business Process Automation (BPA)Consulting

No H1B

U.S. Citizen Only

Insider Connection @Maximus

Discover valuable connections within the company who might provide insights and potential referrals.
Get 3x more responses when you reach out via email instead of LinkedIn.

Responsibilities

Provide design and implementation expertise to a cross-functional software development team.

Design and develop software applications from business requirements in collaboration with other team members.

Support testing and remediate defects.

May mentor entry and mid-level developers.

Develop scalable and re-usable frameworks for ingestion and transformation of large data sets.

Work with other members of the project team to support delivery of additional project components (API interfaces, Search).

Work with Batch processes in Databricks.

Work within an Agile delivery / DevOps methodology to deliver proof of concept and production implementation in iterative sprints.

Convert existing Informatica ETL code to Databricks code whenever it is feasible/required.

Create and maintain Databricks queries to support dashboarding and/or reporting activities.

SQL query development and optimization as required to support various reporting needs.

Performance monitoring and diagnosis of the ingest pipeline and suggest continual improvement.

Qualification

Find out how your skills align with this job's requirements. If anything seems off, you can easily click on the tags to select or unselect skills to reflect your actual expertise.

DatabricksPythonPySparkSQLETLCloud SolutionsData WarehousingPerformance TuningRelational DatabasesData Ingestion PipelinesAgileData Management Best PracticesNoSQLRed Hat LinuxData ProfilingEvent-based TechnologiesDatabricks CertificationIRS Knowledge

Required

Bachelor's degree in related field.

5-7 years of related experience required.

Equivalent combination of education and experience considered in lieu of degree.

At least two (2) years of experience with Databricks

Expertise in designing and deploying data applications on cloud solutions, such as Azure or AWS

Comprehensive understanding of data management best practices including demonstrated experience with data profiling, sourcing, and cleansing routines utilizing typical data quality functions involving standardization, transformation, rationalization, linking and matching.

Experience in building ETL / data warehouse transformation processes

Hands on experience in performance tuning and optimizing code running in programming languages such as PySpark and Python

Good understanding of SQL, T-SQL and/or PL/SQL

Demonstrated analytical and problem-solving skills particularly those that apply to a big data environment

Experience working with structured and unstructured data

Experience working in an Agile environment

Experience of working with relational databases: (SQL Server, PostgreSQL)

Candidates must meet requirements to obtain and maintain an IRS Minimum Background Investigation (MBI) clearance (active IRS Moderate Risk MBI clearance is a plus).

Candidates must be a US Citizen or a Legal Permanent Resident (Green Card status) for at least three (3) years, and Federal Tax compliant