Data Engineer (Databricks) jobs in United States
cer-icon
Apply on Employer Site
company-logo

ComResource ยท 1 day ago

Data Engineer (Databricks)

positionColumbus, Ohio Metropolitan Area
timeFull-time
remoteOnsite
senioritySenior Level
date5+ years exp

ComResource is searching for a highly skilled Data Engineer with a background in SQL and Databricks. The role involves designing and constructing scalable management systems, ensuring compliance with company requirements, and researching new data acquisition methods.

CRMInformation TechnologySoftware
check
Comp. & Benefits
check
H1B Sponsor Likelynote

Responsibilities

Design, construct, install, test and maintain data management systems
Build high-performance algorithms, predictive models, and prototypes
Ensure that all systems meet the business/company requirements as well as industry practices
Integrate up-and-coming data management and software engineering technologies into existing data structures
Develop set processes for data mining, data modeling, and data production
Create custom software components and analytics applications
Research new uses for existing data
Employ an array of technological languages and tools to connect systems together
Recommend different ways to constantly improve data reliability and quality

Qualification

DatabricksSQLCloud-based systemsPythonML toolsTest automationData profilingHealthcare data validationDocumentation

Required

5+ years data quality engineering
Experience with Cloud-based systems, preferably Azure
Databricks and SQL Server testing
Experience with ML tools and LLMs
Test automation frameworks
Python and SQL for data quality checks
Data profiling and anomaly detection
Documentation and quality metrics
Test automation and quality process development

Preferred

Healthcare data validation experience preferred
Azure Databricks
Azure Cognitive Services integration
Databricks Foundational model Integration
Claude API implementation a plus
Python and NLP frameworks (spaCy, Hugging Face, NLTK)

Company

ComResource

twittertwittertwitter
company-logo
ComResource is one of IBM's preferred Business Partners in the the IBM Sterling Solutions.
dateFounded in 1991
location
Columbus, Ohio, USA
people-size201-500 employees
web-link
http://comresource.com/

H1B Sponsorship

ComResource has a track record of offering H1B sponsorships. Please note that this does not guarantee sponsorship for this specific role. Below presents additional info for your reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2021 (1)
2020 (3)

Funding

Current Stage
Growth Stage

Leadership Team

leader-logo
Monica Pennington
Director, Data Solutions / Chief Branding & Communications Officer
linkedin
Company data provided by crunchbase