abra · 11 hours ago
Senior Data Engineer – Data Fabric
Center District, Center, IL
Full-time
Onsite
Senior Level
5+ years expabra professional services is seeking a Senior Data Engineer to lead the technical development of their Data Fabric within a military program. This role involves technical leadership in building contextual data pipelines and driving data pipeline automation.
Information TechnologyProduct DesignSoftware
Responsibilities
Lead the technical development of our Data Fabric within a military program
Building contextual data pipelines
Working with big data lakehouse architectures
Driving data pipeline automation
Qualification
Required
5+ years of hands-on experience as a Big Data Engineer
Proven ability to design and deploy Big Data & AI solutions using frameworks and tools such as: Apache NiFi, Kafka, Spark, Graph DB, NoSQL databases
Strong coding proficiency in Python and Bash
Experience building large-scale data pipelines for data processing, transformation, and analytics
Ability to define and manage metadata schemas
Experience developing data workflows (e.g., metadata generation, auto-extraction, validation, format conversion)
Experience developing tools for data observability and compliance analytics
Ability to analyze and report on complex datasets and results
Experience working with big data lakehouse architectures
Ability to explore, enhance, and manage data fusion from multiple data sources
Experience developing analytics tools, algorithms, and programs
Technical leadership of data structure design for contextual pipelines
Collaboration experience with Data Scientists and Architects
Strong ability to work independently, learn new technologies, and apply innovative solutions
Excellent interpersonal skills and ability to work as part of a team
MSc in Computer Science or Data Science
Preferred
Experience with managing metadata and taxonomy concepts alongside big data objects
Experience working with public cloud Big Data & AI services
Familiarity with machine learning concepts
Strong technical skills
Independent, hands-on developer
Curious, open-minded, fast learner, and a strong team player
Company
abra
Devalore (now abra R&D Solutions) is an Israeli based boutique software development company, that is driven by quality and efficiency.
51-200 employees
Funding
Current Stage
Growth StageCompany data provided by crunchbase