Big Data Engineer jobs in United States
cer-icon
Apply on Employer Site
company-logo

Noblis ยท 12 hours ago

Big Data Engineer

Noblis is a company that tackles the nation's toughest problems and applies advanced solutions to critical missions. They are seeking a Big Data Engineer to design scalable data architectures and support the development of advanced analytics tools.

Information TechnologyNational SecurityNon Profit
check
Growth Opportunities
badNo H1BnoteSecurity Clearance RequirednoteU.S. Citizen Onlynote

Responsibilities

Design scalable data architectures, leading ETL processes, and oversee the implementation of data storage solutions to include creating, manipulating, and maintaining large databases
Support the development, integration, and visualization of advanced analytics tools, ensuring efficient data access and insights generation
Optimize system performance and scalability, implementing continuous improvement initiatives
Architect, deploy, and maintain multiple, fast-turnaround capabilities used to perform various highly-visible and high-priority collection efforts
Strategically apply AI/ML to extract, format, and expose in indexed search tools relevant content such as raw text, tabular (CSV, Parquet, Avro)
Provide data engineering support to include cleaning, modeling, and formatting data of unknown formats
Move data between different cloud storage environments for critical requests
Coordinate with multiple entities, including mission partners, to ensure capabilities and deliverables meet defined requirements and tradecraft needs
Create and maintain collection capabilities and deliverables within the customer's Amazon Web Services environment
Validate collected data to ensure it meets data format requirements
Document all source code, including how to execute the code
Perform operations and maintenance on the collection capabilities and deliverables to adapt to changes in collection target, technologies, data formats, and naming conventions

Qualification

PythonAWS managementSQLNo-SQL databasesData warehousing conceptsETL processesTableauSalesforceData pipeline optimizationSoft skills

Required

Active Top Secret/SCI clearance with Counterintelligence (CI) Polygraph
US Citizenship is required
Bachelor's degree in Science, Technology, Engineering, or Mathematics (STEM) or related field with 9 years of experience OR Master's degree in STEM field or related with 7 years of experience
Must have one active certification: CCISO, CISM, CISSP, GSLC, SSCP, Security+, OR GSEC
Demonstrated experience with Python
Ability to maintain SQL and NO-SQL databases
Demonstrated experience with Tableau or Salesforce
Ability to create and manage AWS resources, including provisioning EC2 instances, writing and deploying Lambda functions, creating and writing to S3, and managing authorization appropriately across resources with IAM policies

Preferred

Experience optimizing data pipelines, performing large-scale data processing, and ensuring data quality
Strong knowledge of data warehousing concepts, ETL processes, and distributed computing environments

Benefits

Health, life, disability, financial, and retirement benefits
Paid leave
Professional development
Tuition assistance
Work-life programs

Company

Noblis is a nonprofit science, tech strategy organization that works in the public interest to help clients solve most complex problems.

Funding

Current Stage
Late Stage

Leadership Team

leader-logo
Mile Corrigan
President and CEO
linkedin
leader-logo
William Streilein
Chief Technology Officer
linkedin
Company data provided by crunchbase