Apply on Employer Site

Celestar Holdings Corporation · 5 months ago

Expert Statistician/Mathematician (QAF Oversight & Monitoring) - OBIQUA

Reston, VA

Full-time

Onsite

Senior Level, Lead/Staff

20+ years exp

Celestar Corporation is seeking an Expert Statistician/Mathematician to support The Defense Intelligence Agency under the Object Based Intelligence and Quality Assurance task order. The role involves developing and applying mathematical and statistical theories to solve intelligence problems and ensuring compliance in the use of AI systems.

EducationInformation Technology

No H1B

Security Clearance Required

U.S. Citizen Only

Responsibilities

Develops and applies fundamental mathematics, mathematical or statistical theory to collect, organize, interpret and summarize numerical data to generate usable information to solve a wide range of intelligence problems

Applies mathematical theories and statistical methods to solve practical problems

Develops mathematical or statistical models of phenomena for analysis or computational simulation

Designs complex metrics projects that apply valid scientific techniques and utilize information obtained from baselines or historical data to structure analyses

Plans and performs data collection for projects, determining types/sizes of sample groups and prepares data for processing by organizing information and checking for inaccuracies

Processes large amounts of data for statistical modeling and graphic analysis (metrics)

Develops computer code to automate the collecting and processing of data

Produces results of analyses in graphs, charts, tables, and metrics. Prepares products to describe and document findings and activities

Conduct audits to ensure compliant use of AI systems for approved use-cases in all source analysis

Evaluate: AA performance and adherence to tradecraft standards and identify areas for improvement

Develop and maintain a repository of audit findings and recommendations to facilitate knowledge sharing and best practices across the organization

Design and execute TEVV protocols to evaluate the performance, robustness, and fairness of AI systems in all source analysis contexts

Develop and apply statistical models and methods to analyze TEVV results and identify areas for improvement

Collaborate with stakeholders to develop and implement corrective actions to address TEVV findings

Develop and track performance metrics to evaluate the effectiveness of AI systems in all source analysis

Analyze and interpret performance metrics to identify trends, patterns, and areas for improvement

Collaborate with stakeholders to develop and implement data-driven decision-making processes to inform AI system development and improvement

Develop and refine methodologies for evaluating AI system performance, robustness, and fairness in all source analysis contexts

Collaborate with stakeholders to develop and implement best practices for AI system development, testing, and deployment

Publish and present research findings on AI assurance methodologies and best practices

Supports capability development by contributing, editing, and storing code in Government owned/controlled source version control repositories

Qualification

Statistical modelingData analysisMathematical theoryAI system evaluationPerformance metricsAnalytic leadershipTechnical guidanceProblem definitionSurvey execution

Required

Minimum 20 years of experience conducting analysis relevant to the specific labor category with at least a portion of the experience within the last 2 years

Master's degree in an area related to the labor category from a college or university accredited by an agency recognized by the U.S. Department of Education

Demonstrates ability to define problems, supervise studies and lead surveys to collect and analyze data to provide advice and recommend solutions

Demonstrates analytic leadership and expertise in identifying, planning, developing, and executing analytic production methodologies, tradecraft and techniques aligned with labor category mission

Demonstrates extensive ability to provide strategic advice, technical guidance and expertise to Defense planners and policymakers