Artificial Intelligence Quantified (AIQ)
Funding Agency:
- Department of Defense
AIQ brings together two Technical Areas (TAs) and a government team to test the program
hypothesis. The goal of TA1 is to provide rigorous foundations for understanding and
guaranteeing capabilities across levels; teams proposing for TA1 are expected to be led by
individuals with deep technical expertise, such as pure or applied mathematics, theoretical
computer science, or statistics, or other relevant expertise and demonstrate relevance to AI. The
goal of TA2 is to develop methods for evaluating AI models, integrating and evaluating TA1
results at scale using appropriate research datasets; teams proposing for TA2 are expected to
comprise computational, cognitive, and/or behavioral scientists with expertise in AI evaluation.
A single proposal may address only one of the technical areas; no combined proposals for TA1
or TA2 will be accepted. An organization may submit individual proposals for each TA;
however, no prime or subcontractor proposer will be selected as a performer on both TAs. All
proposals for must address all the requirements for the proposed TA as described in this BAA.
TA1: TA1 proposal teams should directly address at least one of the three capability levels
above. They will be charged with deriving mathematical results related to generalization,
empirically validated, that demonstrate an understanding of factors that affect generalization.
Strong TA1 proposals will explain which level(s) will be their focus, what mathematical
approaches will be used, and why these approaches are promising, both mathematically and
practically. Proposals may follow any approach that is likely to be successful. In particular, the
proposal should argue, presenting any preliminary results and evidence, how their approach is
likely to meet the metrics and milestones of the program. TA1 proposers should develop
software to empirically demonstrate their results and demonstrate their potential to scale and
perform well in program evaluations (see TA2 section below) using their own datasets.
Multiple awards are anticipated
August 13, 2024 at 12:00 PM
The BAA Coordinator for this effort may be reached at:
DARPA/ I2O
ATTN: HR001124S0029
675 North Randolph Street
Arlington, VA 22203-2114