Governance evidence
What agencies reported about the OMB M-25-21 minimum practices for high-impact AI. This is a disclosure analysis, not an audit, a compliance finding or an official assessment. An unanswered question is missing evidence, not evidence that a safeguard is absent.
Practice-by-practice evidence
Denominator: 28 records · use cases that answered at least one practice questionReported in place: 9 (32.1%)Pre-deployment testing
Reported in progress: 18 (64.3%)Pre-deployment testing
No answer reported: 1 (3.6%)
Reported in place: 6 (21.4%)AI impact assessment
Reported in progress: 20 (71.4%)AI impact assessment
No answer reported: 2 (7.1%)
Reported in place: 6 (21.4%)Independent review
Reported in progress: 20 (71.4%)Independent review
Waived by CAIO: 1 (3.6%)Independent review
No answer reported: 1 (3.6%)
Reported in place: 7 (25.0%)Operator training
Reported in progress: 20 (71.4%)Operator training
Other or ambiguous answer: 1 (3.6%)
Reported in place: 6 (21.4%)Fail-safe
Reported in progress: 17 (60.7%)Fail-safe
Not applicable: 5 (17.9%)
| Practice | In scope | In place | In progress | Not in place | N/A | Precluded or waived | Other | No answer | Answered | In place of applicable |
|---|---|---|---|---|---|---|---|---|---|---|
| Pre-deployment testing | 28 | 9 | 18 | 0 | 0 | 0 | 0 | 1 | 96% | 32% of 28 |
| AI impact assessment | 28 | 6 | 20 | 0 | 0 | 0 | 0 | 2 | 93% | 21% of 28 |
| Independent review | 28 | 6 | 20 | 0 | 0 | 1 | 0 | 1 | 96% | 22% of 27 |
| Ongoing monitoring | 28 | 8 | 20 | 0 | 0 | 0 | 0 | 0 | 100% | 29% of 28 |
| Operator training | 28 | 7 | 20 | 0 | 0 | 0 | 1 | 0 | 100% | 25% of 28 |
| Fail-safe | 28 | 6 | 17 | 0 | 5 | 0 | 0 | 0 | 100% | 26% of 23 |
| Appeal process | 28 | 4 | 17 | 0 | 6 | 0 | 0 | 1 | 96% | 18% of 22 |
| User and public consultation | 28 | 7 | 17 | 0 | 0 | 0 | 3 | 1 | 96% | 25% of 28 |
Answered = records with any answer ÷ records in scope. In place of applicable = reported in place ÷ (in scope minus not applicable, precluded and waived). Unanswered records stay in that denominator, so the rate is a lower bound on reported evidence, not an estimate of real practice.
| Testing | Impact assess. | Indep. review | Monitoring | Training | Fail-safe | Appeal | Consultation | n | |
|---|---|---|---|---|---|---|---|---|---|
| DOJ | 0% | 0% | 0% | 0% | 0% | 0% | 0% | 0% | 16 |
| DOE | 80% | 60% | 50% | 80% | 60% | 100% | 50% | 80% | 5 |
| DHS | 75% | 25% | 25% | 25% | 50% | 50% | 100% | 50% | 4 |
| DOL | 100% | 100% | 100% | 100% | 0% | 0% | 100% | 0% | 1 |
| FERC | 100% | 100% | 100% | 100% | 100% | 100% | 0% | 100% | 1 |
| DOI | – | – | 100% | 100% | 100% | 0% | 0% | – | 1 |
Hatched cells: the agency answered nothing for that practice, so there is no evidence either way. Compare agencies with care: each agency is one reporting unit, and portfolios differ in size and type.
Records requiring further investigation
23 records with at least one practice unanswered or in progressOpen in explorer| Use case | Stage | Test | AIA | Review | Monitor | Train | Fail-safe | Appeal | Consult |
|---|---|---|---|---|---|---|---|---|---|
| Babel DHS · DHS-185 | Deployed | Reported in place | Reported in progress | Reported in progress | Reported in progress | Reported in progress | Reported in progress | Reported in place | Other or ambiguous answer |
| CBP Translate DHS · DHS-2388 | Deployed | Reported in place | Reported in progress | Reported in progress | Reported in progress | Reported in place | Not applicable | Not applicable | Reported in place |
| Open Source and Social Media Analysis DHS · DHS-2538 | Deployed | Reported in progress | Reported in progress | Reported in progress | Reported in progress | Reported in progress | Not applicable | Reported in place | Reported in progress |
| AI for Operations Center DOE · DOE-10 | Deployed | Reported in place | No answer reported | No answer reported | Reported in place | Reported in place | Reported in place | No answer reported | Reported in place |
| GitHub Copilot DOE · DOE-586 | Deployed | Reported in place | Reported in place | Reported in place | Reported in place | Reported in progress | Reported in place | Not applicable | Reported in place |
| Scripting DOE · DOE-674 | Deployed | Reported in progress | Reported in progress | Reported in progress | Reported in progress | Reported in progress | Reported in place | Not applicable | Reported in place |
| DocketScope DOI · DOI-0040 | Deployed | No answer reported | No answer reported | Reported in place | Reported in place | Reported in place | Not applicable | Reported in progress | No answer reported |
| Veritone DOJ · DOJ-0050 | Deployed | Reported in progress | Reported in progress | Reported in progress | Reported in progress | Reported in progress | Reported in progress | Reported in progress | Reported in progress |
| Dragon DOJ · DOJ-0057 | Deployed | Reported in progress | Reported in progress | Reported in progress | Reported in progress | Reported in progress | Reported in progress | Reported in progress | Reported in progress |
| Financial and Cryptocurrency Analysis: Federal Partner DOJ · DOJ-0083 | Deployed | Reported in progress | Reported in progress | Reported in progress | Reported in progress | Reported in progress | Reported in progress | Reported in progress | Reported in progress |
| Financial and Cryptocurrency Analysis: Commercial Solution DOJ · DOJ-0084 | Deployed | Reported in progress | Reported in progress | Reported in progress | Reported in progress | Reported in progress | Reported in progress | Reported in progress | Reported in progress |
| Intelligence Data Platform DOJ · DOJ-0088 | Deployed | Reported in progress | Reported in progress | Reported in progress | Reported in progress | Reported in progress | Reported in progress | Reported in progress | Reported in progress |
| Data Synthesis, Sentiment, Filtering, and Location Linking DOJ · DOJ-0121 | Deployed | Reported in progress | Reported in progress | Reported in progress | Reported in progress | Reported in progress | Reported in progress | Reported in progress | Reported in progress |
| Language Translation, Optical Character Recognition (OCR), Object Detection, Language Detection, Alert Noise Reduction DOJ · DOJ-0138 | Deployed | Reported in progress | Reported in progress | Reported in progress | Reported in progress | Reported in progress | Reported in progress | Reported in progress | Reported in progress |
| UpToDate DOJ · DOJ-0170 | Deployed | Reported in progress | Reported in progress | Reported in progress | Reported in progress | Reported in progress | Reported in progress | Reported in progress | Reported in progress |
| Dragon DOJ · DOJ-0196 | Deployed | Reported in progress | Reported in progress | Reported in progress | Reported in progress | Reported in progress | Reported in progress | Reported in progress | Reported in progress |
| Lexis Nexis (People Search) DOJ · DOJ-0213 | Deployed | Reported in progress | Reported in progress | Reported in progress | Reported in progress | Reported in progress | Reported in progress | Reported in progress | Reported in progress |
| Westlaw (People Search) DOJ · DOJ-0217 | Deployed | Reported in progress | Reported in progress | Reported in progress | Reported in progress | Reported in progress | Reported in progress | Reported in progress | Reported in progress |
| Video Transcription Tool DOJ · DOJ-0231 | Deployed | Reported in progress | Reported in progress | Reported in progress | Reported in progress | Reported in progress | Reported in progress | Reported in progress | Reported in progress |
| Open Source Investigative Tool DOJ · DOJ-0233 | Deployed | Reported in progress | Reported in progress | Reported in progress | Reported in progress | Reported in progress | Reported in progress | Reported in progress | Reported in progress |
| Veritone DOJ · DOJ-0244 | Deployed | Reported in progress | Reported in progress | Reported in progress | Reported in progress | Reported in progress | Reported in progress | Reported in progress | Reported in progress |
| Systran Translate Server DOJ · DOJ-0250 | Deployed | Reported in progress | Reported in progress | Reported in progress | Reported in progress | Reported in progress | Reported in progress | Reported in progress | Reported in progress |
| PLX DOJ · DOJ-0270 | Deployed | Reported in progress | Reported in progress | Reported in progress | Reported in progress | Reported in progress | Reported in progress | Reported in progress | Reported in progress |
Unanswered analytical questions
Generated from the data; for follow-up with agencies- VA designated 7 use cases high-impact but answered none of the minimum-practice questions for any of them. Were the practices assessed, and where is that recorded?
- 17 high-impact use cases are reported as deployed while their AI impact assessment is reported in progress. Was deployment authorised before the assessment was complete?
- 2 high-impact use cases mark an appeal process as not applicable. On what basis was each individual outcome judged not contestable?
- 15 high-impact use cases report using PII but give no link to a Privacy Impact Assessment. Is a PIA published elsewhere?
- 3 governance answers are ambiguous (for example, an answer option from a different question). What did the agency intend?
These are questions the inventory raises but cannot answer. They are not findings of non-compliance.