HHS · no agency ID · record R0998

OSPIDA RPAB Scientific Coding Assistance Tool (CAT)

Department of Health and Human Services · HHS/NIH

Overview

Development stage: PilotSource: b) Pilot – The use case has been deployed in a limited test or pilot capacity.
High-impact designation: Not high-impactSource: c) Not high-impact
Impact justification: Not reported
Start date: 2025-01 (month precision)Source: Jan-25
Withheld from public reporting: NoSource: a) No

Mission

Topic area: Administrative Functions
Operational functions: Software development assistance Derived by keyword rules; see methodology

Problem the AI is intended to solve

OSPIDA's Referral Program and Analysis Branch (RPAB) is responsible for scientific coding assignments of grant applications. They assign scientific codes to grants based on different objectives, selecting from a list of over 3,000 scientific codes related to NIAID's research areas.

Expected benefits

RPAB's Scientific CAT will significantly save time spent on the initial manual assignment of scientific codes and promote consistency in coding across applications.

System outputs

The models output scientific code predictions by objective, which are displayed in the SCORS application used by RPAB to review grants.

Technology

AI classification: Natural language processingSource: Natural Language Processing: AI that processes, interprets, and shares information in human language.
System name(s): SCORS Coding Assistance Tool (CAT)
Custom-developed code: Yes
Public source code: Not reported

Sourcing

How it was built: Contract and in-houseSource: c) Developed with both contracting and in-house resources
Vendor (as reported): Deloitte
Vendors (standardized): Deloitte

A vendor is the supplier named by the agency. It does not identify the underlying model or AI technology.

Data and privacy

Involves PII: No
Privacy Impact Assessment: Not reported
Authorization to Operate: Yes
Demographic features: k) None of the above
Training and evaluation data: Multiple years of grant data and RPAB scientific coding assignment data were used to train the NLP models, a different set of grant data and RPAB sicnetific coding assignment data were used to evaluate model metrics from the trained NLP models.
Federal Data Catalog: Not reported

Governance

0 of 8 minimum-practice questions answered. A blank answer means the agency reported nothing; it does not mean the practice is absent.

Pre-deployment testingNo answer reported

AI impact assessmentNo answer reported

Independent reviewNo answer reported

Ongoing monitoringNo answer reported

Operator trainingNo answer reported

Fail-safeNo answer reported

Appeal processNo answer reported

User and public consultationNo answer reported

Potential impacts and how they were identified

Not reported