HHS · no agency ID · record R0756

Citation Analysis and Survey Assistant (CASA - Nursing Home Survey CMS 2567)

Department of Health and Human Services · HHS/CMS/CCSQ

Overview

Development stage: DeployedSource: c) Deployed – The use case is being actively authorized or utilized to support the functions or mission of an agency.
High-impact designation: Not high-impactSource: c) Not high-impact
Impact justification: Not reported
Start date: 2024-11 (month precision)Source: Nov-24
Withheld from public reporting: NoSource: a) No

Mission

Topic area: Health and Medical
Operational functions: No function tag matched Derived by keyword rules; see methodology

Problem the AI is intended to solve

CASA enhances the efficiency and effectiveness of monitoring and reviewing nursing home surveys across the US. It enhances how the Quality, Safety, and Oversight Group (QSOG) and Survey Operations Group (SOG) assess how State Survey Agencies (SSAs) are citing nursing home deficiencies, reported on CMS Form 2567, by employing advanced natural language processing and machine learning technologies.

Expected benefits

Speeds up the manual and time-consuming process of survey review and citing nursing home deficiencies, reported on CMS Form 2567, by employing advanced natural language processing and machine learning technologies.

System outputs

An application which provides Nursing Home Oversight groups an interface to view, track and utilize all the features supported by aforementioned ML/AI powered processes.

Technology

AI classification: Natural language processingSource: Natural Language Processing: AI that processes, interprets, and shares information in human language.
System name(s): CDRAP
Custom-developed code: Yes
Public source code: Not reported

Sourcing

How it was built: Developed in-houseSource: b) Developed in-house
Vendor (as reported): Not reported
Vendors (standardized): None on the standard list

A vendor is the supplier named by the agency. It does not identify the underlying model or AI technology.

Data and privacy

Involves PII: No
Privacy Impact Assessment: Not reported
Authorization to Operate: Yes
Demographic features: k) None of the above
Training and evaluation data: It uses data from Nursing Home Care Compare website. A model/process that uses an LLM and few-shot learning to identify Extent and Sample from deficiency text. Accuracy metrics generated by comparing development outcome with labeled data collected from Labeling jobs.
Federal Data Catalog: Not reported

Governance

0 of 8 minimum-practice questions answered. A blank answer means the agency reported nothing; it does not mean the practice is absent.

Pre-deployment testingNo answer reported

AI impact assessmentNo answer reported

Independent reviewNo answer reported

Ongoing monitoringNo answer reported

Operator trainingNo answer reported

Fail-safeNo answer reported

Appeal processNo answer reported

User and public consultationNo answer reported

Potential impacts and how they were identified

Not reported