TREAS · TREAS-IRS-105 · record R2824

Qualitative Text Classification for Analysis

Department of the Treasury · Internal Revenue Service (IRS)

Overview

Development stage: In development or acquisitionSource: a) Pre-deployment – The use case is in a development or acquisition status.
High-impact designation: Not high-impactSource: c) Not high-impact
Impact justification: The output is not presumed to be high-impact and is not used as the principal basis for significant decisions/actions
Start date: Not reported
Withheld from public reporting: NoSource: a) No

Mission

Topic area: Administrative Functions
Operational functions: No function tag matched Derived by keyword rules; see methodology

Problem the AI is intended to solve

The AI tool, leveraging internal large language models, is intended to increase the operational efficiency of qualitative research within Small Business / Self-Employed (SB/SE) Research, increase research scope, complexity, and decrease overall time to customer.

Expected benefits

Leveraging the generative AI applications within the large language model will allow analysts to benefit from an automated secondary analysis, improving overall reliability of analytical deductions and validating manually derived analytical outputs.

System outputs

The AI system's output combines with the non-AI derived manual analysis, extrapolating based on manually derived analysis and using unsupervised and supervised methodologies to correlate data into classes. Essentially, we are taking unstructured data and using various inputs, we are leveraging the AI to classify and structure the data to assist in mass text analysis.

Technology

AI classification: Generative AISource: Generative AI: AI that generates new or synthetic content (e.g., images, videos, audio, text, code).
System name(s): Not reported
Custom-developed code: Not reported
Public source code: Not reported

Sourcing

How it was built: Not reported
Vendor (as reported): Not reported
Vendors (standardized): None on the standard list

A vendor is the supplier named by the agency. It does not identify the underlying model or AI technology.

Data and privacy

Involves PII: Not reported
Privacy Impact Assessment: Not reported
Authorization to Operate: Not reported
Demographic features: Not reported
Training and evaluation data: Not reported
Federal Data Catalog: Not reported

Governance

0 of 8 minimum-practice questions answered. A blank answer means the agency reported nothing; it does not mean the practice is absent.

Pre-deployment testingNo answer reported

AI impact assessmentNo answer reported

Independent reviewNo answer reported

Ongoing monitoringNo answer reported

Operator trainingNo answer reported

Fail-safeNo answer reported

Appeal processNo answer reported

User and public consultationNo answer reported

Potential impacts and how they were identified

Not reported