FDIC · FDIC – 32 · record R1058

Automatically-Scored Writing Assessment (AWA)

Federal Deposit Insurance Corporation · Division of Administration

Overview

Development stage: DeployedSource: c) Deployed – The use case is being actively authorized or utilized to support the functions or mission of an agency.
High-impact designation: High-impactSource: a) High-impact
Impact justification: Not reported
Start date: 2008-01 (month precision)Source: 01/2008
Withheld from public reporting: NoSource: a) No

Mission

Topic area: Human Resources
Operational functions: No function tag matched Derived by keyword rules; see methodology

Problem the AI is intended to solve

Reduce the time it takes to review the writing assessment and cost of essay scoring for the purpose of making more timely employment decisions.

Expected benefits

The Automatically-Scored Writing Assessment (AWA) is intended to significantly increase speed and reduce cost of essay scoring for the purpose of employment decisions.

System outputs

A single overall score for the essay on a scale from 1 to 5, as well as three subscale scores ranging from 1 to 5 across the following dimensions: grammar and mechanics, analysis and reasoning, as well as organization and structure.

Technology

AI classification: Classical / predictive MLSource: Classical/Predictive Machine Learning: Models trained on data to make predictions or classifications based on identified patterns or relatio…
System name(s): Not reported
Custom-developed code: No
Public source code: Not reported

Sourcing

How it was built: Contract and in-houseSource: c) Developed with both contracting and in-house resources
Vendor (as reported): Personnel Decisions Research Institutes, LLC (PDRI)
Vendors (standardized): None on the standard list

A vendor is the supplier named by the agency. It does not identify the underlying model or AI technology.

Data and privacy

Involves PII: Yes
Privacy Impact Assessment: Not reported
Authorization to Operate: No
Demographic features: k) None of the above
Training and evaluation data: Not Applicable
Federal Data Catalog: Documentation has been partially completed: Some documentation exists (detailing the composition and any statistical bias or measurement skew for training and evaluation purposes), but documentation took place within this use case’s development.

Governance

0 of 8 minimum-practice questions answered. A blank answer means the agency reported nothing; it does not mean the practice is absent.

Pre-deployment testingNo answer reported

AI impact assessmentNo answer reported

Independent reviewNo answer reported

Ongoing monitoringNo answer reported

Operator trainingNo answer reported

Fail-safeNo answer reported

Appeal processNo answer reported

User and public consultationNo answer reported

Potential impacts and how they were identified

Not reported