HHS · no agency ID · record R0877

Machine Learning as a Service: Extract data from product labels, business forms, and image files

Department of Health and Human Services · HHS/FDA/ODT

Overview

Development stage: DeployedSource: c) Deployed – The use case is being actively authorized or utilized to support the functions or mission of an agency.
High-impact designation: Not high-impactSource: c) Not high-impact
Impact justification: Not reported
Start date: 2022-01 (month precision)Source: Jan-22
Withheld from public reporting: NoSource: a) No

Mission

Topic area: Health and Medical
Operational functions: Document processing and extraction Derived by keyword rules; see methodology

Problem the AI is intended to solve

This AI project is designed to assist in capturing data submitted to & reviewed by the FDA by extracting text and data, determining its structure, and saving the information in a more useful format

Expected benefits

The ability to extract information such as nutrition information and ingredients from product labels, tabular data, invoices and receipts, and handwritten forms without the need to have users retype or copy & paste the data into FDA applications.

System outputs

Parsed text and data structured in JSON format, with key/value pairs where appropriate (such as for specific fields in a form or nutrient name & amount on a product label)

Technology

AI classification: Classical / predictive MLSource: Classical/Predictive Machine Learning: Models trained on data to make predictions or classifications based on identified patterns or relatio…
System name(s): MLaaS
Custom-developed code: Yes
Public source code: git.fda.gov ↗

Sourcing

How it was built: Contract and in-houseSource: c) Developed with both contracting and in-house resources
Vendor (as reported): Precise
Vendors (standardized): None on the standard list

A vendor is the supplier named by the agency. It does not identify the underlying model or AI technology.

Data and privacy

Involves PII: No
Privacy Impact Assessment: Not reported
Authorization to Operate: Yes
Demographic features: k) None of the above
Training and evaluation data: Makes use of Google Translation Hub
Federal Data Catalog: Not reported

Governance

0 of 8 minimum-practice questions answered. A blank answer means the agency reported nothing; it does not mean the practice is absent.

Pre-deployment testingNo answer reported

AI impact assessmentNo answer reported

Independent reviewNo answer reported

Ongoing monitoringNo answer reported

Operator trainingNo answer reported

Fail-safeNo answer reported

Appeal processNo answer reported

User and public consultationNo answer reported

Potential impacts and how they were identified

Not reported