Automated Realtime Global Organization Specialist (ARGOS) for Company Registration Submissions to E-Verify

Overview

Development stage

DeployedSource: c) Deployed – The use case is being actively authorized or utilized to support the functions or mission of an agency.

High-impact designation

High-impactSource: a) High-impact

Impact justification

Not reported

Start date

2023-08-12 (day precision)Source: 2023-08-12T00:00:00

Withheld from public reporting

Not reported

Mission

Topic area

Administrative Functions

Operational functions

Risk scoring and triage Derived by keyword rules; see methodology

Problem the AI is intended to solve

The goal of the use case is to leverage sentiment analysis in ARGOS to streamline the process and accelerate work for the individual who is researching a company that has submitted its information for registration to E-Verify.

Expected benefits

ARGOS sentiment analysis produces a risk score and keyword extraction identifies the keyword category of interest to the VAC MPAs (management and program analyst) for the aggregated open-source information to help quickly identify any pertinent information to aid the MPAs in their open-source investigation of company applications. This saves potentially thousands of MPA man hours in open-source investigation and creates a single source-of-truth for each MPAs investigation of a company application. This, in turn, allows for quicker application processing and, if risk of company fraud exists, much faster referral processing time quickening the next-step referral to FDNS for further investigations.

System outputs

Responses back to a user dashboard accessible internally only by VAC Management and Program Analyst (MPA) personnel. Keywords relating to the MPA's work interest are extracted if present and risk scores are assigned to the open-source collected information. The data is presented to the MPA on the GUI (graphical user interface) dashboard.

Technology

AI classification

Natural language processingSource: Natural Language Processing: AI that processes, interprets, and shares information in human language.

System name(s)

ARGOS (Automated Real-Time Global Organization Specialist)

Custom-developed code

Yes

Public source code

Not reported

Sourcing

How it was built

Contract and in-houseSource: c) Developed with both contracting and in-house resources

Vendor (as reported)

IBM

Vendors (standardized)

IBM

A vendor is the supplier named by the agency. It does not identify the underlying model or AI technology.

Data and privacy

Involves PII

No

Privacy Impact Assessment

Not reported

Authorization to Operate

Yes

Demographic features

Not reported

Training and evaluation data

The fine-tuned dataset is collected from open-source queries from the Bing API connected to the ARGOS system. This is publicly available data that doesn't contain any PII.

Federal Data Catalog

Not reported

Governance

8 of 8 minimum-practice questions answered. A blank answer means the agency reported nothing; it does not mean the practice is absent.

Potential impacts and how they were identified

Lack of Domain-Specific Accuracy: model tested on company data across different industries resulted in inconsistent performance. Limited Generalization to Unseen Data: model’s performance on validation datasets lower than on training data, indicating potential overfitting. Misinterpretation of Sentiment: instances of sarcasm/irony not recognized. All risks identified in testing and evaluation phases.