Speech Assist Virtual Interview Assistant

Overview

Development stage

In development or acquisitionSource: a) Pre-deployment – The use case is in a development or acquisition status.

High-impact designation

Not high-impactSource: c) Not high-impact

Impact justification

Not reported

Start date

Not reported

Withheld from public reporting

Not reported

Mission

Topic area

Information Technology

Operational functions

Translation and transcription Derived by keyword rules; see methodology

Problem the AI is intended to solve

Accurate audio processing automation and draft transcription generation to reduce the manual labor intensive associated with transcribing audio interviews and reports, while ensuring Officer-vetted accuracy and nuance.

Expected benefits

To enhance operational efficiency by accelerating the processing and analysis of audio data, resulting in both reduced labor burden and compressed workflow timelines. Speech Assist will offer diarized transcriptions of conversations alongside conversation summaries and named entities extracted from audio captured for various CBP mission use cases. The output will be used to automatically draft a document for review by CBP officers and agents. Speech Assist will reduce the time required for the interpretation, and comprehension of key information from audio data, reducing the time required for transcribing audio reports.

System outputs

The AI system will provide original audio clips alongside feature-rich output reports that include diarized transcriptions, transcript summaries, speaker summaries, and named entities extracted from the audio clips. The diarized transcript will consist of audio segments from the audio clip containing the start and end time of the audio segment, a unique label for the speaker (e.g., Speaker A, Speaker B, etc.), their verbatim speech in the original language. The output is provided as a highly structured nested JSON containing free text that is then used to automatically generate a draft transcription for review.

Technology

AI classification

Generative AISource: Generative AI: AI that generates new or synthetic content (e.g., images, videos, audio, text, code).

System name(s)

Not reported

Custom-developed code

Not reported

Public source code

Not reported

Sourcing

How it was built

Not reported

Vendor (as reported)

Not reported

Vendors (standardized)

None on the standard list

A vendor is the supplier named by the agency. It does not identify the underlying model or AI technology.

Data and privacy

Involves PII

Not reported

Privacy Impact Assessment

Not reported

Authorization to Operate

Not reported

Demographic features

Not reported

Training and evaluation data

Not reported

Federal Data Catalog

Not reported

Governance

0 of 8 minimum-practice questions answered. A blank answer means the agency reported nothing; it does not mean the practice is absent.

Potential impacts and how they were identified

Not reported