NASA logo
NASA SISM
Intelligent Systems Project
Human-Centered Computing
Research Task
IS Logo

IS Tasks | HCC Tasks | MI Tasks
IS:  Previous | Next  ||  HCC:  Previous | Next


Dialogue Systems

NASA Ames Research Center

Jim Hieronymus (RIACS)



Abstract


Spoken language is a convenient communication technology, especially for space-suited astronauts busy with manual tasks. Investigators are extending speech-recognition capabilities to dialogue-based interaction, for robust performance in specialized tasks even with foreign-accented English. The dialogue system will provide a hands-free interface to complex systems, with interaction via semi-autonomous software agents. A target application will be the reading and recording of checklist procedures, to help astronauts aboard the International Space Station. The system will keep track of procedure state during interruptions, and will be able to review procedure history and answer questions about the steps. (In the past, this task has required full-time participation of a second astronaut.) The dialogue-understanding technology can be applied to other domains, such as ground operations or hands-free data entry and note-taking during exploration activities.


Task Description


Objective:

A spoken dialogue system will be developed, to assist astronauts in performing procedures on the International Space Station (ISS). The speech recognition system will be adapted to accept foreign accented English from an open microphone. Unification grammars will be compiled into speech recognition grammars, with development of new algorithms and an overall spoken dialogue system design.


Applications:

Speech commanding of autonomous systems; conversational astronaut assistants; interaction with ISS systems, robots, or rovers; checklist navigation; just-in-time tutoring; hands-free data entry and note-taking; science data management; mission operations; automated transcription.


NASA Benefit:

Spoken dialogue interfaces will help astronauts and ground controllers interact with complex systems and semi-autonomous agents.


Keywords:

spoken-language interface, dialogue management, conversational assistants, mixed-initiative speech



Research Plan


Prior Technology:

Keyboard input; limited-vocabulary speech recognition; poor noise tolerance; difficulty with accents; rigid procedure sequences; two astronauts required for checklist procedures.


FY04 Milestone:

First prototype of conversational astronaut assistants.



Progress


FY04 Quadchart Slide:

HCC_DIR_Hieronymus_DlgSys.ppt.


Accomplishments:

Requirements analysis; demonstration systems tested; feedback from astronauts incorporated; core dialogue management system.



For More Information


Related Web Pages:

RIACS reseach projects.


Contacts:

James L. Hieronymus (PI), USRA RIACS.



Intelligent Systems | Human-Centered Computing | Multimodal Interfaces
IS:  Previous | Next  ||  HCC:  Previous | Next

Responsible NASA Official: Joseph C. Coughlan.
Project Support: Kenneth I. Laws / Updated: 10-Nov-2004
Mail Stop 269-3, NASA Ames Research Center, Moffett Field, CA 94035-1000

NASA Privacy Statement.
For Section 508-accessible information, contact access@mail.arc.nasa.gov.