NUI Speech enables your app to accept voice commands from players. With a recognition grammar you provide, the NUI Speech engine can match what players say to a list of vocal commands supported in your app, in English or other supported languages. You can change active grammar rules at any time. This enables the recognition engine to work with a short list of commands appropriate to the current game context.
The NUI Speech API is different from the API used on the Xbox 360; all NUI input is handled by services running in the system resource partition, and apps interact with NUI services to get input. This means that the NUI Speech APIs have been streamlined compared to the Xbox 360 APIs, making for easier implementation of basic scenarios, while still offering the most important advanced features for complex scenarios.
Grammar development for Xbox 360 involved the use of a number of tools to test and tune grammar parameters. You should expect that grammars that were tuned for the Xbox 360 will not yield the same results. We recommend that you use the SpeechLab tool for testing and tuning your speech implementation.
For best results, test speech in an environment that is similar to a living room. For example, an office or conference room with a closed door is preferable to an open plan office setting. When in open environments, it may be better to use text or prerecorded audio input, since ambient noise and conversations will likely generate a high number of false positives.
In this release, the languages listed in the following table are supported.
| Acoustic Model | Language | Country/Region |
|---|---|---|
| DE-DE | German | Germany |
| EN-AU | English | Australia |
| EN-GB | English | United Kingdom |
| EN-US | English | United States |
| EN-CA | English | Canada |
| ES-ES | Spanish | Spain |
| ES-MX | Spanish | Mexico |
| FR-CA | French | Canada |
| FR-FR | French | France |
| IT-IT | Italian | Italy |
| JA-JP | Japanese | Japan |
| PT-BR | Portuguese | Brazil |
Refer to the following white papers.
The full list of white papers is available at Xbox Game Developer: White Papers.
Natural User Interface (NUI) Speech Grammars
Overview of grammars.
Working with grammars in NUI Speech
Details on working with grammars in NUI Speech.
Starting Speech Recognition
How to start speech recognition in NUI Speech.
Working with NUI Speech recognition results
Details on working with NUI Speech recognition results.
Customizing speech recognizer settings in NUI Speech
Details on customizing speech recognizer settings in NUI Speech.
Handling Issues with Audio Input in NUI Speech
Describes how to handle issues with audio input in NUI Speech by using the event AudioProblemOccurred.
Safely Tearing Down Speech Recognizers
You must properly shut down speech recognizers when your application exits.
Enabling Japanese for Speech Profiling
Explains how to enable prototyping of Japanese speech.
Speech and Voice Recommendations
Provides developers information for implementing speech support in an Xbox One ADK application.
Global System Commands
List of global commands for each supported locale.
Speech recognition errors
Speech recognition errors