← LeaderboardThe Skill Leaderboard

azure-speech

Expert knowledge for Azure Speech in Foundry Tools development including troubleshooting, best practices, decision making, limits & quotas, security, configuration, integrations & coding patterns, and deployment. Use when using Azure STT/TTS, custom voices/avatars, Speech containers, Voice Live, or telephony/agent integrations, and other Azure Speech in Foundry Tools related development tasks. Not for Azure Content Understanding in Foundry Tools (use azure-content-understanding), Azure Translator (use azure-translator), Azure AI Vision (use azure-ai-vision), Azure AI Video Indexer (use azure-v

Published by MicrosoftDocs ↗MicrosoftDocs/Agent-Skills

Try your first task

A source-grounded starter task has not been verified for this skill yet.

SKILL.md

name: azure-speechdescription: Expert knowledge for Azure Speech in Foundry Tools development including troubleshooting, best practices, decision making, limits & quotas, security, configuration, integrations & coding patterns, and deployment. Use when using Azure STT/TTS, custom voices/avatars, Speech containers, Voice Live, or telephony/agent integrations, and other Azure Speech in Foundry Tools related development tasks. Not for Azure Content Understanding in Foundry Tools (use azure-content-understanding), Azure Translator (use azure-translator), Azure AI Vision (use azure-ai-vision), Azure AI Video Indexer (use azure-video-indexer).compatibility: Requires network access. Uses mcp_microsoftdocs:microsoft_docs_fetch or fetch_webpage to retrieve documentation.metadata:   generated_at: "2026-11-01"  generator: "docs2skills/1.0.0"

Azure Speech in Foundry Tools Skill

This skill provides expert guidance for Azure Speech in Foundry Tools. Covers troubleshooting, best practices, decision making, limits & quotas, security, configuration, integrations & coding patterns, and deployment. It combines local quick-reference content with remote documentation fetching capabilities.

How to Use This Skill

IMPORTANT for Agent: Use the Category Index below to locate relevant sections. For categories with line ranges (e.g., L35-L120), use read_file with the specified lines. For categories with file links (e.g., [security.md](security.md)), use read_file on the linked reference file

IMPORTANT for Agent: If metadata.generated_at is more than 3 months old, suggest the user pull the latest version from the repository. If mcp_microsoftdocs tools are not available, suggest the user install it: Installation Guide

This skill requires network access to fetch documentation content:

  • Preferred: Use mcp_microsoftdocs:microsoft_docs_fetch with query string from=learn-agent-skill. Returns Markdown.
  • Fallback: Use fetch_webpage with query string from=learn-agent-skill&accept=text/markdown. Returns Markdown.

Category Index

CategoryLinesDescription
TroubleshootingL36-L44Diagnosing and fixing common Azure Speech issues in Foundry (TTS/STT errors, SDK and container problems, deployment failures, and how to collect session/transcription IDs for support).
Best PracticesL45-L62Best practices for audio/video prep, transcription quality, custom voice/avatars, latency and memory tuning, keyword/phrase accuracy, device design, reliability, and backup/recovery for Azure Speech.
Decision MakingL63-L78Guides for choosing APIs, telephony options, and migration paths for Azure Speech (STT, TTS, custom voice, embedded models), including version upgrades and feature replacements.
Limits & QuotasL79-L86Quotas, limits, and lifecycle rules for Azure Speech: custom speech/voice models and endpoints, supported languages/voices, and capacity constraints for deploying and using Speech services.
SecurityL87-L100Securing Azure AI Speech: auth (Entra, RBAC), network isolation (VNet, Private Link, sovereign clouds), encryption/BYOK/BYOS, compliance/consent, and secure custom/voice/avatar model integration.
ConfigurationL101-L135Configuring Azure Speech/Voice features: recognition, TTS, avatars, containers, logging, storage, SSML, devices, diagnostics, and Voice Live/CLI runtime and connection settings.
Integrations & Coding PatternsL136-L169Patterns and APIs for integrating Azure Speech (STT, TTS, avatars, Voice Live) with apps, agents, telephony, REST/SDK, SSML, and Realtime/OpenAI tools.
DeploymentL170-L180Deploying and running Azure Speech services (STT, TTS, language ID) via containers, Kubernetes/Helm, and batch APIs, including custom models and on-premises setups.

Troubleshooting

TopicURL
Troubleshoot common Azure text-to-speech issueshttps://learn.microsoft.com/en-us/azure/ai-services/speech-service/faq-tts
Retrieve Speech to text session and transcription IDs for supporthttps://learn.microsoft.com/en-us/azure/ai-services/speech-service/how-to-get-speech-session-id
Resolve common Azure Speech in Foundry issueshttps://learn.microsoft.com/en-us/azure/ai-services/speech-service/known-issues
Troubleshoot Azure Speech containers deployment issueshttps://learn.microsoft.com/en-us/azure/ai-services/speech-service/speech-container-faq
Diagnose and fix common Azure Speech SDK issueshttps://learn.microsoft.com/en-us/azure/ai-services/speech-service/troubleshooting

Best Practices

TopicURL
Prepare and locate audio data for batch transcriptionhttps://learn.microsoft.com/en-us/azure/ai-services/speech-service/batch-transcription-audio-data
Create high-quality human-labeled speech transcriptionshttps://learn.microsoft.com/en-us/azure/ai-services/speech-service/how-to-custom-speech-human-labeled-transcriptions
Prepare training data for professional custom voicehttps://learn.microsoft.com/en-us/azure/ai-services/speech-service/how-to-custom-voice-training-data
Apply best practices to reduce Speech synthesis latencyhttps://learn.microsoft.com/en-us/azure/ai-services/speech-service/how-to-lower-speech-synthesis-latency
Track and manage Azure Speech SDK memory usagehttps://learn.microsoft.com/en-us/azure/ai-services/speech-service/how-to-track-speech-sdk-memory-usage
Handle interrupted responses in Voice Live chat historyhttps://learn.microsoft.com/en-us/azure/ai-services/speech-service/how-to-voice-live-auto-truncation
Evaluate Voice Live agents with Foundry harnesshttps://learn.microsoft.com/en-us/azure/ai-services/speech-service/how-to-voice-live-evaluate
Use phrase lists to improve Azure Speech accuracyhttps://learn.microsoft.com/en-us/azure/ai-services/speech-service/improve-accuracy-phrase-list
Apply keyword recognition design and accuracy guidelineshttps://learn.microsoft.com/en-us/azure/ai-services/speech-service/keyword-recognition-guidelines
Mitigate Azure AI Speech SDK CRL compatibility issuehttps://learn.microsoft.com/en-us/azure/ai-services/speech-service/migrate-to-sdk-1-48-2
Record high-quality samples for custom voice traininghttps://learn.microsoft.com/en-us/azure/ai-services/speech-service/record-custom-voice-samples
Back up and recover custom Speech and Voice resourceshttps://learn.microsoft.com/en-us/azure/ai-services/speech-service/resiliency-and-recovery-plan
Design microphone arrays optimized for Speech SDKhttps://learn.microsoft.com/en-us/azure/ai-services/speech-service/speech-sdk-microphone
Prepare high-quality video samples for custom avatarshttps://learn.microsoft.com/en-us/azure/ai-services/speech-service/text-to-speech-avatar/custom-avatar-record-video-samples

Decision Making

TopicURL
Evaluate custom voice lite before professional voicehttps://learn.microsoft.com/en-us/azure/ai-services/speech-service/custom-neural-voice-lite
Evaluate device suitability for embedded speech modelshttps://learn.microsoft.com/en-us/azure/ai-services/speech-service/embedded-speech-performance-evaluations
Choose MAI-Transcribe-2-Streaming API optionhttps://learn.microsoft.com/en-us/azure/ai-services/speech-service/mai-transcribe-2-streaming
Migrate Speech to text REST API from v3.2 to 2024-11-15https://learn.microsoft.com/en-us/azure/ai-services/speech-service/migrate-2024-11-15
Migrate Speech to text REST API 2024-11-15 to 2025-10-15https://learn.microsoft.com/en-us/azure/ai-services/speech-service/migrate-2025-10-15
Migrate from retired Speech intent recognition to Language or OpenAIhttps://learn.microsoft.com/en-us/azure/ai-services/speech-service/migrate-intent-recognition
Migrate from Long Audio API to Batch synthesishttps://learn.microsoft.com/en-us/azure/ai-services/speech-service/migrate-to-batch-synthesis
Migrate from v3 text-to-speech to custom voice REST APIhttps://learn.microsoft.com/en-us/azure/ai-services/speech-service/migrate-to-custom-voice-api
Migrate Speech-to-text REST from v3.0 to v3.1https://learn.microsoft.com/en-us/azure/ai-services/speech-service/migrate-v3-0-to-v3-1
Migrate Speech to text REST API v3.1 to v3.2https://learn.microsoft.com/en-us/azure/ai-services/speech-service/migrate-v3-1-to-v3-2
Choose and plan Azure Voice Live API usagehttps://learn.microsoft.com/en-us/azure/ai-services/speech-service/voice-live
Choose telephony integration for Foundry voice agentshttps://learn.microsoft.com/en-us/azure/ai-services/speech-service/voice-live-telephony

Limits & Quotas

TopicURL
Manage custom speech model and endpoint lifecyclehttps://learn.microsoft.com/en-us/azure/ai-services/speech-service/how-to-custom-speech-model-and-endpoint-lifecycle
Check Azure Speech language and voice availabilityhttps://learn.microsoft.com/en-us/azure/ai-services/speech-service/language-support
Custom voice endpoint limits for Speech servicehttps://learn.microsoft.com/en-us/azure/ai-services/speech-service/professional-voice-deploy-endpoint
Reference quotas and limits for Azure Speechhttps://learn.microsoft.com/en-us/azure/ai-services/speech-service/speech-services-quotas-and-limits

Security

TopicURL
Configure BYOS storage for Azure Speech resourceshttps://learn.microsoft.com/en-us/azure/ai-services/speech-service/bring-your-own-storage-speech-resource
Integrate custom models with Voice Live BYOMhttps://learn.microsoft.com/en-us/azure/ai-services/speech-service/how-to-bring-your-own-model
Configure Microsoft Entra auth for Azure AI Speechhttps://learn.microsoft.com/en-us/azure/ai-services/speech-service/how-to-configure-azure-ad-auth
Configure consent and compliance for personal voicehttps://learn.microsoft.com/en-us/azure/ai-services/speech-service/personal-voice-create-consent
Assign Azure RBAC roles for Speech resourceshttps://learn.microsoft.com/en-us/azure/ai-services/speech-service/role-based-access-control
Configure Speech service in Azure sovereign cloudshttps://learn.microsoft.com/en-us/azure/ai-services/speech-service/sovereign-clouds
Manage Speech service data-at-rest encryption and keyshttps://learn.microsoft.com/en-us/azure/ai-services/speech-service/speech-encryption-of-data-at-rest
Secure Speech service with Virtual Network service endpointshttps://learn.microsoft.com/en-us/azure/ai-services/speech-service/speech-service-vnet-service-endpoint
Secure Azure AI Speech with Private Link endpointshttps://learn.microsoft.com/en-us/azure/ai-services/speech-service/speech-services-private-link
Use content credentials for Azure avatar videoshttps://learn.microsoft.com/en-us/azure/ai-services/speech-service/text-to-speech-avatar/content-credentials

Configuration

TopicURL
Configure Batch synthesis properties for text-to-speechhttps://learn.microsoft.com/en-us/azure/ai-services/speech-service/batch-synthesis-properties
Check status and retrieve batch transcription resultshttps://learn.microsoft.com/en-us/azure/ai-services/speech-service/batch-transcription-get
Configure BYOS storage for Speech to texthttps://learn.microsoft.com/en-us/azure/ai-services/speech-service/bring-your-own-storage-speech-resource-speech-to-text
Configure language ID and diarization in Azure Speechhttps://learn.microsoft.com/en-us/azure/ai-services/speech-service/configure-language-identification-diarization
Define UPS phonetic pronunciations for Speech to texthttps://learn.microsoft.com/en-us/azure/ai-services/speech-service/customize-pronunciation
Configure OpenSSL on Linux for Azure Speech SDKhttps://learn.microsoft.com/en-us/azure/ai-services/speech-service/how-to-configure-openssl-linux
Control and monitor Speech SDK service connectionshttps://learn.microsoft.com/en-us/azure/ai-services/speech-service/how-to-control-connections
Configure post-processing options for Azure speech recognitionhttps://learn.microsoft.com/en-us/azure/ai-services/speech-service/how-to-post-processing
Configure real-time speech recognition with Azure Speechhttps://learn.microsoft.com/en-us/azure/ai-services/speech-service/how-to-recognize-speech
Select and configure audio input devices in Speech SDKhttps://learn.microsoft.com/en-us/azure/ai-services/speech-service/how-to-select-audio-input-devices
Use visemes for facial animation with Speech servicehttps://learn.microsoft.com/en-us/azure/ai-services/speech-service/how-to-speech-synthesis-viseme
Configure Speech SDK audio input streamshttps://learn.microsoft.com/en-us/azure/ai-services/speech-service/how-to-use-audio-input-streams
Configure compressed audio input for Speech SDK and CLIhttps://learn.microsoft.com/en-us/azure/ai-services/speech-service/how-to-use-codec-compressed-audio-input-streams
Enable and configure Speech SDK diagnostic logginghttps://learn.microsoft.com/en-us/azure/ai-services/speech-service/how-to-use-logging
Configure interim responses for Voice Live toolshttps://learn.microsoft.com/en-us/azure/ai-services/speech-service/how-to-voice-live-interim-response
Configure OpenTelemetry tracing for Voice Live SDKhttps://learn.microsoft.com/en-us/azure/ai-services/speech-service/how-to-voice-live-telemetry
Configure audio and transcription logging for Speech recognitionhttps://learn.microsoft.com/en-us/azure/ai-services/speech-service/logging-audio-transcription
Upload and validate training datasets for professional voicehttps://learn.microsoft.com/en-us/azure/ai-services/speech-service/professional-voice-create-training-set
Configure Azure Speech text-to-speech avatar optionshttps://learn.microsoft.com/en-us/azure/ai-services/speech-service/quickstarts/get-started-text-to-speech-avatar
Configure Azure Speech regional endpoints and IDshttps://learn.microsoft.com/en-us/azure/ai-services/speech-service/regions
Configure Azure Speech containers runtime settingshttps://learn.microsoft.com/en-us/azure/ai-services/speech-service/speech-container-configuration
Configure and run Azure Speech language ID containershttps://learn.microsoft.com/en-us/azure/ai-services/speech-service/speech-container-lid
Configure Redis cache for speech diarization containershttps://learn.microsoft.com/en-us/azure/ai-services/speech-service/speech-container-speech-to-text-diarization-cache
Control speech output using SSML configurationhttps://learn.microsoft.com/en-us/azure/ai-services/speech-service/speech-synthesis-markup
Configure pronunciation with SSML phonemes and lexiconshttps://learn.microsoft.com/en-us/azure/ai-services/speech-service/speech-synthesis-markup-pronunciation
Structure SSML documents and events for Speechhttps://learn.microsoft.com/en-us/azure/ai-services/speech-service/speech-synthesis-markup-structure
Configure Speech CLI datastore search order and fileshttps://learn.microsoft.com/en-us/azure/ai-services/speech-service/spx-data-store-configuration
Configure output destinations for Speech CLI resultshttps://learn.microsoft.com/en-us/azure/ai-services/speech-service/spx-output-options
Configure batch synthesis properties for TTS avatarshttps://learn.microsoft.com/en-us/azure/ai-services/speech-service/text-to-speech-avatar/batch-synthesis-avatar-properties
Configure events and models for Voice Live APIhttps://learn.microsoft.com/en-us/azure/ai-services/speech-service/voice-live-api-reference-2026-07-15
Configure languages and locales for Voice Live APIhttps://learn.microsoft.com/en-us/azure/ai-services/speech-service/voice-live-language-support

Integrations & Coding Patterns

TopicURL
Integrate Speech service with call center telephonyhttps://learn.microsoft.com/en-us/azure/ai-services/speech-service/call-center-telephony-integration
Use Speech SDK APIs to handle recognition resultshttps://learn.microsoft.com/en-us/azure/ai-services/speech-service/get-speech-recognition-results
Implement text-to-speech synthesis with Speech SDKhttps://learn.microsoft.com/en-us/azure/ai-services/speech-service/how-to-speech-synthesis
Translate speech using Azure Speech APIshttps://learn.microsoft.com/en-us/azure/ai-services/speech-service/how-to-translate-speech
Integrate Voice Live with Foundry text agentshttps://learn.microsoft.com/en-us/azure/ai-services/speech-service/how-to-voice-agent-integration
Implement function calling in Voice Live sessionshttps://learn.microsoft.com/en-us/azure/ai-services/speech-service/how-to-voice-live-function-calling
Integrate Voice Live with Foundry hosted agentshttps://learn.microsoft.com/en-us/azure/ai-services/speech-service/how-to-voice-live-hosted-agent-integration
Connect MCP servers to Voice Live sessionshttps://learn.microsoft.com/en-us/azure/ai-services/speech-service/how-to-voice-live-mcp-server
Add proactive greeting messages to Voice Live agentshttps://learn.microsoft.com/en-us/azure/ai-services/speech-service/how-to-voice-live-proactive-messages
Integrate MAI-Transcribe-2-Streaming via Realtime APIhttps://learn.microsoft.com/en-us/azure/ai-services/speech-service/mai-transcribe-2-streaming-realtime
Integrate MAI-Transcribe-2-Streaming with Speech SDKhttps://learn.microsoft.com/en-us/azure/ai-services/speech-service/mai-transcribe-2-streaming-speech-sdk
Integrate Azure Speech with Azure OpenAI chathttps://learn.microsoft.com/en-us/azure/ai-services/speech-service/openai-speech
Integrate personal voice speaker profiles in appshttps://learn.microsoft.com/en-us/azure/ai-services/speech-service/personal-voice-how-to-use
Use Power Automate connector for Speech batch transcriptionhttps://learn.microsoft.com/en-us/azure/ai-services/speech-service/power-automate-batch-transcription
Call Azure Speech-to-Text via REST APIhttps://learn.microsoft.com/en-us/azure/ai-services/speech-service/rest-speech-to-text
Call Azure Speech-to-text short audio REST APIhttps://learn.microsoft.com/en-us/azure/ai-services/speech-service/rest-speech-to-text-short
Call Speech text to speech REST API endpointshttps://learn.microsoft.com/en-us/azure/ai-services/speech-service/rest-text-to-speech
Use SSML phonetic alphabets with Azure Speechhttps://learn.microsoft.com/en-us/azure/ai-services/speech-service/speech-ssml-phonetic-sets
Use SSML to customize Azure Speech voiceshttps://learn.microsoft.com/en-us/azure/ai-services/speech-service/speech-synthesis-markup-voice
Generate Speech service REST clients from Swaggerhttps://learn.microsoft.com/en-us/azure/ai-services/speech-service/swagger-documentation
Control text to speech avatar gestures with SSMLhttps://learn.microsoft.com/en-us/azure/ai-services/speech-service/text-to-speech-avatar/avatar-gestures-with-ssml
Implement real-time text-to-speech avatar streaminghttps://learn.microsoft.com/en-us/azure/ai-services/speech-service/text-to-speech-avatar/real-time-synthesis-avatar
Connect Voice Live to Foundry Agent Servicehttps://learn.microsoft.com/en-us/azure/ai-services/speech-service/voice-live-agents-quickstart
Integrate advanced Voice Live API 2025-10-01https://learn.microsoft.com/en-us/azure/ai-services/speech-service/voice-live-api-reference-2025-10-01
Use preview Voice Live API 2026-01-01https://learn.microsoft.com/en-us/azure/ai-services/speech-service/voice-live-api-reference-2026-01-01-preview
Use Voice Live API 2026-04-10 for streaminghttps://learn.microsoft.com/en-us/azure/ai-services/speech-service/voice-live-api-reference-2026-04-10
Adopt preview Voice Live API 2026-06-01https://learn.microsoft.com/en-us/azure/ai-services/speech-service/voice-live-api-reference-2026-06-01-preview
Implement Azure Voice Live WebSocket and WebRTChttps://learn.microsoft.com/en-us/azure/ai-services/speech-service/voice-live-how-to
Connect Voice Live API to telephony via SIPhttps://learn.microsoft.com/en-us/azure/ai-services/speech-service/voice-live-sip
Use Voice Live WebRTC API for real-time audiohttps://learn.microsoft.com/en-us/azure/ai-services/speech-service/voice-live-webrtc

Deployment

TopicURL
Use Batch synthesis API for long-form text-to-speechhttps://learn.microsoft.com/en-us/azure/ai-services/speech-service/batch-synthesis
Deploy custom speech models and endpointshttps://learn.microsoft.com/en-us/azure/ai-services/speech-service/how-to-custom-speech-deploy-model
Run custom speech to text containers with Dockerhttps://learn.microsoft.com/en-us/azure/ai-services/speech-service/speech-container-cstt
Deploy fast transcription speech containers on-premiseshttps://learn.microsoft.com/en-us/azure/ai-services/speech-service/speech-container-ft
Deploy and run Speech containers with Dockerhttps://learn.microsoft.com/en-us/azure/ai-services/speech-service/speech-container-howto
Run Speech containers on Kubernetes with Helmhttps://learn.microsoft.com/en-us/azure/ai-services/speech-service/speech-container-howto-on-premises
Deploy neural text to speech containers with Dockerhttps://learn.microsoft.com/en-us/azure/ai-services/speech-service/speech-container-ntts
Deploy speech-to-text containers with Dockerhttps://learn.microsoft.com/en-us/azure/ai-services/speech-service/speech-container-stt
azure-speech by MicrosoftDocs · The Skill Leaderboard