AWS walks through a full Pipecat voice agent with Deepgram on SageMaker
An AWS post co-written with Pipecat and Deepgram deploys a complete voice agent: Deepgram STT/TTS on SageMaker, Claude on Bedrock, Pipecat on ECS.
AWS published a step-by-step reference deployment (1 October 2026) for a production-style voice agent. It covers VAD, speech-to-text, LLM, text-to-speech and telephony in one streaming Pipecat pipeline. It is worth reading for the pipeline design alone, even if you never deploy on SageMaker. Pipecat's Kwindla Hultman Kramer, a co-author, flagged it on X and says Pipecat helped build the original SageMaker bidirectional reference implementations.
Per the post, the setup works like this:
- Deepgram STT and TTS models run on SageMaker endpoints over HTTP/2 bidirectional streaming.
- Claude Haiku 4.5 runs on Bedrock.
- The Pipecat pipeline runs on ECS Fargate, with barge-in enabled.
- Calls arrive over WebRTC or the phone network through Daily.co.
The post says auto scaling keys on active calls rather than CPU, and a CloudWatch dashboard tracks latency and interruptions. Repository skills let Claude Code drive the deployment. Pipecat's docs confirm a DeepgramSageMakerSTTService for this path.
The costs are real. The post warns that the SageMaker GPU endpoints are the most expensive component and are billed per hour regardless of usage. It also says the ECS service is always on. It gives no end-to-end latency figure and no per-call cost, and whether anything scales to zero is unclear. For STT latency numbers you can check yourself, Pipecat maintains an open benchmark.
There are lighter-weight options:
- Hosted Deepgram with Pipecat: Pipecat also supports Deepgram's hosted API and Flux, which avoids running your own GPU endpoints.
- AWS-native speech-to-speech: AWS's Voice AI Agent Studio sample uses Nova 2 Sonic instead of a cascaded pipeline. It is labeled a proof of concept.
- Realtime APIs: speech-to-speech services such as OpenAI Realtime and Gemini Live, or the LiveKit Agents framework, are surveyed here.
Sources
- Deploy voice agents with Pipecat, Deepgram and Amazon SageMaker AI · Amazon Web Services, Inc.
- Deepgram Speech-to-Text - Pipecat · Pipecat
- GitHub - pipecat-ai/stt-benchmark: Benchmarking STT service TTFB and semantic WER for real-time AI applications · GitHub
- Add "Voice Agents" sub-section under Guides & References / AI: exposing a RAG assistant by voice — cascaded vs. speech-to-speech architectures, latency budgets, VAD / turn detection / barge-in / echo cancellation, STT and TTS services and local models, realtime APIs (OpenAI Realtime, Gemini Live, Azure Voice Live), ElevenLabs Agents, Pipecat and LiveKit Agents, browser voice over WebRTC / WebSocket, telephony with Twilio (Media Streams, ConversationRelay) and Asterisk / FreeSWITCH / SIP, with LangChain and Spring AI back-ends, bibliography and a one-page cheat sheet PDF · Issue #210 · albertoirurueta/docs · GitHub
- sample-voice-ai-agent-studio/README.md at main · aws-samples/sample-voice-ai-agent-studio · GitHub
- @kwindla: If you're building voice agents and deploying on AWS, it's worth keeping up with the real… · @kwindla