Issue Description
Users deploying a conversational AI agent on platforms such as Vercel may encounter an error stating “uh oh, agent failed to connect” during voice chats. Additionally, the AI agent may respond with “system is not working” for basic queries like “hello” due to quota exceedance issues with the underlying Language Model (LLM) provider.
Platform/SDK
- SDK Product (Selectable): Conversational AI Engine
Error Message
- Initial error: “Uh oh, agent failed to connect”
- Subsequent error: “The system is not working”
Step by Step Solution
-
Verify LLM and TTS Settings:
- Confirm that the correct Keys and settings for Language Model (LLM) and Text-To-Speech (TTS) services are loaded before deploying the agent.
-
Check Conversational AI Enablement:
- Ensure conversational AI has been enabled for your project in the Agora console at https://console.agora.io/.
Root Cause
The initial “agent failed to connect” issue may be caused by incorrect settings or the conversational AI feature not being enabled on the app builder project. The “system is not working” error is due to exceeding the current quota of the Language Model provider, resulting in the AI agent’s unresponsiveness.
Prevention/Best Practice
- Always double-check the configuration of your LLM and TTS settings before deployment.
- Confirm that the necessary features are enabled on your app builder project.
- Monitor your usage and understand the quota limits of your LLM provider to avoid service interruptions.
- Consider upgrading to a subscription plan that accommodates your anticipated usage volume.
Corresponding Document/Link
- For managing billing and quotas with OpenAI, refer to the official documentation at OpenAI API Error Codes and Quotas.