We’re thrilled to announce that Agora’s Conversational AI Extension is now available on Dify Marketplace as a plugin, bringing powerful real-time voice AI capabilities directly to developers within the Dify ecosystem. This partnership combines Agora’s expertise in low-latency, interactive AI solutions with Dify’s open, community-driven plugin marketplace, enabling developers to create smarter, more engaging AI agents with ease.
Dify Marketplace: A Hub for Innovation
We have launched Marketplace with our v1.0.0 release, building on our open-source AI application development platform to create a thriving ecosystem. Our Marketplace now hosts over 120+ plugins—Models, Tools, Agent Strategies, Extensions, and Bundles—empowering you, our developers, to build and scale innovative solutions. With its modular architecture, developer-friendly tools, and distribution channels like community sharing and local deployment, it’s the perfect home for Agora’s Conversational AI Extension, driving real-time AI innovation within our community.
Agora Conversational AI Extension: Powering Real-Time Voice AI
We’re excited to highlight Agora Conversational AI Extension, now available on Dify Marketplace. This powerful extension empowers our developers to build real-time, interactive voice AI experiences. Developers can use a wide range of leading Large Language Models (LLMs) to build seamless voice AI agents with industry-leading speech-to-text and the ability to choose from leading text-to-speech voice services. , Powered by Agora’s ultra-low-latency Software-Defined Real-Time Network (SD-RTNTM), the extension offers quick response times and global reliability—even in poor network conditions. With its rapid, low-code integration, developers can deploy voice agents—such as virtual assistants or customer support bots—directly within Dify, enhancing our ecosystem with Agora’s global-scale, high-quality voice capabilities.
The Conversational AI Extension is powered by the Ten Framework, an Agora-supported open-source framework and community project for building conversational AI.
Quick Start Guide
It’s easy to get started with the Agora Conversational AI Extension on Dify.
Step 1: Install the Extension
Enter the explore page of Dify Plugins, then find the “Agora Conversational AI” extension, and install it.
Step 2: Confirm Installation
Check your installed plugins gallery. You should see the extension installed there.
Step 3: Set Up Your Agora Account
Prepare your Agora account for necessary information.
First, log into Agora’s console, then create a project and copy the App ID. Save it for later use. If you have enabled a certificate for your project, save that as well.
Next, enable the configuration in the conversation AI engine. As shown in the image, you will see the "active" indicator on the right side.
Third, on the "RESTful API" sub-page of the overview section, create the corresponding RESTful API key and password. Save it for later use.
Note: You will need to turn on the “Conversational AI” feature in the Agora Console.
Step 4: Configure TTS
This extension supports two TTS vendors: Microsoft Azure and Elevenlabs. Make sure you apply for an API key for the vendor service that works best for you and save the key for later use.
Step 5: Integrate with Dify
Come back to Dify. Click on the extension, select Create a new API endpoint from the right panel, and input the values as guided.
You can find examples of the TTS parameters (vendor dependent) in JSON format in the plugin’s ReadMe on Dify Marketplace.
When saved, you can now use the URL:
https://<your Dify endpoint host>/convoai-web/index.html to open the demo page.
If you want to define your own UI, you can also use the API directly to start/stop an agent. The API reference can be found here.
Use Case: Daily Search Assistant
Unlike traditional high-latency chatbots, real-time communication (RTC) demands fast, natural interactions—making Agora’s Conversational AI Extension a perfect fit.
As an example, we’ve built a Daily Search Assistant app within Dify. This voice-powered agent acts like a knowledgeable friend, providing quick, concise answers to everyday questions—whether it’s “What’s the weather like today?” or “How do I make a quick dinner?”
Imagine this: You ask, “What’s a good coffee spot nearby?” The assistant instantly responds in a warm, customized voice tone, “Hey, there’s a great café called Brew Haven just two blocks away—perfect for a quick pick-me-up!” Powered by Agora’s ultra-low-latency SD-RTN™ and seamless speech-to-text/text-to-speech integration, the assistant delivers responses in real time, even on spotty networks.
Once your agent or chatflow is published in Dify, you can fine-tune its settings via the endpoint panel. With the Agora extension, this assistant gains real-time conversation capabilities and customizable voice tones, making it ideal for applications like personal assistance, customer service, or sales support.
Please check out the full demo here: AgoraDemoFinal.mp4
Conclusion
The launch of Agora’s Conversational AI Extension on Dify Marketplace brings real-time, low-latency voice AI capabilities to developers, making interactive AI experiences more accessible than ever. With seamless integration and high-quality voice interactions, this partnership paves the way for smarter, more engaging AI agents. Try it out today and bring your AI agents to life!
About Agora
Agora is the global leader in real-time engagement, providing developers with simple, flexible, and powerful APIs to embed real-time conversational AI, voice, video, interactive live streaming, and chat into their applications and IoT devices. Headquartered in Santa Clara, CA, Agora is trusted by over 1,700 leading organizations across the globe to power best-in-class real-time experiences from social media and live shopping to education and telehealth. For more information about Agora (NASDAQ: API), visit: www.agora.io.
About Dify.AI
Dify.AI is revolutionizing AI-native application development by providing an open-source platform that simplifies the entire lifecycle of AI application creation, deployment, and management. With its extensible plugin ecosystem, Dify.AI enables developers and businesses to seamlessly integrate AI capabilities, customize workflows, and accelerate innovation. By lowering the barriers to AI adoption, Dify.AI empowers users to build intelligent applications with greater efficiency and flexibility.
