Build a Scalable and Up-to-Date Generative AI Chatbot with Amazon Bedrock and Confluent Cloud
Jun 24, 2024Pascal Vantrepote
Summary
This post details the architecture and implementation of a generative AI chatbot using Confluent Cloud and Amazon Bedrock. It highlights the use of Kafka for real-time data streaming to keep the AI agent updated, a microservices architecture for agility and scalability, and Amazon Bedrock with Anthropic's model for conversational AI. The chatbot processing microservice utilizes KStream API and KCache for real-time responses and dynamic cache updates. The pre-approval microservice leverages Amazon Bedrock to extract mandatory information from conversations into JSON format for an automated approval process.
More from the Real-time Enterprise RAG trail
- Building an Agentic SOC on a Stream
- Hemut: Building the Internet of Freight on Real-Time Data
- New in Confluent Intelligence and AI Tools: Making Agents Native to the Stream, Expanded Model Support, New Agent Skills, and Copilot
- Customer Intelligence Hub for Real-Time GTM Insights
- RAG and GenAI for Customer 360 Architecture