Introducing OpenRAG on watsonx.data

This post introduces OpenRAG on watsonx.data, a managed RAG service built on the OpenRAG open-source project. It details the architecture and benefits of this service, highlighting its advanced RAG capabilities that go beyond traditional RAG. Key components include Docling for structure-aware document processing, OpenSearch for hybrid retrieval (lexical, semantic, and vector similarity), and Langflow for agent orchestration. The post explains the knowledge ingestion path (ingestion, document processing, content preparation, embedding generation, indexing) and the agentic query and response path (request interpretation, evidence retrieval and assessment, iterative refinement, and grounded response generation). It emphasizes the adaptive retrieval, multi-relevance signal retrieval, preservation of meaning during content preparation, reduced integration/operational effort, and enterprise foundation as key differentiators from traditional RAG systems.