Building an Intelligent Customer Support Agent with Glean APIs and NVIDIA NIM Microservices

This post details the integration of Glean APIs with NVIDIA NIM microservices to build an enterprise-grade AI customer support agent. The workflow involves user query contextualization (including image-to-text via NeMo), query guardrailing with NeMo Guardrails, retrieval using Glean's Search APIs (supporting 25,000-character snippets and deduplication), reranking with NeMo Retriever, and answer generation using an LLM NIM (e.g., Llama 3.1) with references from the NeMo Retriever embedding microservice. It highlights deployment flexibility across cloud and on-premises environments and emphasizes Glean's contributions in contextual knowledge graph, permission-aware search, large snippet support, user context, query deduplication, and real-time performance.