Leveraging RAG-powered LLMs for analytical tasks

Introduced Data-Arks, an in-house Python-based API platform that hosts frequently used SQL queries and Python functions, packaging them into individual APIs. Data-Arks integrates with Slack, Wiki, and JIRA APIs to parse and fetch information. This platform serves as middleware to channel data to LLM agents, enabling automation of regular metric reports and fraud investigations. The A* bot, an LLM fraud investigation helper, leverages Data-Arks and Spellvault to execute relevant fraud investigation queries and provide summarized results via Slack. The post also elaborates on the rationale for choosing RAG over fine-tuning for LLM accuracy improvements, citing effort/cost, ability to respond with latest information, and speed/scalability.