Metasense V2: Enhancing, improving and productionisation of LLM powered data governance

Metasense V2 enhances Grab's LLM-powered data governance by splitting the classification model into PII and non-PII taggers, reducing the number of non-PII tags from 21 to 8, and splitting tables with over 150 columns. It integrates LangChain for prompt chaining and LangSmith for collaborative prompt experimentation, evaluation, and monitoring. This leads to streamlined prompt optimization, transparent performance metrics, and a protocol for continuous improvement based on misclassification alerts.