Automatic Detect PII in Real Time with Machine Learning

What this post added

This post details the development and deployment of a PII Detection stream processing application, PII UDFs/UDTs for ksqlDB, and a PII SMT for Kafka Connect. These components leverage machine learning and NLP to identify and redact Personally Identifiable Information (PII) from data streams in real-time, enhancing data governance and security for SIEM/SOAR solutions. It also introduces the concept of entity-level control for unstructured data and provides configuration examples for custom entity detection.