Weaviate

Text Analysis for Hybrid Search: Tokenization, Stopwords & Accent Folding | Weaviate

May 14, 2026
Text Analysis for Hybrid Search: Tokenization, Stopwords & Accent Folding | Weaviate
SummaryAI, from the source post

Introduces per-property stopword management via named presets and the `text_analyzer` configuration, allowing for language-specific stopword lists and exemption of specific characters from accent folding. Also details the new `/v1/tokenize` endpoint for debugging tokenization results.