Is this a date? Using ML to identify date formats in file names
Sep 26, 2023Mingming Liu

Summary
This post details the development of an ML model for identifying date formats in file names. It covers the challenges of inconsistent date representations, the limitations of rule-based approaches, and the ML-based solution using supervised learning for multi-class classification. Key components discussed include manual data annotation with Doccano, synthesized data generation to improve coverage, subword tokenization using SentencePiece, and IOB tagging for entity recognition. The model leverages transfer learning for cost-effectiveness.