Dropbox

Is this a date? Using ML to identify date formats in file names

Sep 26, 2023Mingming Liu
Is this a date? Using ML to identify date formats in file names
SummaryAI, from the source post

This post details the development of an ML model for identifying date formats in file names. It covers the challenges of inconsistent date representations, the limitations of rule-based approaches, and the ML-based solution using supervised learning for multi-class classification. Key components discussed include manual data annotation with Doccano, synthesized data generation to improve coverage, subword tokenization using SentencePiece, and IOB tagging for entity recognition. The model leverages transfer learning for cost-effectiveness.

More from the ML-based Date Format Identification in File Names trail