Table Pre-training with Synthetic Data

Hugging Face introduces TAPEX, a novel approach to table pre-training that leverages synthetic data generated from SQL queries and their execution results. This method significantly improves efficiency and performance on downstream table-related tasks like question answering and fact verification by learning a neural SQL executor. TAPEX achieves state-of-the-art results with a fraction of the pre-training data compared to previous methods.