Deep Dive: Vision Transformers On Hugging Face Optimum Graphcore
Aug 18, 2022
Summary
This post details the fine-tuning of Vision Transformer (ViT) models on Graphcore IPUs using the Hugging Face Optimum library, providing a step-by-step guide and a notebook for training on the ChestX-ray14 dataset. It highlights the suitability of IPUs for ViT models due to their parallel processing capabilities and the ease of use provided by the Optimum library for integrating pre-trained models and datasets.
More from the IPU-Ready Transformers Optimization trail
- Accelerating PyTorch Transformers with Intel Sapphire Rapids - part 2
- Optimum+ONNX Runtime - Easier, Faster training for your Hugging Face models
- Accelerating PyTorch Transformers with Intel Sapphire Rapids - part 1
- Accelerate your models with 🤗 Optimum Intel and OpenVINO
- Pre-Train BERT with Hugging Face Transformers and Habana Gaudi