Accelerate your models with 🤗 Optimum Intel and OpenVINO
Nov 22, 2022
Summary
This post details inference performance improvements on Intel Sapphire Rapids CPUs using Optimum Intel, demonstrating significant speedups for popular NLP models. It highlights the integration of OpenVINOâ„¢ Runtime for optimized inference on Intel hardware, enabling faster execution of models like ViT-Food101.
More from the IPU-Ready Transformers Optimization trail
- Accelerating PyTorch Transformers with Intel Sapphire Rapids - part 2
- Optimum+ONNX Runtime - Easier, Faster training for your Hugging Face models
- Accelerating PyTorch Transformers with Intel Sapphire Rapids - part 1
- Pre-Train BERT with Hugging Face Transformers and Habana Gaudi
- Deep Dive: Vision Transformers On Hugging Face Optimum Graphcore