Parameter-Efficient Fine-Tuning using 🤗 PEFT
Sep 26, 2023
Summary
This post introduces the `mt0-large` model for text generation, updated on Sep 26, 2023. It also provides an example of using the PEFT library with this model for parameter-efficient fine-tuning.
More from the Parameter-Efficient Fine-Tuning (PEFT) trail
- Beyond LoRA: Can you beat the most popular fine-tuning technique?
- One Model Family, Two Gold-Level Results: Fine-Tuning Nemotron for IOI and IMO
- NeoMME: an efficient Multimodal-native and Multilingual Encoder
- Fine-tuning a 350M Model for Better Structured Outputs in 100 GRPO Steps
- Training a coding model to paint watercolours with TRL and OpenEnv