Unlocking the potential of vision language models on satellite imagery through fine-tuning | Mistral AI

What this post added

This post details the application of LoRA fine-tuning to Pixtral-12B for satellite imagery classification using the Aerial Image Dataset (AID). It demonstrates how LoRA can efficiently adapt model weights to specific tasks and domains, leading to significant improvements in classification accuracy (from 0.56 to 0.91) and a reduction in hallucinations. The post also highlights the ease of fine-tuning via Mistral's API and LaPlateforme UI, and provides guidance on hyperparameter selection. It showcases the effectiveness of domain-specific adaptation for specialized visual domains like satellite imagery.