5/21/2024
What this post added
This post details the technical process of fine-tuning a Stable Diffusion model on a custom dataset (Heroicons) to generate new icons. It covers dataset preparation (SVG to PNG conversion, captioning, CSV creation, HuggingFace upload), setting up a Modal environment with Diffusers dependencies, using Modal Volumes for persistent storage of model weights, and configuring training hyperparameters. It also outlines the steps for serving the fine-tuned model and wrapping it in a Gradio UI.