Video Style Transfer with LoRAs
You can now fine-tune open-source video models

You can now fine-tune open-source video models

1/24/2025

What this post added

This post details the integration of the Musubi Tuner for fine-tuning open-source video models like HunyuanVideo on Replicate. It introduces a new model (`zsxkib/create-video-dataset`) for automating the creation of training data from video URLs or files, including clip segmentation and caption generation. The process of training a LoRA model on Replicate using this data is outlined, along with instructions for running the fine-tuned models via the UI and API. Programmatic training using the Replicate Python client is also demonstrated, showcasing the end-to-end workflow from data preparation to model deployment and inference.

Read the original post ↗