Hugging Face

Bringing Robotics AI to Embedded Platforms: Dataset Recording, VLA Fine‑Tuning, and On‑Device Optimizations

Nov 28, 2024
Bringing Robotics AI to Embedded Platforms: Dataset Recording, VLA Fine‑Tuning, and On‑Device Optimizations
SummaryAI, from the source post

This post details the integration of SmolVLM-Base (2B parameter image-text-to-text model) and Robometer-4B (4B parameter model) for on-device inference on embedded platforms. It discusses dataset recording using Grabette and conversion to LeRobot datasets, and VLA fine-tuning. Optimizations for on-device performance are highlighted, including quantization and efficient inference techniques for these models on resource-constrained hardware.

More from the Robot Manipulation Data Recording System trail