Bringing Robotics AI to Embedded Platforms: Dataset Recording, VLA Fine‑Tuning, and On‑Device Optimizations
Nov 28, 2024

Summary
This post details the integration of SmolVLM-Base (2B parameter image-text-to-text model) and Robometer-4B (4B parameter model) for on-device inference on embedded platforms. It discusses dataset recording using Grabette and conversion to LeRobot datasets, and VLA fine-tuning. Optimizations for on-device performance are highlighted, including quantization and efficient inference techniques for these models on resource-constrained hardware.
More from the Robot Manipulation Data Recording System trail
- Grabette: an open system to record robot-manipulation data
- From the Hugging Face Hub to robot hardware with Strands Agents and LeRobot
- Record, train, and deploy from one place with Strands Agents, LeRobot, and Hugging Face Storage Buckets
- LeRobot v0.6.0: Imagine, Evaluate, Improve
- LeRobot v0.5.0: Scaling Every Dimension