What happens when Claude Code gets an experiment tracker
This post introduces the_lab.api, an API for experiment tracking designed for AI agents. It details how this API enables autonomous experimentation by providing capabilities for starting/queuing/canceling experiments, inspecting logs, querying leaderboards for best-performing runs, branching ideas as distinct git branches, and maintaining historical context. The post showcases a live demo where Claude Code used the_lab.api to teach Gemma 4 to play Tetris, iterating through 468 experiments across 90 ideas with zero human intervention. It emphasizes the importance of structured tracking for agents to avoid re-running experiments or losing context, and highlights the cost-effectiveness of using idle GPU resources for these agentic research loops.