AI Visual Representation Alignment

This post introduces a novel multi-step method for aligning AI visual representations with human knowledge. The approach involves training a teacher model on human judgments (THINGS dataset), generating a large synthetic dataset (AligNet) of human-like decisions, and then fine-tuning student AI models on this synthetic data. This process significantly improves model robustness, generalization, and human-alignment on various visual tasks, including few-shot learning and distribution shift.