AppleBlog3dMix, Don’t Tune: Bilingual Pre-Training Outperforms Hyperparameter Search in Data-Constrained Settings
AppleBlog26 AugIDEA Prune: An Integrated Enlarge-and-Prune Pipeline in Generative Language Model Pretraining
