Meta 称其在 6 月让自主 AI 研究系统 AIRA₃ 参加 NVIDIA 在 Kaggle 举办的竞赛,任务是微调一个 30B 的 Nemotron 模型,使其推理能力更强。AIRA₃ 在约 4000 支队伍中排名第 8,获得金牌,成绩超过使用同等前沿工具的人类参赛者。Meta 认为这表明 AIRA₃ 能在特定能力上把模型提升到接近人类专家的水平。
Meta 公开 AIRA₃ 在 Kaggle 微调竞赛中的名次与参赛条件,可据此判断自主研究系统在模型能力改进上的位置。
As a test of our progress to advance the frontier of AI research, in June we entered the next generation of our autonomous AI research system, AIRA₃, in a live Kaggle competition run by NVIDIA to fine-tune a 30B Nemotron model. The challenge was to teach the model to reason better — all competitors had access to the same information and were graded externally on a private test set.
AIRA₃ placed 8th out of ~4,000 teams to win Gold, outperforming human competitors who had access to the same frontier tools.
We believe this is a reliable signal that AIRA₃ can improve a targeted capability of an AI model at a level similar to human experts.
来源:AI at Meta · x.com