AI at Meta· @AIatMeta · X·· 2026-08-21AI 评分40
AI 导读
Meta 预览内部评测框架 WildArtifactBench,用于评估智能体在多种交付格式下完成复杂真实任务的能力。该框架不依赖严格的标准答案评分,而是采用人类与智能体偏好评判给出的胜率和 Elo 分数,从而扩大对实际多模态工作流的任务覆盖。Meta 已从中开放 10 个任务,用于衡量多模态智能体的实际实用价值。
正文 · 原文
Today we’re also previewing WildArtifactBench, an internal evaluation framework designed to assess agents on complex, real-world tasks across diverse deliverable formats.
By using win rates and Elo scores from human and agentic preference judges rather than strict ground-truth rubrics, it expands task coverage across practical multimodal workflows.
We’re releasing 10 tasks from WildArtifactBench as a step forward in our ability to measure the real practical utility delivered by multimodal agents: https://research.meta.ai/wild-artifact-bench
来源:AI at Meta · x.com