标题： 对严格GPAI模型评估的初步建议 显示英文标题

标题： Preliminary suggestions for rigorous GPAI model evaluations

摘要： 本文提出了一个通用人工智能（GPAI）评估实践的初步汇编，这些实践可能有助于促进内部有效性、外部有效性和可重复性。 它包括对人类提升研究和基准评估的建议，以及可能适用于许多不同评估类型的跨领域建议。 建议按照评估生命周期的四个阶段进行组织：设计、实施、执行和文档记录。 结合机器学习、统计学、心理学、经济学、生物学及其他被认为对AI评估有重要教训的领域的现有实践，这些建议旨在为通用人工智能评估这一新兴且不断发展的科学领域提供讨论贡献。 本文档的目标读者包括展示系统性风险（GPAISR）的通用人工智能模型提供者，欧盟人工智能法案为其设定了具体的评估要求；第三方评估人员；评估严谨性的政策制定者；以及开发或进行通用人工智能评估的学术研究人员。 显示英文摘要

摘要： This document presents a preliminary compilation of general-purpose AI (GPAI) evaluation practices that may promote internal validity, external validity and reproducibility. It includes suggestions for human uplift studies and benchmark evaluations, as well as cross-cutting suggestions that may apply to many different evaluation types. Suggestions are organised across four stages in the evaluation life cycle: design, implementation, execution and documentation. Drawing from established practices in machine learning, statistics, psychology, economics, biology and other fields recognised to have important lessons for AI evaluation, these suggestions seek to contribute to the conversation on the nascent and evolving field of the science of GPAI evaluations. The intended audience of this document includes providers of GPAI models presenting systemic risk (GPAISR), for whom the EU AI Act lays out specific evaluation requirements; third-party evaluators; policymakers assessing the rigour of evaluations; and academic researchers developing or conducting GPAI evaluations.