2025年7月22日至25日，第五届人类对齐人工智能暑期学校将在布拉格举行。本次暑期学校旨在深入探讨人工智能对齐研究的最新趋势和更广泛的AI风险框架。学校将通过讲座、研讨会和讨论，为对人工智能对齐感兴趣的人士、博士生、机器学习/人工智能研究人员以及优秀学生提供学习和交流的平台。课程内容涵盖技术对齐研究、AI战略与系统对齐以及基础框架，旨在帮助参与者理解人工智能对齐的复杂性，并探索应对未来挑战的策略。

🧠 技术对齐研究：暑期学校将深入探讨当前的技术方法，包括行为评估、机制可解释性、可扩展的监督以及失调的模型生物。讨论将围绕这些领域中的最新进展展开，并评估这些方法潜力和局限性。

💡 AI战略与系统对齐：课程将涵盖时间线考量、强大AI相关的战略和治理挑战、AI发展的经济模型以及后AGI世界中逐渐失去权力等风险。重点在于建立整体理解，以及这些考量如何为技术研究提供信息。

⚙️ 基础框架：暑期学校还将探讨与近期AI发展相关的研究领域，如多智能体动力学与合作、代理理论、有限理性以及目标导向行为的现实模型。这些框架有助于理解在包含AI和人类的复杂环境中对齐的含义，以及如何开发合适的技术。

🎤 课程形式：学校将采用讲座、主题系列、小组研讨会、专家小组讨论以及交流、项目头脑风暴和非正式讨论等形式。详细的课程安排将在活动前公布，参与者可以参考往届暑期学校的课程内容和结构。

Published on June 6, 2025 7:31 PM GMT

Join us at the fifth Human-Aligned AI Summer School in Prague from 22^nd to 25^th July 2025!

We will meet for four intensive days of talks, workshops, and discussions covering latest trends in AI alignment research and broader framings of AI risk.

Apply now, applications are evaluated on a rolling basis.

The intended audience of the school are people interested in learning more about the AI alignment topics, PhD students, researchers working in ML/AI, and talented students. 

What to expect

The school is focused on teaching and exploring approaches and frameworks, less on presentation of the latest research results. Much of the content is technical – it is assumed the attendees understand current ML approaches and some of the underlying theoretical frameworks.

This year, we explore AI alignment through three core areas:

Technical alignment research: We'll examine current technical approaches including behavioral evaluations, mechanistic interpretability, scalable oversight, and model organisms of misalignment. We'll discuss recent developments in these areas and what they tell us about the potential and limitations of these methods.AI strategy and systemic alignment: We'll explore topics such as timeline considerations, strategic and governance challenges around powerful AI, economic models of AI development, and risks of gradual disempowerment in a post-AGI world. We'll focus on building overall understanding and how these considerations can inform technical research.Foundational frameworks: We'll visit research areas relevant to recent AI developments, such as multi-agent dynamics and cooperation, theories of agency, bounded rationality, and realistic models of goal-directed behavior. These frameworks help us understand what alignment means in complex environments containing both AIs and humans, and how to develop appropriate techniques.

The school consists of lectures and topical series, focused smaller-group workshops and discussions, expert panels, and opportunities for networking, project brainstorming and informal discussions. A detailed program will be announced shortly before the event. See the program of the previous school for an illustration of the program content and structure.

Speakers

Lewis Hammond – Cooperative AI Foundation & University of Oxford.Evan Hubinger (remote) – Anthropic.Vojta Kovarik – Czech Technical University.Jan Kulveit – ACS Research, Charles University.Gavin Leech – University of Cambridge & Arb Research.

We are in the process of confirming more speakers - check the website for updates!

Discuss