少点错误 2024年08月23日
Invitation to lead a project at AI Safety Camp (Virtual Edition, 2025)
index_new5.html
../../../zaker_core/zaker_tpl_static/wap/tpl_guoji1.html

 

AI Safety Camp Virtual是2025年1月至4月的线上研究项目,参与者组队研究预选项目,本文介绍了项目详情,包括申请要求、时间线、评审标准等。

🎯AI Safety Camp Virtual是为期3个月的线上研究项目,参与者需组成团队对预选项目进行研究。研究项目涵盖多种类型,旨在确保未来AI的安全性。

📋申请成为研究负责人需有一定研究经验,如博士学习1年以上、完成过AI安全研究项目等。研究负责人要积极参与项目,每周至少投入10小时。

⏰项目有明确的时间线,包括研究负责人申请截止时间、提案完善截止时间、团队成员申请及选择时间等,以及项目开展和最终展示的时间。

📝研究负责人的申请将根据项目的理论影响、计划及与AISC的适配性、 downside risk以及负责人自身能力和投入程度进行评审。

💰作为研究负责人可申请1500美元的津贴,团队成员的津贴可能仅提供给低收入国家的人员,这取决于筹款结果。

Published on August 23, 2024 2:18 PM GMT

Do you have AI Safety research ideas that you would like to work on with others? Is there a project you want to do and you want help finding a team? AI Safety Camp could be the solution for you!

Summary

AI Safety Camp Virtual is a 3-month long online research program from January to April 2025, where participants form teams to work on pre-selected projects. We want you to suggest the projects!

If you have an AI Safety project idea and some research experience, apply to be a Research Lead. If accepted, we offer some assistance to develop your idea into a plan suitable for AI Safety Camp. When project plans are ready, we open up team member applications. You get to review applications for your team, and select who joins as a team member. From there, it’s your job to guide work on your project.

Who is qualified?
We require that you have some previous research experience. If you are at least 1 year into a PhD or if you have completed an AI Safety research program (such as a previous AI Safety Camp, PIBBSSMATS, and similar), or done a research internship with an AI Safety org, then you are qualified already. Other research experience can count, too.

More senior researchers are of course also welcome, as long as you think our format of leading an online team inquiring into your research questions suits you and your research.

We require that all Research Leads are active participants in their projects and spend at least 10h/week on AISC.

 

Apply here

 

If you are unsure, or have any questions you are welcome to:

 

Choosing project idea(s)

AI Safety Camp is about ensuring future AIs are either reasonably safe or not built at all.

We welcome many types of projects including projects aimed at stopping or pausing AI development, aligning AI, deconfusion research, or anything else you think will help make the world safer from AI. If you like, you can read more of our perspectives on AI safety, or look at past projects.

If you already have an idea for what project you would like to lead, that’s great. Apply with that one!

However, you don’t need to come up with an original idea. What matters is you understanding the idea you want to work on, and why. If you base your proposal on someone else's idea, make sure to cite them. 

    For ideas on stopping harmful AI, see here and/or email Remmelt.For some mech-interp ideas see here.We don’t have specific recommendations for where to find other types of project ideas, so just take inspiration wherever you find it.

You can submit as many project proposals as you want. However, you are only allowed to lead one project.

Use this template to describe each of your project proposals. We want one document per proposal.

 

We’ll help you improve your project

As part of the Research Lead application process, we’ll help you improve your project. The organiser whose ideas match best with yours, will work with you to create the best version of your project.

We will also ask for assistance from previous Research Leads, and up to a handful of other trusted people, to give you additional feedback.

 

Timeline

Research Lead applications

Team member applications:

Program 

Afterwards

 

Application process for Research Leads

As part of the Research Lead application process we will help you improve your project plan, mainly through comments on your document. How much support we can provide depends on the number of applications we get. However, everyone who applies on time (before September 22nd) is guaranteed at least one 1-on-1 call with someone on the AISC team, to discuss your proposal. 

Your application will not be judged based on your initial proposal, but on the refined proposal, after you had the opportunity to respond to our feedback. The final deadline for improving your proposal is October 20th. 

Your Research Lead application will be judged based on:

    Theory of change
    What is the theory of impact of your project? Here we are asking about the relevance of your project work for AI Safety. If your project succeeds, can you tell us how this makes the world safer?Project plan and fit for AISC
    Do you have a well-thought-out plan for your project? How well does your plan fit the format of AISC? Is the project something that can be done by a remote team over 3 months? If your project is very ambitious, maybe you want to pick out a smaller sub-goal as the aim of AISC?Downside risk
    What are the downside risks of your projects and what is your plan to mitigate any such risk? The most common risk for AI safety projects is that your project might accelerate AI capabilities. If we think your project will enhance capabilities more than safety, we will not accept it.You as Research Lead
    Do we believe that you have the required skills and commitment to the project, and enough time to spend on this, in order to follow through? If we are going to promote your project and help you recruit a team to join you, we need to know that you will not let your team down. 

 

Apply here

 

Stipends

As Research Leads, you can apply to receive a stipend of $1500 USD (for the entire program, not per month).

For your team members we may be limited to only giving stipends to people from lower income countries. This will depend on the outcome of our fundraising.

 

EA Hotel

AISC is currently run online, but if you want to turn it into an in-person program, you can apply to stay at EA Hotel (Blackpool, UK) during all or part of AISC. The EA Hotel staff has told us that AISC participants are very likely to be accepted as residents. 

If you choose to stay at EA Hotel, you can decide to preferentially accept team members who are able to join you there. If this is something you want to do, we can discuss the logistical details more during your Research Lead application.

Please mind that AISC is open and welcoming to people from many communities, so you might end up missing out on some applicants if you select for affinity with Effective Altruism (EA).  

 

Do you want to be a Research Lead?

If you have a project idea and you are willing to lead or guide a team working on this idea, you should apply to be a Research Lead.

We don’t expect a fully formed research plan! If we think your idea is suitable for AISC, we can help you to improve it.

If you are unsure, or have any further questions you are welcome to:

Apply here



Discuss

Fish AI Reader

Fish AI Reader

AI辅助创作,多种专业模板,深度分析,高质量内容生成。从观点提取到深度思考,FishAI为您提供全方位的创作支持。新版本引入自定义参数,让您的创作更加个性化和精准。

FishAI

FishAI

鱼阅,AI 时代的下一个智能信息助手,助你摆脱信息焦虑

联系邮箱 441953276@qq.com

相关标签

AI Safety Camp AI 安全 研究项目 申请要求 时间线
相关文章