Astral Codex Ten Podcast feed 2024年07月17日
The Craft and the Codex
index_new5.html
../../../zaker_core/zaker_tpl_static/wap/tpl_guoji1.html

 

理性主义社区起源于将理性视为一种可训练提升的武艺,后转为工艺。尽管部分领域有所发展,但社区内普遍感觉在理性艺术本身上进展最少。AI对齐成为发展中的科学领域,有效利他主义规模化、专业化,而理性艺术仍限于少数人撰写博客。原因包括易摘果实已尽,以及重点的转移。

🧠 理性主义社区的起源与变迁:从武艺到工艺,理性被视为可训练提升的技能,但社区感到理性艺术本身发展缓慢。

🔬 AI对齐与有效利他主义的崛起:AI对齐成为科学领域,有效利他主义规模化,而理性艺术相对落后。

🍒 低垂果实的摘取与重点转移:易达成的目标已实现,社区重心转移导致理性艺术进展有限。

🔍 博客在理性主义项目中的角色:作者自认在决策理论和机器学习等方面贡献有限,常被最新争议分散注意力。

The rationalist community started with the idea of rationality as a martial art – a set of skills you could train in and get better at. Later the metaphor switched to a craft. Art or craft, parts of it did get developed: I remain very impressed with Eliezer’s work on how to change your mind and everything presaging Tetlock on prediction.

But there’s a widespread feeling in the rationalist community these days that this is the area where we’ve made the least progress. AI alignment has grown into a developing scientific field. Effective altruism is big, professionalized, and cash-rich. It’s just the art of rationality itself that remains (outside the usual cognitive scientists who have nothing to do with us and are working on a slightly different project) a couple of people writing blog posts.

Part of this is that the low-hanging fruit has been picked. But I think another part was a shift in emphasis.

Martial arts does involve theory – for example, beginning fencers have to learn the classical parries – but it’s a little bit of theory and a lot of practice. Most of becoming a good fencer involves either practicing the same lunge a thousand times in ideal conditions until you could do it in your sleep, or fighting people on the strip.

I’ve been thinking about what role this blog plays in the rationalist project. One possible answer is “none” – I’m not enough of a mathematician to talk much about the decision theory and machine learning work that’s really important, and I rarely touch upon the nuts and bolts of the epistemic rationality craft. I freely admit that (like many people) I tend to get distracted by the latest Outrageous Controversy, and so spend way too much time discussing things like Piketty’s theory of inequality which get more attention from the chattering classes but are maybe less important to the very-long-run future of the world.

Fish AI Reader

Fish AI Reader

AI辅助创作,多种专业模板,深度分析,高质量内容生成。从观点提取到深度思考,FishAI为您提供全方位的创作支持。新版本引入自定义参数,让您的创作更加个性化和精准。

FishAI

FishAI

鱼阅,AI 时代的下一个智能信息助手,助你摆脱信息焦虑

联系邮箱 441953276@qq.com

相关标签

理性主义 AI对齐 有效利他主义 理性艺术 社区发展
相关文章