少点错误 03月30日
Climbing the Hill of Experiments
index_new5.html
../../../zaker_core/zaker_tpl_static/wap/tpl_guoji1.html

 

文章探讨了通过低成本的简单实验来优化个人生活的理念。作者指出,人们常常满足于“够用就好”,而忽略了通过实验来提升生活质量的可能性。文章详细介绍了实验的成本,强调了低成本实验的重要性,并提供了实验的设计、实施和评估方法。作者鼓励读者通过头脑风暴、优先级排序、详细规划和实际执行来开展实验,以改善健康、生产力、社交和幸福感,最终达到优化生活的目的。

💡 **低成本实验的重要性:** 文章强调了低成本实验对于持续改进的重要性。由于时间、精力、金钱等成本的限制,过高的实验成本会降低实验的执行可能性。因此,设计低成本的实验,例如“做X持续Y时间”并观察结果,是更有效的方法。

🤔 **实验设计与实施:** 实验设计应包括明确的步骤,例如头脑风暴、优先级排序、详细规划和实际执行。头脑风暴包括识别个人问题、不足和低效之处,以及参考他人的实验。优先级排序则基于预期回报、成功概率、价值和实施时间。

✅ **实验的评估与调整:** 实验需要明确的评估方法和量化的退出点。评估方法包括观察、指标记录等。当实验效果不佳时,应果断停止并尝试其他方案。文章还提供了健康、生产力、社交、幸福感等方面的具体实验案例,以供参考。

Published on March 29, 2025 8:37 PM GMT

A better anything can be achieved with simple tests at low costs.


Background

People often settle for "good enough" and "if it ain't broke don't fix it" in their personal lives, opting not to make any effort to improve said things because either:

But how is one to tell how much better something can get or if it's already optimal? The only answer is to experiment. Most people have significant room for pareto improvements in their lives. The impact and availability of said improvements varies from low to high depending on the cost one is willing to incur and how much has already been attempted or implemented.


Costs, or Lack Thereof

Experimentation is often associated with major costs. Setting up experiments and collecting and analyzing data takes a lot of time. Thinking of all the controls and confounders takes a mental toll. Purchasing supplements or technology costs money. These are all in addition to the corresponding opportunity costs. "If experiment X doesn't pan out, I could've been doing Y all along, which I know brings me value" is a fair, common criticism against potential tests.

But experiments do not need to be so costly. Erring on the side of lower cost is key to ensuring experiments keep running; too high of a cost in any area (time, effort, money) will make experiments less likely to happen in the future. Design of experiments (DOE) has its place for areas that have high potential returns, while a simple "do X for Y" (e.g., take magnesium before bed for 30 days) and see how you feel has its place for lower returns or lower interest. The latter type is where I think a majority of benefits lie because they are more likely to be performed, there is a greater number available to test, and they are straightforward to implement.

These simple experiments are akin to hill climbing, defined by Wikipedia as:

an iterative algorithm that starts with an arbitrary solution to a problem, then attempts to find a better solution by making an incremental change to the solution. If the change produces a better solution, another incremental change is made to the new solution, and so on until no further improvements can be found.

The beauty and strength lie in the fact that the solution doesn't have to be arbitrary—it can be reasonable and informed, expediting the search time for the best solution and increasing the rate of improvements across the board. Further, improvements to multiple problems can be pursued at any given time without major interference with one another. This is one reason advice, especially pieces of such that are reliably backed, is so valuable: it is easy to implement, easy to verify the effectiveness, and can be backed out of quickly. Quick feedback loops lead to quick improvements and quick improvements lead to more testing.

I suspect the cost type that is most important to someone is the one they have the least of (e.g., if someone has lots of money and energy, but little time, they're time poor). This should be recognized, accepted, and accounted for when planning experiments. In other words, figure out your type of poorness, accept it, then find ways to avoid said cost in experiments and leverage the rich types.

A few notes on individual cost types:

Time

Time can be saved by outsourcing both physical and mental labor. Trying to see the effect of a clean house on happiness? Pay someone to do it. Trying to analyze data? Get an LLM to help with it.

Experiments also don't need to take an hour of planning, an hour of executing, and another hour of analysis to see if it actually worked. (Sure, the scientist in you may be loudly protesting about placebos and the need for controls in certain experiments, but sometimes just feeling better or doing better is enough for it to be considered effective.)

Effort

Effort, while often intertwined with time, is still distinct: some tasks can be short and tedious, long and mundane, or somewhere between the two. Again, effort can be reduced or almost altogether eliminated by outsourcing labor with a focus on making tasks easy and simple.

Effort is often inversely related to enjoyment, so experiments that are more fun will feel less effortful than if they were soul-sucking.

Money

Running cost-benefit analyses is helpful to determine if the experiment is worth running. Items that didn't work out can be sold on public marketplaces to recoup some of the cost. Ask others if they're willing to subsidize the cost in exchange for well-organized and well-planned results.

Diminishing Returns

Diminishing returns exist across all cost types, whether it's putting in more time, more effort, or more money. Try to recognize when returns plateau and move to the next experiment when/if that happens.


Getting Started

Step 1: Brainstorming

First, a list of potential experiments should be made from the following methods:

Step 2: Prioritization

Second, prioritize experiments based on expected return over time, or area under the enjoyment-time curve. The formula I use to think about this is:

priority = success-probability × value-per-time ÷ how-long-it-takes-to-implement

where the scales are 0-1 for success-probability, 0-10 for value-per-time, and 0-10 for how-long-it-takes-to-implement.

For example, magnesium supplementation may be 0.8 × 5 × 1 = 4 and consistent bedtime is 0.9 × 10 × 1/5 = 1.8. In other words, don't delay the magnesium until after the consistent bedtimes, but rather take care of the magnesium now while still starting the bedtime.

Probabilities can be estimated from literature (preferable), other n=1 experimenters or trusted figures (a bit less preferable), or raw (least preferable). Value per time is entirely subjective, but should be easily approximated. Implementation time depends on the depth of DOE—something like controversial supplementation may take longer to prove its value while increasing lighting brightness inside the home may have an immediate, noticeable effect.

Step 3: Planning

Third, plan exactly how to implement the experiment. Like estimating probabilities, literature or articles/blogs/podcasts/word-of-mouth can be good starting points for both design and execution.

Planning should include the following:

Step 4: Performing

Fourth, do it. Purchase the products, set up the effectiveness tracker, define the quitting point, and follow the procedure.


Examples

Here's a non-exhaustive, vaguely-categorized list of as many experiments as I could think of in a few hours. Again, some of these are simple one-time behavior modifications that may reap surprising benefits, while others are long-term systems that must be maintained. (I reserve the right to not update regularly, but will try to as new ones come to light.)


Takeaways

Doing something sub-optimal is often better than delaying or never doing the optimal.

There is almost always room to improve something at a low cost.

Speed matters. Get experiments done quickly so the "cost of doing something new will seem lower in your mind [and] you'll be inclined to do more".


See Also



Discuss

Fish AI Reader

Fish AI Reader

AI辅助创作,多种专业模板,深度分析,高质量内容生成。从观点提取到深度思考,FishAI为您提供全方位的创作支持。新版本引入自定义参数,让您的创作更加个性化和精准。

FishAI

FishAI

鱼阅,AI 时代的下一个智能信息助手,助你摆脱信息焦虑

联系邮箱 441953276@qq.com

相关标签

实验 低成本 生活优化 个人提升
相关文章