少点错误 02月05日
What working on AI safety taught me about B2B SaaS sales
index_new5.html
../../../zaker_core/zaker_tpl_static/wap/tpl_guoji1.html

 

本文探讨了在通用人工智能(AGI)时代,大型科技公司垄断人才和软件的潜在趋势。文章指出,过去软件公司通过高薪吸引人才,构建自身软件生态,从而向其他企业收取高额软件费用。然而,随着AI工程师的出现,这种模式面临挑战。文章预测,为了保持在企业软件领域的优势,科技巨头可能会试图垄断AGI模型,阻止其他企业利用AI技术构建自己的软件,从而维持其高利润。

💰WTP(支付意愿)的概念在软件垄断中扮演重要角色。科技公司通过垄断人才,使得其他公司难以构建自己的软件,从而提高其软件产品的支付意愿,并收取高额费用。

🧑‍💻软件行业垄断人才的模式正在受到AI的挑战。随着AI工程师能力的提升,科技公司可能会通过垄断AI模型来维持其在软件领域的优势,防止其他公司利用AI技术自主开发软件。

🔒文章预测,科技公司可能会尝试垄断擅长软件工程的AI模型,以确保其非AI产品的稀缺性。拥有更多企业软件和许可产品的公司更有可能这样做,而拥有更多面向消费者和网络产品的公司则不太可能这样做。

🌐大型科技公司在AI上的巨额投资,可能并非仅仅是为了技术进步,而是为了在AGI时代维持其垄断地位。通过控制AI模型,他们可以继续向其他企业出售软件解决方案,并从中获利。

Published on February 4, 2025 8:50 PM GMT

Subtitle: you're too poor to use AGI.

WTF is WTP?

In Econ 101, you learn about something called willingness to pay (WTP). WTP is the highest price at which you're willing to buy some good or service. As long as the equilibrium price is less than your WTP, you'll get the good, otherwise you'll prefer to keep your money.

But there's a wrinkle: what if my demand isn't independent of yours? This happens all the time. My WTP for a social media platform will be higher if lots of other people are also using the platform. My WTP for a rare collectible will be higher if fewer other people have it.

That second situation creates an incentive for exclusive contracts. Let's say Ferrari makes a car for $50k. Suppose my individual WTP for a new car is $100k and your WTP is $70k. In theory, Ferrari should sell cars to both of us, since WTP > cost. But I want to feel special, so if I'm the only person with the sports car it's worth an extra $100k to me. Now Ferrari could sell to both of us and get $170k in revenue. But instead, I offer $190k to exclusively sell it to me. This leaves me better off, leaves Ferrari way better off, and leaves you in the dust.

Keep that dynamic in mind, we'll see it again later.

Software (companies) ate the world

Here's a quick stat: in 2024, the global SaaS market was around $3 trillion.[1] That's an economy the size of the UK built around subscription software. Why doesn't every company build their own software solutions, perfectly tailored to their needs?

To be clear, enterprises definitely want to do this. 3rd party solutions are a huge headache because they create reliance on another company that's totally out of your control and carry all the compliance baggage of the provider. If your software provider goes out of business, you're screwed. If they decide to double your costs, you're screwed. If they have a data leak, you're screwed.  If a junior developer pushes a commit with breaking package dependencies, literally all of your computers will turn off and you will forgo billions of dollars in lost revenue. Oops.

Oh, and also most enterprise software is sold for 5-6x costs, so there are (checks notes) hundreds of billions of dollars of lost value flowing to these providers.[2]

So why does the software industry exist at all? They have monopolized three things:

Distribution and infrastructure started becoming pretty commoditized in the early 2010s with the advent of AWS, Azure, GCP, and co. Sure, there are still high-ish margins, though they're low relative to most enterprise software, and mostly come from upselling to products on top of the compute/storage. But costs for software infrastructure are many orders of magnitude lower than they once were, and are dropping every year.

Data access seems like it should be a strong moat, but it's weaker than it seems. It's true that no one can really compete with Google on web search since they have superior data on page rank. But most enterprise software doesn't rely on data like that, and when it does, it's mostly internal company data.[3] 

I argue that the primary source of software revenue is the monopolization of talent.

The mechanic goes something like this: ideally, regular companies (insurance, banking, etc.) would like to build their own software, so it's perfectly tailored to their needs and completely under their control. To do this, they need to hire skilled engineers, designers, and project managers.

But if those engineers, designers, and project managers work at a tech company, the products they build can be replicated for ~free, making them several times more productive. Since they're far more productive, tech companies can pay them far more, so all these people go work at [insert Big Tech megacorp]. These tech companies pour money into recruiting and PR campaigns to the point that aspiring developers practically idolize them.

Of course, if there were far more skilled workers, this wouldn't be possible. Microsoft wouldn't be able to charge 5x costs for software so unusable that their own engineers shit talk it on Reddit. Every company would just build its own tools! Why do you think most big enterprises have in-house HR teams but not SWE? It's because HR people make 20 bucks an hour and software engineers want $250k + equity out of undergrad.

The Lord giveth, and the Lord taketh away

You know where this is going. It's been a crazy 30-year bull run for software. The playbook of hiring all the strong engineers to stifle competition, building a just-good-enough product, copying it millions of times, and selling each copy for 5-6x costs is perhaps the best business model to ever exist.[4] This model is so powerful that companies started hiring engineers to do nothing, just so they wouldn't work at competitors.

Now the prospect of AI engineers at least as good as humans is on the horizon, and that business model is rapidly looking endangered. Zuck says they'll start replacing Meta employees this year. o3 can already perform economically valuable work for tech companies. SWE benchmarks are getting saturated.

Ayn Rand is rolling in her grave somewhere

What's half a tril between friends?

Remember that thing about willingness to pay?

Let's say you're Oracle, who "specializes in cloud solutions and enterprise-grade software for large corporations." You make 50 billion dollars every year selling software to companies who can't build it themselves because you've bought up all the good engineers. All of the sudden, that moat looks a lot less secure. How much are you willing to pay for AI engineers to ensure that you maintain the monopoly over talent? 

Internally, the WTP is something like total comp of the employees you're replacing, plus or minus a little bit depending on how much you value things like AI engineers being always-on versus the switching costs.

But remember, the business is only valuable because you can build things your customers can't. So really, your WTP is a lot higher if you can get some sort of exclusive access to frontier models, or at least protect the cartel of Big Tech. As long as the plebes don't get it.

For those of you living under a rock, this already happened.

As a concrete prediction to put into writing, I expect this to be a sufficiently strong economic incentive that it outweighs most other people's interest in having AGI. I predict that tech companies will attempt to monopolize AI models that are good at SWE so that their non-AI products remain scarce. I expect companies with more enterprise software and licensing products to do this more, and companies with more consumer-facing and network-y products to do this less.

If this were a better post there would be some sort of nice takeaway at this point

Maybe I'm wrong.[5] But for a wrong model of the world, this sure explains a lot.

For me, it helped justify some of the exorbitant spending by Big Tech on AI. Investors have been criticizing the investment into AI since "it's unclear whether models trained on historical data will ever be able to replicate humans’ most valuable capabilities." LOL.

It's also made me more confident that tech companies will try to corner the market on AI models the way they did with engineers. I think this is bad.

And in a funny way, it explains a lot of companies' stances on open vs. closed models. This mechanic doesn't really impact Meta, since they don't make enterprise software anyway and their platforms are only valuable because of network effects; it's not like I'm gonna tell an AI engineer to make me a personal Instagram-like app tailored to my preferences. So it's pedal to the metal, open-source models, commoditize that shit and send it to 0!

Google is somewhat affected by this, and Microsoft is really affected by it. Lo and behold, Google's models are somewhat open and mostly free, while Microsoft, Salesforce, and Oracle have poured money into OpenAI and their completely closed models.

What a time to be alive.

 

  1. ^
  2. ^
  3. ^

    You might have noticed that I'm only talking about enterprise software here. That's because it's a ~10x larger industry by revenue, and even larger by profit, compared to consumer software (excluding gaming, which is kind of a different category), so it's really the only segment determining incentives.

  4. ^
  5. ^

    Although I'm pretty sure it's at least pointing in the right direction and would be curious to hear counterarguments. And even if it's not fully accurate, I want to encourage more thinking and discussion of this type among those in the AI safety community because I think it's useful for making predictions.



Discuss

Fish AI Reader

Fish AI Reader

AI辅助创作,多种专业模板,深度分析,高质量内容生成。从观点提取到深度思考,FishAI为您提供全方位的创作支持。新版本引入自定义参数,让您的创作更加个性化和精准。

FishAI

FishAI

鱼阅,AI 时代的下一个智能信息助手,助你摆脱信息焦虑

联系邮箱 441953276@qq.com

相关标签

AGI 软件垄断 人才争夺 AI模型 企业软件
相关文章