生成式 AI 正处于它的“康宝莱时刻”
Generative AI Is Having Its Herbalife Moment

原始链接: https://www.whatwelo.st/p/generative-ai-is-having-its-herbalife

作者对 Replit 等 AI 编程初创公司提出了批评,认为它们在 TikTok 上进行的激进网红营销具有掠夺性。这些公司利用经济不稳定时期的 Z 世代作为目标群体,其操纵手段与多层次营销(MLM)骗局及加密货币泡沫如出一辙。 该批评主要集中在以下三点: 1. **“情绪编程”(Vibe-Coding)的迷思:** 这些广告暗示非编程人员可以轻松构建盈利软件,却忽略了软件开发中涉及的巨大技术、安全和法律复杂性(例如 GDPR 责任)。 2. **隐性财务风险:** 与传统业务不同,AI 开发成本不可预测。用户在尝试构建项目时,可能会产生高额且无上限的计算代币费用,而这些项目的成功概率在统计学上极低。 3. **不道德的剥削:** 作者认为,向渴望经济保障的人兜售“副业”梦想本质上是不诚实的。Replit 及其推介的网红未披露高成本和低成功率,正利用一代人对现代职场的疏离感和焦虑获利。最终,作者认为这是一种玩世不恭且不可持续的骗局,剥削了弱势用户。

这篇 Hacker News 的讨论围绕着一篇题为《生成式 AI 正处于“康宝莱时刻”》的博文展开。文章认为,人工智能行业就像一个由虚假营销和“江湖骗子”式领导层推动的传销骗局。 评论者大都对该文的语调持批评态度,认为其充满偏见且情绪化。一位用户质疑了“多层次营销”(MLM,即传销)这一类比,指出传销注定会让后来者亏损,而 AI 平台虽然门槛较高,但为开发者提供了相对公平的竞争环境。 另一些人则批评作者依赖于动机性推理。他们认为,该文章因个人对萨姆·奥特曼(Sam Altman)和达里奥·阿莫代(Dario Amodei)等行业领军人物的厌恶,而无视了 AI 的技术现实。批评者指出,作者做出了一些大胆且缺乏依据的断言——例如声称 AI 导致失业是一个“谎言”——却未提供任何证据或逻辑支撑。总体而言,社区认为这篇文章更侧重于攻击 AI 行业的“氛围”和相关人物,而非对技术本身进行实质性的、基于事实的批判。
相关文章

原文

Over the past few weeks, I’ve noticed that TikTok has been serving me ads for Replit — one of the many vibe-coding startups that have emerged in the past couple of years, and that serve as a glorified wrapper for models from Anthropic, OpenAI, and Google.

Now, TikTok can be a weird place at times. It’s full of companies trying to sell things to an audience that can not — and will not — ever buy them. Things like industrial-grade glycine, graphite cubes, and lightly-used oil tankers.

I usually just laugh at those ads and move on with my day. And, in comparison, Replit isn’t as outlandishly batshit as the idea of someone trying to sell a graphite cube — the kind that looks like it might feel at home in a Soviet RBMK nuclear reactor — to a bunch of hyper-online gen-Z.

The ads — many of which were produced by influencers with brand deals, and can be found by searching “replit” and “#ad,” or #replitpartner — typically follow the same format. You have a beautiful person going about their day, having an idea, and then prompting it into existence with Replit.

The message is simple — you, yes you, can make software, and that software might make your life some level of better, or more convenient.

Or, that software might become the side-hustle that helps pay your rent, or even, if you’re lucky enough, makes you rich.

Where have we heard this before?

Around the 1920s, the world was introduced to the noxious and hateful idea of multi-level marketing. The way it works is simple — a company will have a product, like health supplements or plastic food containers, and they’ll get ordinary people to act as their marketers and salespeople.

There’s very little money in actually selling product. If you want to make real cash, you need to recruit other salespeople. Every new recruit — often referred to as the “downline” typically brings in a one-time bonus, as well as a cut of every bit of product they sell.

Obviously, those downlines now need their own downlines. And those third-generation downlines need their own downlines.

Obviously, this isn’t sustainable. Eventually, you run out of people. Kind of like a pyramid scheme.

Over the following century, the multi-level marketing industry changed. It globalized. We saw the emergence of new MLM companies spruiking wellness drinks with dubious health benefits, shampoos that make you go bald, and more. But while the product (which was never the point) changed, the basic model didn’t. Neither did the incentives for actually joining them.

Have you noticed that it’s never rich people that join MLM schemes? It’s always those on the bones of their arse. It’s why a lot of the people joining them are (at least, in the US) undocumented migrants who are otherwise locked out of the formal economy.

Nobody joins an MLM because they’re passionate about fucking tupperware or protein shakes, or the company manufacturing them. They join them because they believe that if they work hard enough, they can find the economic stability that otherwise eluded them, and perhaps something more.

Of course, only a small percentage of people who actually join them actually achieve that economic stability, and a smaller number still that “something more.”

So long as times are tough — that there’s people who feel alienated from the economic system — there will be people looking to take advantage of that alienation.

Jesus, just look at the crypto boom of the 2010s. I had a front-row seat for much of it, with my time at The Next Web coinciding with the frothiest, dumbest part of the era. Each day, I’d get around 250 pitches from founders and PR people in my inbox, all asking me to write about their clients or companies, and I’d wager that around 200 of them (or four-fifths) had something to do with crypto.

Tell me, do you think that the crypto boom would have happened if not for the fact that people saw a material decline in their economic fortunes and living standards after the global financial crisis, and that they didn’t see any hope of that changing?

FTX pitched itself to a mainstream audience, buying the naming rights to sports stadiums and spending big on a marketing campaign that targeted normal people, with Superbowl ads fronted with recognizable celebrities like Larry David.

Do you think that mainstream appeal would have been there — or would have been quite as strong — if not for the fact that people were broke, with their spending power eroded year-after-year as inflation chipped away at their stagnant wages? Would Paris Hilton have been invited to talk about NFTs on the Jimmy Fallon show, if not for the fact that the dire economic situation had created an opening for NFTs in the first place?

Things are fucked. More fucked than they’ve been in a long, long time.

What makes this moment even more dangerous than, say, the pandemic era, or the period after the global financial crisis, is that at least people believed that this too shall pass. That with vaccines and natural immunity, and sensible policy decisions, life will return to normal. That eventually, the banks will right themselves.

Right now, people — especially young people — are looking down the barrel of a stagnant job market that has decided it doesn’t need them. While AI is often touted as the excuse, it’s often just a cover for another simpler reason, like cutting costs.

Whatever. The fact is, the belief that AI can — and will — displace white-collar jobs is a lie that’s been accepted by the masses, in part because of the huckster-like triangulations of scumbags like Sam Altman and Dario Amodei, and in part because credulous fuckwits in the media have repeated them verbatim.

And I am concerned that the fear I’ve described is being exploited by companies like Replit and Cursor (which is also doing the exact same influencer marketing schtick, albeit not as aggressively as Replit), who are touting their services as a way for people to escape the precariousness of this current moment.

First, the idea that we’re about to see the emergence of a thriving cottage industry of apps, all created and marketed by non-coders is fucking ludicrous. Forgive the causeness of my language, but I have to be blunt.

Vibe-coded software is simply not good. Let’s suppose that someone deploys an app and there’s a critical security vulnerability that allows a threat actor to, say, exfiltrate all their customer information. How would they know? And if they became aware of it (presumably because said threat actor exploited said vulnerability), how would they fix it?

Also, would the person who developed the app know that, under legislation like GDPR, they can be financially liable for data breaches? Because they would be! And the whole point of the financial penalty system (at least, with respect to GDPR) is to be dissuasive — to act as a deterrent to other people who would be cavalier with other people’s data.

I can very easily imagine a national data protection authority — like the UK’s ICO — giving someone a massive, massive fine in order to dissuade other people from deploying their own AI-generated, unvetted slop code.

And then there’s the cost of actually building software.

Replit’s business model allows customers to buy one of two subscriptions, each providing a certain number of credits. When you run out, you can either buy more credits, or simply rack up additional charges and pay at the end of the billing cycle.

It’s entirely possible that someone will try to build their dream app, forget to cap their costs, and end up with a bill of hundreds or thousands of dollars. And no, that’s not an exaggeration.

I do not see how this is any different than, say, someone buying a starter kit from an MLM for a few grand. Both MLMs and vibe-coding startups that are marketing to consumers are charging their victims an upfront price, without making any guarantees that the investment will pay off.

Actually, that’s a lie. There is one important difference.

At least when you spunk cash on a starter kit for Herbalife, you know upfront how much it’s going to cost. By contrast, it is impossible how many tokens a LLM will burn when performing a particular coding task.

You simply cannot predict how much a certain action will cost — or whether the LLM will execute the task correctly, or whether you’ll need to re-prompt the model, and how much that second (or third, or fourth, or fifth) prompt will cost. You do not know whether one of those prompts will get stuck in a loop, burning tokens — and thus money — with nothing to show for it.

I’ll add that none of the TikTok adverts I’ve seen have mentioned the cost of compute. I’d wager that’s because if they were truthful about the costs of vibe coding, and the limitations of the technology, it would be a much harder sell.

Let’s imagine that someone — a non-coder introduced to Replit through TikTok — actually did build something. Realistically, how are they going to monetize that app? How are they going to scale it? How are they going to bring in customers?

I know I sound cynical, but I’ve spent the past decade-and-a-half reading Hacker News, with each day bringing a new “Show HN” post where someone announces their new app or website or service or whatever, and most of those have since faded into the ether, with the only evidence they ever existed being that introductory announcement.

Hell, as a journalist, I’ve been pitched tens of thousands of stories of the years from companies that no longer exist.

Building a tech company is hard! Even when you are a coder! And have capital! And a team of VCs backing you, each bringing their own technical and business expertise. For the vast majority of people, the odds of being a successful founder are as good as them being a professional soccer player.

It’s a dream — and it’s predatory to sell that dream to people through the medium of fucking TikTok adverts.

Incidentally, while I was finishing this newsletter, I decided to check the most recent posts on the Replit subreddit, only to find that someone was complaining about how a friend of their sister was being paid to promote Replit by falsely claiming that they “make 10k at month from home,” and that they landed their first tech job because of their Replit-made app.

I do not know how truthful that poster is, but I certainly found it to be an interesting coincidence.

And, honestly, it doesn’t matter.

I believe that vibe coding — irrespective of whether it’s useful for enterprises, which I doubt — is being marketed towards consumers in a deeply unethical way. One that’s worryingly reminiscent of multi-level marketing schemes like Herbalife and Amway, or the crypto grifts of the 2010s.

I believe that neither Replit, nor those posting sponsored content on behalf of Replit, are being candid about the costs of vibe-coding a business, or the likelihood of actually building a successful tech product with no technical expertise.

And I’m worried that this campaign will be successful in convincing many to part with their money, in the same way that other similar scams have thrived during hard times.

I believe that Replit’s decision to target younger people at a time when they’re struggling to find work, or are convinced that the future workplace has no use for them, is deeply predatory.

Any creator that promotes Replit without being transparent about the likelihood of building a million-dollar app, or about the costs of building software with AI, is either willingly complicit in a cynical, harmful scam, or otherwise promoting a technology that they themselves do not understand.

I ultimately believe that the weight of the blame lies on the shoulders of those within Replit who greenlit and funded this marketing campaign, and who knew exactly what they were doing.

联系我们 contact @ memedata.com