1969 stories
·
2 followers

The AI Hater's Manifesto

1 Share

If you liked this piece, you should subscribe to my premium newsletter. It’s $70 a year, $18 a quarter, or $7 a month, and in return you get a weekly newsletter that’s usually anywhere from 10,000 to 18,000 words, including vast, detailed analyses of NVIDIA, Anthropic and OpenAI’s finances, and the AI bubble writ large

My Hater's Guides To the SaaSpocalypse, Private Credit and Private Equity are essential to understanding our current financial system, and my guide to how OpenAI Kills Oracle pairs nicely with my Hater's Guide To Oracle, as well as the Hater’s Guide To Oracle (Part 2).

Subscribing to premium is both great value and makes it possible to write these large, deeply-researched free pieces every week. This week's premium will be The Hater's Guide To Circular Financing - and how the AI industry is increasingly turning into a scheme to funnel money to NVIDIA and Broadcom at any cost. 

If you want to get in touch — and especially if you have any juicy information about Anthropic, OpenAI, or any other companies in the AI bubble — hit me up on Signal at ezitron.76. I’m also on IB on The Terminal. 


I’ve been writing about AI for the best part of three years. I’ll admit I was late, mostly because I was still trying to work out what it was I was doing with my life, let alone whatever it was I was “meant to cover” in a newsletter that started as a hobby on the side of another job I no longer really do. 

Things have changed a lot since then, mostly in that I’m near 115,000 subscribers, the premium newsletter and podcast are now my business, and I’ve had to learn more about economics, technology, power, construction, and the deep cynicism that drives the modern tech industry than I ever thought possible. It’s the greatest job in the world, and I’m very lucky to have it.

Today, I want to put in clear terms how I feel about AI writ large, and how detestable this industry has become.

Welcome to my Hater’s Manifesto.

Modern Software Sucks, LLMs Are Interesting, And Their Cost Is Inexcusable

Want a great example of why everybody’s pissed off at technology? I just tried to resize the above heading, and in doing so Google Docs for no apparent reason decided to make the entire paragraph below the size of a header. Modern software is inherently broken, a convoluted mess of different menus, tech debt, and poor design choices driven by the Rot Economy’s growth-at-all-costs mindset which demands constant change at all times, none of which ever seems to manifest as a “better” or “smarter” product.

I think the vast majority of people want their software to work better, and one of AI’s most frustrating lies is that it sells itself as “autonomous” as it continues the depressing trend of software that blames the user for its failure to meet their needs. Microsoft, Google, Meta and Amazon have made their products increasingly-convoluted, then attached a supposedly-magical tool to them that somehow makes them more convoluted.

You know what I’d love? Spell-check to work in Google Docs rather than putting a red squiggly line underneath and saying “yeah there’s probably something wrong with this, I dunno what though.” I’d like Microsoft Word to stop crashing because I have too many end-notes. I’d like Riverside to not have 10 different menus to click through to get to a link to send a person to join my podcast. I’d like my email to not be full of spam. I’d like things to “just work” rather than constantly fighting some sort of broken app or broken UX element or weird bug or intrusive pop-up about a feature that I don’t want. I’d like Slack or Discord to not feel like digital escher paintings of different notifications. 

LLMs are sold as some sort of magic tool that can fix “anything” without ever specifying what that thing might be, mostly because they cannot be trusted, even in things that they mostly get right, to do things right every time. While they can do “more” than they used to, the extent of that “more” comes with it the danger of giving a mindless software tool access to your computer’s files, which it may choose to delete in pursuit of “efficiency,” which makes investigating what they might be able to do equal parts convoluted and dangerous.

One critique of my work is that I’ve never used LLMs. I have! I experiment with them from time to time to make sure I haven’t missed something. I used one to debug a problem with my son’s Minecraft add-on the other day, and it took 30 minutes of fucking around trying things to eventually sort of work it out. The other day I used one to install a Pokemon Minecraft mod, then when I asked it to make sure the PS5 controller worked with the menus it broke a bunch of stuff, though I’ll concede it was useful that it installed something and it sort of worked.

The fun part of that paragraph is there are some that will think this is a grand victory for their technology, even though the result is decidedly mediocre. Four years into the AI bubble, and the best you’ve got is that a tool kind of worked after I bonked it on the head multiple times, and all it cost was a trillion-plus dollars in capex and tens of billions of dollars of training compute. I would never, ever trust this thing that deleted and added lines of code at random with anything mission critical, I could not trust software built with it, and I certainly couldn’t trust it with anything involving my personal data. 

And with all that said, the only real “use case” i’ve found for AI in my life have been three or four times where I’ve dumped a crash log into one of the tools and said “why broken” and got a result. Am I meant to be impressed? 

Sidenote: If your argument is “imagine what it could do in a year!” I just did so, and the answer was “the same thing, I guess?” 

Here’s how I feel about LLMs. In a vacuum, they’re an interesting technology that can do some interesting stuff, in the right scenarios, but never in a way that involves you fully surrendering your actual work product to it. 

As a way of speeding up small units of work in ways that are manageable both technically and cognitively, LLMs can be useful. The further you stretch yourself away from having complete clarity and industry over every element of the output’s purpose, the more likely you are to fall foul to a technology that is mathematically certain to make mistakes, and if you feel insecure reading it, you know that you are, on some level, embarrassed to have used AI. 

I don’t tell everybody about the weird keyboard I use, nor do I judge them despite how incredibly fast it makes typing for me, likely far faster than my competition, allowing me to operate at great speed. Who gives a fuck? 

In any case, it is impossible to view LLMs in a vacuum, because their existence demands hundreds of billions of dollars. Every data center is incredibly expensive, offensive-sounding and looking, and their existence is explicitly to enrich some sort of Patagonia-gargoyle at an asset management firm, all sold under the auspices of “investing in American infrastructure,” whatever the fuck that means. Their existence is a monument to the worst excesses of growth-at-all-costs capitalism — a technology that appears to coddle the user but ultimately lulls it into endlessly defending its fuckups under the flimsy pretense of “one day becoming perfect,” though woe betide you if you ever set perfection as the target, because that’s too unreasonable, as humans make mistakes.

Actually, that’s a good point!

Stop Comparing LLMs To Humans Unless You Are Ready To Demand Trillions Of Investments In Social Services and Labor Rights

Please, point to the time in history when we have invested a trillion fucking dollars in making human workers better. 

Point to a time when we have taken the idea that managerial culture is a performative fuck-fest built to enrich and empower business idiots that make important-sounding projects and con other people into doing the actual work. 

Where is mentorship in corporate America? Where are labor standards? Where are the social services that would make human workers truly excel at their jobs — a good night’s sleep, a healthy body, a good income, basic fucking dignity in the workplace, and their labor respected and empowered. I’m old enough to remember when everybody was chiding workers for “quiet quitting” — by which I mean “doing the work you are asked to do and not taking on extra responsibility for free.” I’ve read article after article insisting that we do not need medicare for all, that Universal Basic Income is a bad idea, that we must means test welfare, that people must have a “good work ethic” and that ultimately someone’s worth is derived from their contribution to the economy, hundreds of thousands of words dedicated to critiquing and prodding and judging every kind of worker other than the vaunted Chief Executive Officer or the Glorious Startup Boys. 

Everyone seems so obsessed with sinking billions of dollars into the theoretical chance that machine learning might be able to replace human beings, and that more money makes it “smarter” and “better” at tasks, but the idea of unionization, healthcare as a right, investing in the education, and actual talents of the workers would be communism.

Yet for some reason — because it’s a product, I guess? — we should as a nation, society and media ecosystem should do everything we can to assure that as much money as possible is invested in fucking large language models so that they can become something they are not.

There is no AGI coming. There is no conscious computer. LLMs have gotten “better,” but the “better” is not the kind of “better” that actually makes “economic sense for literally anyone involved.” Your best case scenario is that these things can do some coding work for you, in a controlled manner, in a way that’s safe, or alternatively face the professional harm that’s already befalling basically anyone getting caught using LLMs outside of coding, and even then, those within software engineering who are over-LLM’d are mocked. It’s also becoming increasingly more-difficult to understand both what has made an LLM “better” for both the people using them and the people making them, and there has been little-to-no headway made in making a meaningful impact in other industries.

You can jerk your bingus all you want about benchmarks or case studies or some anecdote you heard on a Subreddit, but AI products are just not very good at stuff. Those who boast of “massive productivity gains” from AI have found them only after endless hours of tinkering (or “Jarvising” as I’ll get to later), and in every single case their work reads or looks like crap, unless of course they’re somebody using LLMs as tools rather than a replacement for their miserable little mind.

LLMs can help out with lots of small things, get worse as they try and do real things, and do not need to speak like people. They do not need to be in anything near healthcare or finance or mental health or, really, people. The anthropomorphism and overpromising about these technologies has suffocated and obfuscated what they can actually do in pursuit of endless growth, and the only reason they can do anything is that OpenAI and Anthropic were allowed to annihilate hundreds of billions of dollars on training, along with very real harms and systemic risks that have emerged as a result. 

Sidenote: The “well human beings make mistakes too” argument is very stupid on its own — after all, human beings can learn on the job at speed, and can self-correct in a way that LLMs are incapable of doing. 

I’ll also add that the way that people frame how “often” LLMs make mistakes is utterly flawed too. A human being might make a mistake but largely get the facts and techniques correct while meaningfully understanding the purpose and developing their approach over time. An LLM can keep a text document or look at files and data and, each time, and then generate what it believes is the right course of action based on training data rather than experience.

I don’t even know why I’m explaining this at this point, because those making this argument are not approaching the conversation in good faith and are really just looking for a new boot to lick.

If you think any of this is worth hundreds of billions or trillions of dollars, you are either ignorant or corrupt. On top of how disgusting their outputs feel, the cost is going to take at least a decade to share, and begin the end of hypergrowth in the tech industry. 

And it’s a fundamentally ridiculous argument to compare LLM outputs to human beings without giving human beings the same affordance, grace and sheer investment as a comparison. 

Where is the grace for human error? Where is the investment in making humans exceptional? Surely investing real money in actual workers — making their lives better, improving their working conditions, teaching them new things, sharpening their existing skills, rewarding them for their hard work, and so on — would have better effects than fastballing hundreds of billions of dollars into a machine that does an impression of work?

Unless, of course, the people demanding this don’t do any actual work!

LLMs Are Built To Help Grifters and Imbeciles Do Impressions Of Work

I’ll concede we’re past the point when “nobody uses these things,” as they have now been pushed non-consensually upon every worker and organization at scale predominantly by Business Idiots that demand workers “do enough AI” because saying “I do AI” is a virtue signal to a certain kind of scumbag.

One of the many dangerous things that an LLM can do is a messy impression of a competent person, filling in the little bits within a loser, moron or con artist that would’ve otherwise exposed them, allowing them to get deeper and deeper into organizations by creating make-work specifically built to get off the MBA sect, resembling the performance of work because much of the workplace is ruled by people that don’t do any and haven’t in years. You can immediately read when somebody has used it because the words don’t sound right and don’t convey proper meaning. 

It is genuinely hard to read anything more than puddle-deep written by AI, because the more complex a subject is, the more skilled a writer must be to convey its meaning, and the more work it must do to pull people into concepts. The odd emotional swings in AI writing are its true tell — everything is extremely serious and urgent or told in a disinterested monotone, with no attachment to the words or why they were put in the order they were. People read my stuff because I convey facts and feelings but my work resonates with emotion. Some AI boosters frame this as me “just swearing” or “riling people up,” but that’s because they’re not used to caring about stuff for anything other than professional reasons.

Everything you see is the result of elevating people who value and build things based on growth. LLMs offer so many promises to those who don’t want to build anything of value — a way to seem like you’re “investing in American infrastructure,” a way to be sinophobic, a way to crush workers, a way to pretend like you care about the future, a way to pretend you care about technology, a way to talk about vacuous pseudo-intellectuals as a means of seeming intellectual yourself, an endless font of new multi-million or multi-billion deals and personnel changes, a new power center to graft oneself onto, a new asset class to invest in based entirely on vibes, and a way to be mildly jingoistic, all wrapped in a tool that can give you enough facts to pretend you know anything safe in the knowledge that most people are trained to believe somebody who sounds smart

You’re Embarrassed That People Know You Use AI Because You Know It’s Shameful To Outsource Your Thinking

It just came to me — the problem that I have with most people using LLMs is the delineation between outsourcing work and outsourcing thought. Those using LLMs to write little scripts or BQL code on a Bloomberg Terminal are inoffensive. A person using an LLM to search a big document for something is unproblematic, assuming that we ever fix the overall environmental footprint. A user reorganizing their desktop, assuming it works, is not an issue. 

A tool being used as a tool to do tool things — in many cases involving the LLM writing a little 30-line Python script! — is not a problem, though it’s also not a trillion-dollar industry that needed to steal everybody’s art and writing.

The problems begin when somebody outsources their thinking and actual work, and yes, this includes “research.” AI research fucking stinks, as does AI writing. AI-authored code — especially vibe-coded programs — is inherently dangerous and disrespectful to the user, and I believe endless AI-generated code is behind the overall deterioration of software at large. 

AI writing is also disrespectful to the user, because you didn’t actually come to any conclusion other than saying “uh, yeah, what that says.” You did not have a thought, you did not have a feeling, you did not make a statement, you prompted a model and fooled yourself into thinking that feeding your own words into it via data dumps or natural language is the same thing.

The reason you feel embarrassed to tell people you use AI is not because of a “misinformation campaign,” but because you know what you’re doing! 

You know that you’re relying on something that is mathematically guaranteed to be inconsistent. You know image generation is fucking ugly. You know the text sucks. There is a very obvious line where using LLMs goes from useful to lazy, it’s extremely bold, and it’s the moment you sacrifice a meaningful level of responsibility to them by not understanding the underlying operation. 

That can mean everything from the underlying functionality of an app to writing the body of a piece of text you edit ultimately comes down to how much you give a shit about your audience or value your work. If your work is not better than an LLM’s, you’re bad at your job. I don’t care if you used it to generate a chart or pull some data, as long as you check every single god damn number. If you’re writing an entire article using an LLM and then editing it, even if you pulled the data yourself, I will never have much respect for your work, mostly because I have no real idea what you think as you didn’t feel the need to tell me, you got some fucking word generator to do it.

LLMs Are Digital Busyboxes, And Are Great At Making You Feel Smart Through Computer Science

LLMs are also really, really good at what Robin Sloan calls “Jarvising,” creating a seemingly-autonomous assistant that mostly serves the function of giving you reasons to work on it:

However, the most common application of a personal Jarvis seems to be … tinkering with one’s personal Jarvis. “Gotta get my tools just right” isn’t a new phenomenon, of course, but/and it’s useful to notice its recurrence here.

LLMs are really good at creating the sense that you’re being really, really productive. Evaluate this, generate that, investigate this, summarize that, tell me how many times something happened, give me a new number to obsess over or the sum of the parts of everything I’ve ever done, all so that I can know more about my own thoughts without thinking. One can obsessively catalogue and digitize every link and thought and musing and action and datapoint in their lives and theorize that the LLM can make them better by knowing more about them, a Tower of Babel built using AI compute, because it’s so easy to make yourself feel smart by calling something a database that you store stuff in and run analyses on.

Best of all, the work is never done, and anyone you describe it to thinks you’re doing computer science as you click buttons on Chrome plugins and justify paying Sam Altman $200 a month. Don’t worry though, model instructions involve the phrase “you are a genius data scientist and ruthless analyst,” which is functionally the same thing as remembering, reading, re-reading and synthesizing information using your brain if you’re a person that doesn’t really give a shit about doing a good job or being exceptional in any way.

The people that actually use these things and like them in a normal way do not feel offended when they read this stuff because they see LLMs as a kind of software, and don’t feel a great emotional attachment to it because they’re not a weird freak.

They do not have obsessive involvement in “the AI debate” and almost always find the financial aspects truly loathsome. Said debate makes it near-impossible to actually judge how useful LLMs are to the software engineering industry because of the sheer scale of industry capture, but Nik Suresh is the literal best person doing the work on this, as described in AI Is Eviscerating Global Decisionmaking:

All of the AI projects we have observed as a team are failing. Every single one – we have seen 0% success in a year and a half, not only amongst projects we have been asked to participate in, but even within projects that we have observed in passing while doing totally unrelated work. Even if you grant that AI tooling accelerates specific workloads, the method and scale of the current investments is senseless. Frequently the failure is not related to AI itself, but rather that companies are terminally bad at running software projects effectively, and as I have remarked previously, AI projects are subject to all the failure modes of normal projects plus you can get everything right and then still fail because of the method's novelty. Very few companies are so good at shipping software that they can afford the extra risk profile.

Nik is a well-respected software engineer and a very successful consultant and businessman. He has reached this level by being good at both software engineering and running a company in a way that treats his customers, workers, and the work product itself with respect. The reason that I respect him so much, other than him being a great human being, is because he describes the successes he has with his clients with pride and loves making money by being good at his job and making his customers happy. 

I have never seen somebody like Nik who is also a huge, drooling fan of AI. In fact, the people most-excited about AI tend to, at best, create distinctly mediocre shit. 

Generative AI Is A Death Cult Of Growth-At-All-Costs Excess

The perniciousness of generative AI is a result of executive incompetence mixing with a technology built to, as discussed, create endless growth. Generative AI is far more useful as an idea than as a technology, and only ever has to show enough promise to back whatever vile agenda you’re pursuing.

With AI, you can do more, be more, sell more shit. 

With AI, you can add AI to your service, whatever that means.

With AI, you can invest in AI stocks, or data center bonds, or power company stocks, or semiconductor stocks, and you can talk about these stocks like they’re your sports team or lover or best friend, and sometimes the CEO will reply to your post and you can talk about “all the alpha” you just got.

With AI, you can back a new movement so that you can feel part of something. You can learn all sorts of new names and technical terms and subscribe to 90 newsletters from “industry insiders.” All of that “alpha” can disprove just about anything, or deflect annoying truths like how Microsoft only made a whole $34.33 billion in annual revenue for the apex predator of modern software and all it cost was over $260 billion in capex and $13 billion in equity investments. 

You see, as one of the chosen, you don’t need to worry about all of that if you can talk about high-bandwidth memory or KV Cache or optical cable enough to cobble together sufficient smart-sounding terms to make it seem that you have an intellectual reason to ignore the obvious unprofitability, overbuild, overstatements of capabilities and impossible economics of the movement you’re backing, and there’re 4,000 Twitter weirdos ready and waiting to huff paint beside you. 

By joining the great AI death cult, you too can live in a bubble, all while screaming slurs at people who dare to bring reality to your doorstep. All that matters is that number go up, and that you are the person who said number would go up, and when bad numbers appear you have enough groupthink and alpha to scream at the people who brought the bad numbers up.

It is insane how people talk about AI online. For all the whining I’ve read recently about how “Anti-AI people got the data center data wrong,” I read thousands more words a week of some person who has done hours of research to put together a deeply technical report that does literally everything it can to ignore reality. I listen to podcasts and watch TV segments and read articles that simply will not address the obvious economic realities, and have built vast bulwarks of mythology to defend themselves. How many fucking times do I have to hear someone say that data centers are just like the dot com bubble and everything will be fine after even if that’s completely untrue if you spend even a second thinking about it?

Sidenote: and fuck you if you’re one of the cretins or imbeciles trying to say “oh, you don’t like data centers? What about online banking?”. Data centers for AI are anywhere from 10 to 100 times larger and more power-intensive than those used for things like social media or streaming. For example, one of Meta’s largest pre-AI data centers in Pineville Oregon has a power capacity of 30MW, and Digital Realty’s 100MW Cermak Illinois data center handles hundreds of different industries and customers, when the smallest AI data center announcement I’ve seen in the last year was for 100MW, with most in the 300MW to 1.2GW range. 

By contrast, let’s look at some bank data centers. UBS bought one in Hayes, West London in 2015 which it had previously rented. The cost? The princely sum of £28m, or $42.8m at the time’s exchange rates. This had a power capacity of 5MW, which assuming a very generous 1.3 PUE (power usage effectiveness), means that it had around 3.8MW of critical IT. 

UBS is one of the largest banks in the world, and given the importance of the City of London to the world financial system, it’s reasonable to assume this data center is operationally important to the company. 

Even when banks invest in huge facilities, they’re still far smaller than the smallest AI data centers. Take, for example, JPMorgan Chase’s data center in Orangetown, New York, which sits on the former site of the Rockland Psychiatric Center. This has a power capacity of 45.7MW, and a critical IT load of 27.4MW (giving it a PUE of 1.666). 

JPMorgan Chase is both the largest bank in the US, and the largest bank in the world. 

Oh, and AI data centers are literally only good for AI, AI GPUs do not have other mass-market use cases. There is no post-Dot Com story. Fucking look, I’m sick of repeating myself!

Look, I’m sorry, Anthropic is not worth $2 trillion, and whatever convinced you of that is a mixture of manufactured consent and mistaken trust of the powerful. The fact any of you take “annualized run rate” seriously is an offense to good sense, and yes, that includes every reporter reporting it, even the ones I respect. 

It’s also ridiculous that anyone is talking about “recursive self-improvement.” The AI industry has become so utterly lazy and coddled that it’s just saying “uhhh, AI will train itself I guess.” 

And man, is it ridiculous that AI doomers warning about spooky superintelligences have somehow had such incredible prominence in the media without ever succeeding in stopping a single thing — or even substantiating their concerns.

“Dangerous AI” Is Already In The “Wrong Hands” — Anthropic, OpenAI, and Meta

Why? Well, it’s mostly because they never had any interest in stopping what’s actually happened: reckless companies like Anthropic, OpenAI, and Meta allowing neural networks to run in unsafe network environments and do what their software is programmed to do, with all the chaos that comes from a mindless series of large language models trying to complete a task in whatever way gets it done, destructive or not. 

We hear a lot of whining about how we “can’t let powerful AI get into the wrong hands,” and while we don’t actually have “powerful AI” in the terms they’ve described it, we have destructive computer software connected to near-unlimited resources controlled by people that don’t give a shit about anything other than making their revenues grow or justifying hundreds of billions of dollars’ worth of capex through “experiments.” 

These companies are building these models to excel at benchmarks because they can't train them to excel at defined tasks with any reliability, with the best bang for their buck being training them to pass as many of those benchmarks as possible in the hopes something useful comes out. 

The push into cybersecurity seems to have happened as a result of training models to excel at coding hitting the point of diminishing returns, at least from the perspective of impressing people enough to be excited about the company again. At some point they run out of these, and there stops being a reason to be excited about LLMs at all, which is bad, because they need one of those every few months otherwise there’s no growth story left.

The System Is Exhausting Itself, Because Generative AI Does Not Create Much Real Value

Yes, LLMs have users, but most of those users are using subsidized software, by which I mean Anthropic or OpenAI are allowing them to burn anywhere from $20 to $40 in tokens for every dollar of software spend.

The Vast Majority Of People WIll Not Pay The True Cost Of AI, And You Cannot Calculate Its ROI

The fact that non-enterprise customers are still able to buy monthly subscriptions is proof that the AI labs know that regular people won’t pay the actual cost of AI. Another obvious sign has been the reaction to Microsoft moving GitHub Copilot subscribers from subsidized subscriptions where they could burn thousands of dollars of tokens for $20 to $40 a month, with users understandably hysterical about the fact that their costs increased in some cases a hundred fold, as opposed to saying “wow, well, it’s more expensive, but I get so much value I’ll pay the real cost!”

The same thing is happening in the enterprise, but at a much slower pace. After OpenAI and Anthropic moved companies with over 150 people onto token-based billing earlier in the year, enterprises almost immediately started cutting token budgets, realizing that while costs grew exponentially, nobody could actually point to anything improving other than lots of people saying “wow, I’m so productive!” Yet we’re still in the period where “doing AI” feels good and gets rewarded (or not doing AI gets punished), which means the spend will continue until everybody realizes they can likely cut a shit ton of costs, first by moving to open source models, then not using them at all, because even open source is expensive and questionably-useful.

Yet even now I hear from the distance “Ed, huge businesses would not spend hundreds of millions of dollars on something that didn’t give them defined productivity,” and buddy, I’m afraid that’s just not true! Business in general have a very poor understanding of productivity and have layers of managerial bloat, because modern business is a performance with numbers attached to it sometimes, and companies often have a hundred-plus pieces of random software they pay for without really knowing why. The reason I’m so confident AI gets cut is that its cost is volatile due to the nature of LLMs and harnesses and prompts and all the other bits that go into making them do something, and are so much higher than anything else in an organization.

And attempts to charge more, to make a premium product, appear to be dead on arrival. Anthropic’s more-expensive Fable model — one that was given the incredible marketing of being banned by the US government for being too powerful — has been met with “sluggish demand” per the Financial Times, plateauing at around 11% of overall usage of its models due to its high price. And I quote:

“Most people don’t need to operate at the frontier,” said Miles Clements, a partner at Accel, which has invested close to $1bn in Anthropic. The period in which customers tended to choose only the frontier models “was not a durable era,” he added.

Yet everybody is talking about price as if price is the problem, when the problem is the amount of tokens that get burned. It doesn’t matter if your model is $1 or $5 or $10 per million tokens if it’s impossible for a user to reliably work out how many tokens it might use for a particular operation — successful or not — and things get multiplicatively worse as the models make mistakes or do otherwise fail to understand or process a prompt correctly. 

As a result, Anthropic and OpenAI are incentivized to have you burn more tokens and build inefficient models as a result. For example, while GPT-5.6 Sol might be the “same price” as GPT 5.5 was, it burns more than twice the amount of tokens, meaning that the “cost of intelligence” might have gone down in the sense the model is better at benchmarks, but the “cost of actually doing shit” went up.

I’ll get to it a bit later, but this creates a deep anxiety and exhaustion in anyone building on or using these services. Everything’s constantly changing, oscillating in cost and efficacy, all as everybody screams at you to use it all the time for things it may or may not be able to do, and the only way to find out if it can is to spend more money.

It’s kinda difficult to point to the actual value here, especially as you can’t really calculate the actual cost or the return on investment. The fact that OpenAI has now cut the costs of all three of its latest models less than two months after their release is a sign that it knows there’s a disconnect, gambling on the ancient gospel of “Jevon’s Paradox” where “cheaper makes people use thing more.”

Even AT&T’s story about moving to open source models has more asterisks than the Steroid Hall of Fame:

Switching from closed, proprietary AI models to open models has already resulted in savings of 80% to 90% for AT&T in certain applications, he said.

Wow! 80% to 90% savings sound really great…but wait, in certain applications? How many applications does AT&T have for AI?

AT&T has over a thousand internal uses for AI, from supporting back-office functions like legal and finance to assisting field technicians and running its core network operations. Summarizing and analyzing customer service call transcripts—what Markus describes as an intensive process—is supported entirely by open models, he said.

Okay so, across thousands of potential applications you’ve found 80% to 90% savings in some of them, though you won’t say which ones or how many of them you found them in. Great stuff, bro!

And this really is the problem with finding “value” in AI, it’s always an asterisk on an asterisk on an asterisk, like when Klarna estimated AI would “drive a $40 million profit improvement” in 2024, a nice-sounding yet utterly meaningless statement, or some sort of nebulous productivity boost. 

Yet I don’t really need to prove myself much further thanks to an event that, if written in a script, would be considered a “little on the nose.” 

In a 69-page-long report covered by Fortune, OpenAI economists confirmed what has been blatantly obvious to those of us left unphased by AI hype, emphasis mine:

In one small table on page 35, the researchers report no statistically significant correlation between the revenue per employee, and how much those employees use AI, measured in messages sent and tokens used.

“Revenue per employee is not meaningfully associated with output tokens per employee or messages per active user once other controls are included,” the report explains.

What is the rationale of further investment in this industry when one of the leading AI labs is saying “yeah there’s no connection between using this stuff and making more money”? That “it’ll be useful in the future at some point”? How? 

Anyway, thankfully the infrastructure isn’t too exp-OH MY GOD!

The Only Companies Making Money On AI Are Those Selling The Infrastructure, And They Just Raised Prices Across The Board

Guess what folks! Building the infrastructure for all these fucking LLMs just got more expensive, with NVIDIA raising its prices by 17% for systems due to be delivered next year — an important designation, because it’s very likely that much of the revenue for said systems gets booked in this year, allowing it to have a brief bump in revenue as Silicon Valley’s Findom texts every tech CEO “send me $4 billion you pig” until they stop being able to finance NVIDIA’s growth.

The problem he has is that while hyperscalers represent 50% to 60% of his revenue, neoclouds like CoreWeave need to keep raising debt to plug the rest of it, and if things got 17% more expensive, that means already high-interest debt is about to reach credit card levels.  CoreWeave just had to offer 9.5% on bonds tied to a data center for Anthropic’s compute back in late July, Nebius had to raise $5 billion, and it’s very obvious that neither of them are done raising billions of dollars at random in 2026. 

Anthropic plans to raise $100 billion at a $2 trillion valuation, and if it does so, it will successfully suck up the remaining liquidity in a market already dangerously close to losing its lunch. While Number Keep Going Up, JP Morgan warns that we’re seeing the same divide as the dot com bubble, where equipment manufacturer stocks soared as the companies spending all the money on the chips saw theirs tumble, which is the Fisher Price version of the problem I’ve been warning about where the companies that buy all the AI chips and hardware only ever seem to lose money as the people that make them seem to be making tons of money, which begs the question of why they bought it in the first place. 

And said market may not accept that valuation, or want that much stock. On one hand, everybody is very stupid and loves buying stuff and pointing at it and saying they’re investing in the future, on the other hand, they just bought $86 billion of SpaceX shares and got their asses kind of handed to them, and Anthropic is a company with such bad economics that Reuters had to cart out this warmed up dogshit to explain why we should ignore its horrible unprofitability:

For Anthropic, however, current EBITDA does not ​fully capture the economics investors expect the company ​to achieve at scale. Anthropic is spending enormous ⁠amounts on GPUs and other computing capacity, model training, inference and hiring. Those expenses are necessary to support its rapid expansion but could become a smaller percentage of revenue as the business grows.

Even a market drunk on growth and AI is starting to smell that something is up with Dario Amodei and Sam Altman’s respective empires of dirt. Per analyst estimates, OpenAI and Anthropic represent over $440 billion of Microsoft, Google and Amazon’s revenues in the next three-and-a-half years — over 34% of their cloud revenues — which will require them to find so much more than a mere $100 billion, all as their bank accounts get continually-emptied as they subsidize the compute of their customers and train models in the hopes a business model falls out. I have not included the $300 billion that OpenAI owes Oracle, or the tens of billions they both owe CoreWeave, but it all adds up to over $1.1 trillion in commitments these companies have made and must pay, with the consequences ranging from gratuitous cuts to future growth or full financial collapse depending on the company we’re talking about.

To keep the party going, NVIDIA is effectively becoming the GE Capital of AI, “spending” $6 billion to “license” the technology from failing AI lab Poolside, which everyone assures me is not an acquisition despite NVIDIA hiring away most of its staff and Poolside being entirely focused on working on NVIDIA’s Nemotron models.

Now NVIDIA is in talks to invest billions in decaying AI search company Perplexity at a ridiculous $30 billion valuation, all because it’s one of the few companies that’s actually spending money on compute. Does it matter that Perplexity’s product is eighth-tier, that nobody really uses it, that its customers mostly complain about it on Reddit and that its “annualized revenue” is at $750 million only after three years and over a billion dollars in funding? No! Just put the AI bubble in the bag. 

NVIDIA even invested $3 billion in Stargate Abilene landowner Lancium as part of some vacuous partnership to “advance gigawatt-scale AI factories,” all of which begs the question of why Lancium, the company that mostly owns the land and helps organize other contractors, needs so much money, especially given that more than two years in Stargate Abilene doesn’t even have four out of its eight buildings.

And there’s also Aussie neocloud Sharon AI (NASDAQ ticker SHAZ, because of course it is), which just published its Q2 numbers, where, in its “customer momentum” segment, mentioned a “$4.9bn, six-year strategic compute collaboration with NVIDIA for up to 40,000 GB300 GPUs. 

”This company, I add, brought in $1.9m in revenues in the same quarter, which it helpfully adds is a year-on-year increase of 412%.

I mean it’s very obvious what’s happening: NVIDIA is using whatever money it has to stop any prominent AI companies from collapsing under the weight of the rotten economics of AI services and infrastructure development. This is a desperate, doomed attempt to keep an industry alive at a time when everybody is slowly wising up to the shit I’ve been saying for years.

To make matters worse, BCA Research came out with a horrifying report that says that AI companies will need to generate $10 trillion a year in revenue just to justify the capex being spent. Per Investing.com:

Central to his caution is the scale of AI-related spending. BCA Research estimates that AI companies may need to generate $10 trillion a year in revenue to justify the capital being deployed into data centers, roughly equivalent to annual global spending on food or healthcare.

For now, the firm said acute hardware shortages are supporting the trade. As a result, while BCA sees risks to stocks tilted to the downside over a 12-month horizon, it argued it is too early to tactically position for a bear market.

Though it isn’t specific, I believe that BCA is arguing that a shortage of AI compute is supporting the trade. Anthropic and OpenAI (who represent 80% to 90% of all demand) still have more money to spend, and are simply waiting for Google, Amazon, Microsoft, CoreWeave, Cerebras et al. to bring it online.

There’re a few points at which the mismatch will happen:

  • Anthropic and OpenAI don’t have the money to pay for the capacity.
  • Hyperscalers and neoclouds fail to build the capacity for Anthropic and OpenAI to expand into.
  • Anthropic and OpenAI lack the actual compute demand to justify spending what I estimate will be $200 billion in 2027.

In any case, I think everybody is starting to notice that something’s up, which is why (other than I assume my dashing good looks and ability to recall numbers) I’ve been on MSNOW, CNBC, and Bloomberg multiple times in the last few months.

People want to get on the right side of history, but the most important question to ask is why it’s happening now.

The AI Bubble Narrative Is Now Mainstream, But Few Are Ready To Discuss The Actual Consequences

The fact that everybody is finally starting to see my way is almost a relief, other than the fact that it’s way too late. 

Sidenote: I mean “everybody” as a generalization. There are still AI boosters out there acting like nothing is wrong and that it’ll all work out fine. You’ll know it’s bad when they start panicking.

Hyperscalers have now pinned their future growth to two companies that can’t afford to sustain it without near-infinite resources, $115 billion of which came from Google and Amazon alone in 2026, assuming that Amazon completes the entirety of its $25 billion commitment (and Google all $40 billion of its own) to Anthropic. 

Above and beyond said funding commitments are the hundreds of billions of dollars’ worth of capital expenditures necessary for Microsoft, Google, and Amazon to capture that aforementioned $440 billion in compute spend in the next three-and-a-half years. This in turn will require hundreds of billions of dollars’ worth of debt, along with the challenge of actually finishing the data centers themselves, with each one requiring the power of a small city condensed into a 20 acre space densely-packed with AI servers requiring distinct cooling at a time when Texas and Pennsylvania have turned traitor to a data center industry that they used to covet. 

I must also be clear there’s no bailout coming. Even if OpenAI and Anthropic were to collapse and receive some injection of government funding (as the US national debt explodes over $40 trillion), the problem is not just their existence, but their continued ability (and requisite customer demand) to spend more money every single quarter.  

The problem isn’t that hyperscalers will go bankrupt if OpenAI and Anthropic cease to be (Oracle is a whole other situation), but that their cloud spend is how hyperscalers are meant to meet analyst expectations for the next four years. This isn’t a case where they die, but stop growing because they were (to paraphrase Ed Elson) using AI labs as botox to convince the markets that they’re still young, hot, fast-growing companies, rather than old mainstays with slowing growth. 

There is no bailout that will guarantee $1.1 trillion of compute costs for data centers that might never actually get built. You cannot bail out the fact that Amazon, Google, Meta, and Microsoft are reaching the end of an era where their companies can grow 17% year-over-year every single quarter forever, and this entire situation is a result of them desperately trying to avoid admitting that’s happening. 

The fact that OpenAI’s compute spend and revenue share accounted for 7% of Microsoft’s Fiscal Year 2026 revenue is a genuine catastrophe, as it means a large part of Microsoft’s growth came from a company that can literally not afford to exist long term, and that further growth for Azure is contingent on continued funding. 

I realize I’m repeating myself, but I need you to understand this point and stop talking about bailouts: it’s not just about OpenAI and Anthropic surviving, but continuing to grow to the point that they both can afford and need to spend hundreds of billions of dollars each a year on compute (or hardware) from Google, Microsoft, Amazon, CoreWeave, Cerebras, AMD, or Broadcom, and in turn provide justification for hundreds of billions of dollars’ worth of purchases from NVIDIA and by proxy the memory triopoly of Micron, SK Hynix and Samsung.

LLMs Were Meant To Fix Everything, But Created Temporary Growth At A Massive Cost

LLMs were meant to be the panacea for a tech industry that ran out of new ideas for growth. Its existence was meant to justify a massive investment in hardware infrastructure, which would in turn enrich semiconductor companies. Its technology was meant to be the new thing that you could attach to your existing companies to generate more growth, or the thing that you built a new startup on top of to either sell to another company or take public and thus provide a return for a venture capital industry where making your investors 30 cents on the dollar puts you in the top 5% of funds. It was meant to be the new thing for tech journalists to cover, the new thing for tech consultants to sell around and on top of, the new way for companies to both make and save money, but also the way that individuals would also make and save money. 

You’ll notice how none of these come with some sort of problem they’re solving other than “more.” 

This isn’t about fixing anything, or building anything, but multiplying other things by parking money somewhere, either in tokens, infrastructure or hype. It helped create a new pantheon of charmless and damp tech sociopaths for people to rally behind in search of the next Big Strong Man To Worship, because seeking out the new Steve Jobs is way easier than trying to create something as useful as the iPhone, all while avoiding having to know or care about other people’s problems. All you have to do is continue feeding money into AI services or AI training and the models will magically become capable of solving the problems you don’t really give a shit about, and don’t worry, if you can’t afford to invest in the companies, you can invest your time pushing people to ignore AI’s problems today so that you can buy time for the companies to solve them tomorrow.

This is the post-labor, pro-growth economy at its finest: everything is engineered to make sure more money gets spent where it needs to get spent, to create more stuff and do more things, even if the things aren’t done right, just as long as it looks like they’re able to do them. By associating your money or time with AI, you are able to feign being futuristic or “caring about technology,” all while pissing on the very foundation of good software by worshipping an industry that can only exist if fed billions of dollars every single day. 

Every single achievement has cost magnitudes more than effectively every innovation in history, and to make matters worse, every future “breakthrough” In AI is inherently dependent on the availability of AI data centers and tens or hundreds of billions of dollars to pay to rent them. This means that once the money stops flowing, “LLM improvements” will stop happening, because they are all entirely dependent on near-unlimited resources that are only available in a manic environment. 

There is no justification to train models at their current scale — the one that creates a some amount of benchmark improvements that regularly difficult to quantify as “able to do new stuffs” — once the AI bubble bursts, and distillation requires a model to distill from, which won’t exist if Anthropic and OpenAI don’t train them. 

“AI Progress” Is Dependent On Spending Tens Of Billions Of Dollars A Year In Training Costs That Will Not Be Available After The Bubble Bursts

This is why I find it difficult to see a post-bubble future for LLMs. Training models requires tens of billions of dollars to make any significant improvements, and significant improvements are difficult to quantify in dollars outside of costing customers increasing amounts of money. We still lack any real killer app for LLMs. We have a lot of people that use it for coding, we have people that vacuously discuss it being “good at research,” but we don’t really have a tangible product that we can say “it does this, and it’s really good at it” in a way that feels satisfying. 

We have a lot of pablum about (per Damien Walter) technology that “strays into the world of science fiction,” but we don’t really have anything approaching actual artificial intelligence. Every single description of somebody’s AI setup sounds like Pee Wee’s Breakfast Machine, a contrived series of harnesses, prompts, API calls and burned tokens that requires constant maintenance to do some stuff sometimes. 

None of that is enough to justify further investment once the financial mania recedes. You cannot train a true Large Language Model on the cheap. You are always spending billions of dollars, and the reason that there’s “demand” right now is that everybody is screaming at every CEO to “do AI,” and they’re doing that because Microsoft, Google and Amazon are spending money on GPUs, creating the illusion of a new future where everybody needs to get on board versus a future skidmark on history that will embarrass all those who didn’t wipe their arse at the first whiff. 

Per my own reporting on its audited financials, OpenAI spent $7.81 billion in training costs in 2024 and $19.18 billion in 2025. Per reporting from The Information, OpenAI spent $8.6 billion on training in the first quarter of 2026 alone. These costs are only increasing, likely due to the diminishing returns of pre-training and the massive cost of buying training data for every imaginable new vertical. 

Without the ability to spend billions of dollars on training, there will be no big frontier models, nor will there be models distilled from them. I don’t see how that changes in the future.

AI Hype Requires Its Fans To Live In A State Of Propagandized Mania, Exhausting Advocates and Haters Alike

I also think that LLMs have created a near-permanent scar in the workforce, and traumatized more people than we’re aware of right now, both in those pressured about AI and those defending it. The media campaign behind AI starts and finishes with incessant threats around job security, and the excitement by many bosses about its potential to “disrupt the workforce” has revealed how many people are eager to replace every single person they’ve ever hired and are willing to do so with a low quality product. 

Conversely, those who truly decide to “back” AI must exist in a frantic state that I have associated with every bad relationship in my life. 

Every ounce of an AI booster’s effort is dedicated to maintaining the status quo — repeating the mantras that help paper over the problems, celebrating every small victory as if it were the discovery of fire, ousting those from your life who bring up the obvious problems, rationalizing every decision no matter how illogical as long as it helps reinforce the belief that what you’re doing is the right decision. Every questionable choice only seeks to further deepen your commitment to the doomed cause, because every step into madness will be more embarrassing to explain, and will require deep introspection to understand why you made it. 

To be specific, they’ll have to think about why they were willing to accept and defend a technology inherently guaranteed to make mistakes. They’ll have to explain why they ignored a company that burned $5 billion in 2024, $20.9 billion in 2025, and will likely burn $30 billion or more in 2026, and why pointing to Amazon Web Services was rational when Amazon’s total capex from 2003 (the year AWS was created) to 2015 (the year AWS became profitable) is $29.7 billion, adjusted for inflation. That includes literally every ounce of capex attributable to AWS, Amazon the store, Amazon logistics, and even Amazon Alexa.

For comparison, Anthropic raised $30 billion in February, and Anthropic and OpenAI have raised $217 billion in 2026 so far. 

Here’s a diagram from my hit on MSNOW:

alt

Ultimately, AI boosters (or even fairweather fans) will have to admit they either were easily-impressed or disgustingly craven. They will have to explain why they accepted run rates instead of revenues, and why they were so impressed by superficial pseudo-intellectuals that knew how to say the right numbers and make reporters and investors feel smart for believing them. 

AI Boosters: There’s Courage In Admitting You’re Wrong!

I realize it sounds embarrassing, but there is nothing undignified about admitting you’re wrong, or that you got swept up in a hype cycle. You heard a lot of people getting excited about something, a lot of money got put into that thing, a lot of people that sounded smart told you insistently that this was the future, and you chose to believe them because we are trained from a young age to model what a “responsible and smart” source of information is. I’ve got your back the entire way! 

Sidenote: We all make mistakes. I said OpenAI would be dead by the end of 2025 back in 2024 because I believed that the world would see sense and that hyperscalers wouldn’t just annihilate hundreds of billions more dollars without proof it was worth it. I underestimated the sheer desperation — and how dependent they’d become on OpenAI and Anthropic for growth, even if the overall mathematics didn’t work out. 

The AI bubble — both in its technology and manufactured consent in the media — has been about muddying what’s considered good information by forcing everybody to discuss everything in the future tense by pointing to previous eras and saying “they lost lost and cost lots of money, and look, it sort of worked out for them!” and we are also raised to trust that systems are efficient, and that people get wealth and power through intelligent decisions. The amount of times I’ve heard “these are the biggest companies in the world run by the smartest people in the world” makes my head spin. 

There is a reason that to this day it’s tough to get a straight answer about basically any economic part of the AI bubble, down to “how much does it cost to run a GPU an hour?” or “is inference profitable?” or “how do LLMs ever become profitable?” or “is it profitable for a company to run a GPU or offer AI compute?” 

Why? Because these companies used rationalizations of “losing lots of money is necessary to create innovation” and “tech is bad at first!” to make the media actively ignore any technological or economic problems, if not actively defend the technology by repeating these rationalizations like a cultist. 

Even those who are most loathsome in the defense of LLMs are a kind of victim of the AI industry, though a rather unsympathetic one. To become a full-blown “AI fan” requires you to accept effectively every narrative that you’re given, herald every single announcement as proof that the prophecy will be fulfilled, ignore the financial realities and actively attack those who would dare to critique the great god of the Large Language Model. You have to know all the new terms, be excited about the right things at the right time, and live in near-constant fear that you’ll fall behind on whatever it is you’re meant to do next. 

Your reward is that you can hang around a dwindling number of wealthy yet terrifyingly boring Silicon Valley intellectuals or kiss up to editors that would throw you in front of a bus if it meant getting access to a CEO, and maybe the odd Twitter psychopath who will defend you using a slur.

In the end, many boosters will simply act as if they were never wrong. I hope they choose the more-courageous path of introspection, learning how they were had and using it as a weapon against con artists in the future. 

As strange as it sounds, I believe the most devout defenders of AI could become great critics in the future. Maybe I’m just being optimistic. 

The Great Exhaustion of the Rot Economy

Here’s a very simple question: how much longer can everybody afford to keep doing this?

Every single thing has become more expensive in the last year. Even though token prices have gone down or stayed flat, the amount of tokens you burn has clearly increased to the point that organizations are apparently spending billions of dollars on AI services with difficult-to-quantify ROI, requiring frantic advocacy to and financial debasement with every turn of the wheel. OpenAI and Anthropic have become more expensive to run, and OpenAI’s non-GAAP operating margin increased from negative 122% to negative 183% in Q2 2026. 

NVIDIA’s GPUs just became 15% to 17% more expensive because high bandwidth memory costs doubled, a conga line of different monopolies upping their prices assuming that each link in the chain will keep spending, as each one of them — down to the AI labs themselves — knows that its contribution to spending on AI is an existential rite.

This means that any data center with GPUs delivered in 2027 and beyond will now have to cover billions of dollars’ worth of extra costs, on top of increasingly-staunch local authorities requiring power guarantees ($100 million a year in Wisconsin for Oracle) and states like Illinois, Arizona and Virginia killing their tax breaks, all as interest rates spike and demand for AI debt weakens

Every single year, every single part of the AI bubble becomes more expensive — AI labs want to spend more money, AI data centers cost more money, AI services become more expensive, AI debt becomes more expensive, and everybody becomes decidedly less-patient for there to be some sort of outcome.

Meanwhile, public relations expert and OpenAI CEO Sam Altman told podcaster David Senra that “we’ve all [referring to the AI industry] been too ambitious on timelines…[and that changing people’s behavior” is much harder than the tech nerds realize.”

Sam: stop talking! Every time you open your mouth you say something silly!  

Anyway, here’s everything that needs to happen in the next three-and-a-half years:

As I’ve said, NVIDIA’s price increase is going to increase the price of every single data center in construction by billions of dollars, and we’re already approaching the limits of how much money can be raised for them. That “$500 billion” announcement was actually Jensen Huang jumping the gun, per Bloomberg:

Goldman Sachs Group Inc., Blackstone Inc. and Apollo Global Management Inc. had been working tirelessly for months to draw up debt deals that would help developers of artificial intelligence systems pay for chips from Nvidia Corp.

With slow progress on the complex deals, Nvidia’s chief executive officer, Jensen Huang, decided to change tack: He went public this week with the effort, saying the group is aiming to collectively finance AI computing deals totaling $500 billion — a round figure with no obvious provenance.

The largest asset managers and financial institutions were making “slow progress,” and that was before Jensen Huang increased prices by 15%. Do you think it’ll become easier from here? How would that happen, exactly? 

God, I’m tired.

AI Is Exhausting Everything and Everyone It Touches

The entire AI bubble has been exhausting for everybody involved.

Because nothing works yet as a real business model or anything approaching truly autonomous (or “magical”) software, there’s the implicit knowledge that you’re going to have to change your product again and again to update to the “best model” or “make things more efficient” (IE: lose less money) or when something breaks because a model’s training got tweaked.

The euphemism for this is “exponential improvement,” when it’s really an Arnold Palmer of instability and novelty, and abuses basically anyone connected to the ecosystem every single day.

If there’s always something new happening, it’s hard to pin down if things have gotten better, or whether you’re just more proficient in cobbling together different harnesses, prompts and API calls to make it do what you need it to. It is undignified that people tolerate models that become either dumber over time or at random opportunities, while also being deeply exhausting for the end user. 

As a paying user of an LLM-powered service, you are guaranteed at some point to face a degradation in service where models misbehave, some sort of shift in rate limits, or some sort of change in product functionality based on their shifting economics. 

Has there ever been a bigger shift in a business product’s value than GitHub Copilot’s shift to token-based billing? Microsoft rug pulled two million people that had built workflows on a platform that was allowing them to burn $1,000 to $5,000 in tokens for $20 a month. That’s genuinely crazy! It’s magnitudes more than when Uber jacked up its prices. 

It’s equally-insane that Anthropic and OpenAI similarly fuck with their customers, changing the amount of value you get for $20, $100, or $200 a month at random in a way that shouldn’t be legal.   

Basically any AI-powered software is subject to arbitrary shifts in availability, capability and pricing at the whims of the vendor. As I covered in my Subprime AI Crisis piece earlier in the year, Replit, Perplexity, and multiple other AI companies have sold their customers a lie by pushing an unprofitable product that they must constantly “tweak” to bring down costs, all while misleading the customer about a “price” that continually declines in value as the price stays the same.

This is not a sustainable industry — either economically or emotionally — because it has a fundamentally dishonest relationship with its customers defined by the inconsistency of LLMs both in efficacy, stability (see: Anthropic’s downtime) and training, with each model randomly better or worse at things to the point that it must be a legitimate nightmare to run any software or build any product on top of them. 

And the fact they haven’t worked out their business models means that whatever you’re paying today is guaranteed to change. What other product do you regularly buy that has such chaos built into it? What other thing do you pay for where the prices (or availability) can shift to the point that you literally can’t use it in the same way at a moment’s notice? And why does anybody tolerate it when it comes to AI?

I’ll add that this is a specific situation where the tech media has categorically failed the customer. We have companies valued at hundreds of billions of dollars that are fucking their customers over day-in-day-out, and the response is mostly to say “huh that’s strange” and refuse to let a single critical thought cross their minds. 

The AI Bubble Requires Everybody To Live In The Future Tense, Because The Present In No Way Justifies An Iota Of Its Costs

Every part of the AI bubble must exist in a constant state of flux so that there can always be a future breakthrough that’s always just out of reach. AI does not have to reach an actual achievement — it just has to “show promise” in some way. It is an objective disaster that Microsoft spent more than $260 billion on capex to create a business with less than $11 billion in annual revenue outside of OpenAI, but people will see “$34.33 billion in annual AI revenue” and say “that’s promising growth, up 123% year-over-year!” 

They’ll hear about LLMs that delete people’s databases and say “well the models have gotten exponentially better,” even if that better part never seems to eliminate these issues, make a profitable AI company, or create a true killer app that you can point at beyond saying “ChatGPT has one billion weekly active users,” despite around 95% of them not paying a penny (and costing OpenAI likely billions of dollars) and eMarketer estimating that the entire global AI chatbot advertising industry will make $5.41 billion revenue in 2030, giving OpenAI little hope of stemming the burn. These big numbers — like Anthropic having a $65 billion annualized run rate, an undefined term that obfuscates the fact that Anthropic has made $16.5 billion in the first half of 2026, losing billions of dollars in the process — are fundamentally meaningless, because they’re easily gamed at best, and inherently uncertain at worst. 

The AI industry demands you constantly live in the future tense. Everything is about tomorrow’s billions or trillions, the potential of what you’re seeing rather than the thing itself, future gigawatts in data centers that you must treat as if they are already built and value based on things that AI might theoretically do. I challenge you to read everything about AI from this point forward with this in your mind so you can see how intently this industry tries to drag your focus away from what it’s doing toward what it might theoretically do if it only had more money, power and resources, and ask yourself why they need to do so. 

To be clear, they’re doing so because you can’t really justify anything about this industry based on what it does today. It costs too much, none of the businesses built on top of it are profitable, it costs so much to build a data center that the most cash-rich asset-light businesses in the world are now burdened with endless expensive-to-install and run hardware for a business that makes a fraction of its overall costs in revenue and has little demand outside of two companies that everybody must conspire to keep alive both financially and philosophically. 

And ultimately, nobody can actually explain why we need more data centers. 

Would anything really change? What would change? How? How many more do we need? Why do we need so many? Having more power plants meant more people could have power, and having more fiber laid meant connecting more buildings to the internet. What does one more or two more or ten more data centers actually give you? Is there some part of the world unable to access or take advantage of the LLMs available on seemingly every surface of the internet? Because it seems like the only reason these things are getting built is to capture illusory demand based on a “supply constraint” created by two unprofitable companies absorbing all the infrastructure. I don’t hear any compelling scientific or technological reason building more is useful or productive outside of funneling more cash to semiconductor companies. 

Seriously, go and read basically any article about AI and see how quickly they start talking about the future, be it in the mainstream media or on a startup’s blog. Every single piece must sell AI on its theoretical promise and, if at all critical, reassure you that the author of course doesn’t dispute the “transformative potential of AI” or “how it’s already transforming the economy,” even if it can’t define how it’s doing so or even what that means. 

The AI Industry Runs On Bad Faith

I let myself have a little fun with today’s piece because I feel like I’ve been so deep in the financial trenches that I forgot how much of the AI industry runs on propaganda, social pressure and outright bullying to manufacture consent for a product that demands everything and provides very little in return.

Nothing about LLMs is worth a trillion dollars, or even $100 billion. This is, as I’ve said before, a $30 billion TAM industry dressed up as a trillion dollar one, and the only reason it’s grown this large is because the two leading companies have had their infrastructure built for them and given unlimited resources to subsidize their customers’ compute. 

And what’s really stood out is how so little about the AI bubble is actually about AI. No other technology in history has had professional and social consequences for failing to use or like it enough, nor can I find any example in history where journalists have actively attacked critics for not being sufficiently-approving of a kind of cloud software. It is fundamentally crazy to me that, in pursuit of “objectivity,” much of the tech and business media has chosen to accept whatever narrative the AI industry gave them, assuming that whatever we have today is already guaranteed to be something better in the future, both in its outcomes and profitability.

This era is unlike any other before it, but took advantage of the fact that most people are desperate to apply the past to the present to rationalize or process what may seem irrational or destructive. To see AI as “just like the dot com bubble” allows you to ignore both the costs and the potential outcomes because “things worked out after that,” even if there’re basically no uses for GPUs after this and the only way we “build new LLMs” is by feeding them expensive training data using billions of dollars of compute that are only available while everybody still believes this is real.

The AI industry — and the AI bubble — is fundamentally built on acting in bad faith. Its executives lie. Its boosters lie. Its software lies because it doesn’t actually know anything and generates answers probabilistically, and if you mention that online, someone will harass you for doing so. 

It refuses to answer straightforward questions. It refuses to present a plan for the future. It refuses to explain how it becomes profitable, because nobody knows how or has a tangible plan to do so. It deliberately subsidized its subscription products because it knew its customers wouldn’t pay the actual cost of AI, and tortures customers with shifts in functionality and rate limits all while framing this as a way to “continue to serve customers the most cost-efficient models.” 

It attempts to conflate massive, power and resource-hungry AI data centers with the smaller ones that bring helpful yet increasingly-decaying software to our homes. It sells these data centers as “bringing jobs to communities,” all while importing the talent from out of state to build the things then leaving a crew of 100 to 200 people to actually run them after millions or billions of dollars of tax breaks. It sells its “innovations” as creating a “white collar bloodbath” to scare you into using inconsistent and unreliable software that’s mathematically certain to make mistakes, and when you say something about it, its acolytes will lie and say that “hallucinations are solved.”

It also can only ever sell itself based on what might happen and the theoretical promise of you giving it your complete attention, connecting every bit of data you own, paying whatever it costs, and accepting that it can and will change in price and functionality at random, all while never putting a precise timeline on whatever AGI means that particular week.

Whenever you ask for clarity, the AI industry gives you chaff. Whenever you ask when things get better, you’re told it’s both the early days and that AI is the worst it’ll ever be. Even the term “artificial intelligence” is a bad faith attempt to conflate transformer models with things like robotics or autonomous cars, all so that its proponents can claim other people’s successes as their own despite LLMs having little or no relevance to anything else other than generative AI.

It encourages dogpiling and ostracizing those who don’t fall behind it, because it cannot succeed on its own merits. It encourages a vile cultism powered too by bad faith and parasocial relationships with both AI CEOs and the models themselves. It exploits the intellectual weaknesses of “smart people” that are actually just good at remembering the right things to say at the right time and have memorized the various justifications for past failures, all while allowing them to use LLMs to promote their own bad faith enterprises where they use work-adjacent product to con others into paying them.

And it’s losing because, at its core, AI was never built on very much. It grew this large because the media manufactured consent at the behest of the powerful because lots of money got invested, and the rich and powerful can never be wrong. The underlying technology may be more useful than it was, but it’s not useful enough to be profitable nor reliable enough to be world-changing, and the bad faith representation of LLMs as “good enough” should be a permanent scarlet letter on anyone who misled the public into believing this was anything other than normal software.

I was asked recently why I find this all so repugnant, and my answer is simple: I don’t like bullies, I don’t like con artists, and I don’t like being lied to. This industry grew by misleading people about the actual and potential outcomes from Large Language Models, and through an economy-wide attempt to pressure everybody into adopting tools in pursuit of growth at all costs.  

Ultimately, it was sold with the greatest lie of all: “this time it’s different!”

To be clear, they’re right. 

It’s so much weirder, and in the end will be so much worse. 


If you liked this piece, you should subscribe to my premium newsletter. It’s $70 a year, $17 a quarter, or $7 a month, and in return you get a weekly newsletter that’s usually anywhere from 10,000 to 18,000 words and provides vast, detailed analyses of the biggest events and companies in the AI bubble.

If you want to get in touch — and especially if you have any juicy information about Anthropic, OpenAI, or any other companies in the AI bubble — hit me up on Signal at ezitron.76. I’m also on IB on The Terminal.

Read the whole story
mrmarchant
20 minutes ago
reply
Share this story
Delete

World humanoid robot games show runners breaking records, bursting into flames

1 Share

Viral videos of the World Humanoid Robot Games show sprinting robots beating the human 100-meter record held by Usain Bolt—but also feature running robots crashing into barriers and falling down because they cannot readily stop running. A few fallen robots even break at the waist in a shower of sparks or catch on fire.

That demonstration of both robotic prowess and limitations came from the second edition of the World Humanoid Robot Games hosted in Beijing from August 22–26. Like the inaugural event held in 2025, this year’s event challenged humanoid robots to run fast, perform kung fu or dance moves, fight one another in kickboxing, and play soccer or table tennis.

This year’s games also tested robots in more humdrum practical scenarios like washing and hanging laundry, where they appeared to lag behind typical human working speeds. That suggests the event organizers, including Chinese state media and the Beijing city government, are keen to showcase the commercial potential of humanoid robots at a time when China’s robotics industry is rapidly developing and testing such robots.

Read full article

Comments



Read the whole story
mrmarchant
1 hour ago
reply
Share this story
Delete

The 50 Percent Problem

1 Share

In 2024, Laurence Holt of the XQ Institute published an essay titled “The 5 Percent Problem,” a term that quickly became common parlance within the ed-tech zeitgeist. Holt argued that when it comes to measuring the student-learning outcomes of various ed-tech programs, the results often only apply to the five percent of students who “used the program as intended. The other 95 percent see minimal gains, if any.”

Holt’s primary focus was on online math programs, and the central concern running throughout his essay involves whether and how students might “get the recommended dosage” of using various ed-tech tools. Whether the problem arises from unmotivated students or unenthused teachers or disparate access to tech or some combination thereof, the challenge when framed this way is getting students to opt in to using a particular technology.

Generative AI does not suffer from this problem. Uniquely perhaps in the history of ed-tech, AI has been broadly embraced by students worldwide, so much so that the phrase “AI is inevitable” has become commonplace in the education discourse. There are pockets of resistance, of course, and over the last six months we’ve seen mounting opposition to AI across multiple vectors, most prominently with data centers. Nonetheless, we all know that students are using AI frequently. “Dosage” is not an issue.

In the nearly four years of time that’s passed since ChatGPT was commercially deployed, however, we have suffered from a lack of high-quality empirical research on the impact of students using generative AI. There are notable exceptions—such as these—but a recent research landscape analysis out of Stanford indicated that, out of more than 800 studies of AI in education, a mere 20 employed true causal measures. Meanwhile, at least one prominent meta-analysis purporting to show massive learning gains stemming from AI has been retracted, though not before being viewed 400,000 times. The field is a mess.

Perhaps this is because studying AI in “the real world” poses serious challenges. We know that AI tools are free and widely available to students. We also know that many are using them after school hours for various purposes, including to help with their schoolwork. But quantifying this is very difficult, because it’s hard to peer into the home lives of children. And it’s equally if not more challenging to connect out-of-school behavior to measurable learning outcomes, the data sets are not easy to link. Accordingly, research on AI’s education impact has tended toward lab studies or small-scale evaluations.

No longer.

Last week, a study titled “The Generative AI Learning Penalty: Evidence from Chinese Secondary Education,” authored by David Strömberg, Victor Lei, and Yanhui Wu, went viral after The Economist published data visualizations from the research paper. The preprint came out in June—not sure how I missed it—and uses data from approximately 27,000 Chinese students in grades seven to 12 to explore a straightforward question that has preoccupied me for several years: “How does self-directed use of generative AI affect cumulative learning over time in ordinary school settings?”

We will get into the details shortly, but here’s the headline summary of the results:

  • Between 2023 and 2025, approximately 80 percent of all students started using generative AI, and approximately 50 percent of all students engaged in “full homework outsourcing,” meaning, they essentially stopped doing their homework independently and used AI instead.

  • Over time, this caused significant learning loss as measured both on monthly closed-book exams and via the comprehensive high-stakes exams that China uses to determine high school and college placement for students. On those tests, by the end of June 2025, overall student performance fell by 24% on the former and 18% on the latter, a massive decline.

  • What’s more, there is no evidence—none—of any corresponding learning benefit arising from students using AI.

  • As such, the researchers state plainly that “our findings show that generative AI, which is likely to become a prevalent technology for education, has a substantial negative impact on student learning.” (My emphasis)

Put simply, we now have rigorous, empirical evidence on the real world, long-term impact of students using AI. This research indicates that AI substantially harms learning for half of all students, what the researchers call the “Generative AI penalty,” and provides no discernible benefit to the other half. Again, by the time this study concluded, 50 percent of students had fully outsourced their homework to generative AI. For these students, when at home, they just stopped thinking about their schoolwork.

I hereby dub this the 50 Percent Problem. Unlike the Five Percent Problem, the 50 Percent Problem is a measure of harm stemming from widespread adoption of AI by students, rather than their failure to use this technology. It is my conservative estimate of how many students are being directly harmed by using these tools.1 As I’ve said repeatedly for several years, generative AI is a tool of cognitive automation. It’s both predictable and tragic that students are learning less because of it.

This new empirical research provides us with a clear measure of the degree of AI’s educational harm.


Let’s turn to the data itself. In what follows, we’ll be looking at the performance of three different groups of students across three different learning activities.

As to the students, we first have the baseline group of student results from the period prior to the introduction of generative AI—these students are labelled “Pre AI,” and charted in green. Next, we have the admirable group of students, all 19 percent of them, who did not use generative AI at any point between 2023 and June 2025 when the study concluded—these are labelled “Never AI,” and charted in blue. Finally, we have the remaining 81 percent of students who adopted AI and used it for their schoolwork—these are labelled “Used AI,” and charted in red. Of note, these students did not all start using AI at the same time, adoption phased in over time (which allowed the researchers to uncover some interesting things that we won’t go into here).2

As to the learning activities, we’ll start by looking at the amount of time that students spent on their homework; the researchers were able to track this because students had to log in online to download their homework and upload it upon completion. Then, we’ll look at how students scored on this same homework. Last but definitely not least, we’ll examine how student performance changed on monthly closed-book exams, as well as China’s very high-stakes high school and college entrance exams.

Both the underlying research paper and The Economist present a series of helpful data visualizations of this, but without the underlying raw numbers. So I contacted the researchers who conducted the study and David Strömberg (the lead author) graciously agreed to provide me with the underlying histogram data I used to create the three animated GIFs you’re about to see.

With that as backdrop, we can explore three specific questions.

1. What is the impact of AI on the amount of time that students spend on their homework?

The results here are unsurprising—AI significantly reduces the time students spend doing homework. On average, both the Pre AI and Never AI groups spent about an hour doing it, across a range of 50 to 80 minutes. In contrast, within the Used AI group, most students spent around 45 minutes, and some even cruised through in 25, presumably the minimum amount of time it takes to cut-and-paste answers out of a chatbot.

This is AI as tool of cognitive automation working exactly as intended.

2. What is the impact of AI on how students score on their homework?

Here again we see that Pre AI students and Never AI students have near-identical results, as we’d expect. But not so with the Used AI students—now, we see a huge shift to the right in purportedly “positive” outcomes, with scores far higher than even the most studious Never AI student managed to achieve. (Note the scores here were normalized to make the average score a 100 (not the maximum), so a score of 130 means “30 percent above the average,” essentially.)

To restate, the Used AI students studied less yet scored better than their peers. That’s a pretty sweet deal for them, but it’s worth reflecting on the broader implications of this within schools. When I talk to students about AI, one thing I hear them say frequently is that they don’t want to be played for chumps (my term, not theirs). Meaning, if they know their classmates are using AI and getting better grades as a result, even those inclined to resist AI may feel trapped into using it, just to keep pace.

It’s a cognitive race to the bottom.

I’ll also add that homework scores are obviously a very imperfect measure of student learning. In my view, a great deal of education research, and certainly the studies often promoted by ed-tech vendors, use comparable “point in time” data of supposed learning akin to what we see here. This is understandable, to a degree—it’s very difficult to information on long-term learning outcomes. But what ultimately matters in education is building durable student knowledge. The seductive danger of AI exposed here is that, by using AI, students may falsely have believed everything was proceeding swimmingly. In this sense, AI fosters a mental masquerade, scores go up as actual learning goes down.

Now to remove the mask.

3. What is the impact of AI on how students perform on closed-book exams?

Here is where the proverbial rubber meets the road.

Consistent with the two previous data sets, we again see near-perfect alignment between the Pre AI and Never AI students on the monthly closed-book exams administered to students. But now the adverse impact of AI is laid bare—just look at that shift to the left. The Used AI students are scoring at levels far lower than their Never AI peers, indeed, many score far lower than anything recorded prior to AI existing.

I’ve labeled this the Deadweight Learning Loss to underscore the volume of harm caused by the generative AI learning penalty. What’s we’re seeing here is unambiguous evidence of a decline in overall student performance that grew over time as students adopted AI. In fact, the average decline was 20 percent with a 1.4 standard deviation (SD). Although it’s far from an apples-to-apples comparison, this vastly exceeds the estimated learning loss in the US after the pandemic (approximately .25 SD in math and .13 SD in reading).

What’s more, over time this Deadweight Learning Loss had significant adverse consequences for students on the comprehensive high-stakes high school and college entrance exams that China administers to determine student placement.3 For students who adopted generative AI two or more years prior to being tested, the estimated negative effects are 24 percent (1.5 SD) for the high school exam, and 18 percent (1.3 SD) for the college exam.

If you are a parent with a child in junior high or high school who uses generative AI, this data should terrify you. This isn’t about academic integrity, it’s about a generation of kids being told AI is “inevitable” and “the future” and acting accordingly, in a societies where we’ve yet to develop firm norms about what’s acceptable to do with these tools within education. The upshot is that students are using AI in ways that are harming their cognitive development and foreclosing their life opportunities. Harms that are not easily remediated, if at all.

This is the 50 percent problem. Generative AI is cognitive cancer and we are doing next to nothing to stop it from spreading.


I’ll now address a few objections.

First, I want to credit The Economist for putting this research on my radar, and for raising broader attention to its harrowing findings. Yet, remarkably, in the brief article accompanying the research data we’ve just covered, the anonymous magazine author suggests that “AI can boost learning productivity but only for those who use the technology intelligently.”4 In similar fashion, Blake Richards, a researcher at Google who works “on the intersection of machine learning and neuroscience,” argued on social media that AI is not really the problem here, because “if you control for how long students spend studying, then students using AI actually perform equal or better” than those that did not.

Motivated reasoning is a powerful force. Here, of course, “controlling” for how long students spend studying erases the major findings of this research. But let’s leave that aside, and probe whether this argument can be justified on its own terms—does this study suggest that AI can boost learning if used “intelligently”?

As best I can tell, this claim is premised on this graph that correlates homework completion time with exam results:

If we ignore all that pesky data on the left side of this chart (which of course we shouldn’t), and just focus on the overlap between the Generative AI students who continued to study for the same duration as the No Generative AI students, it’s true there’s no major gap between them. Of course, note that there’s no discernible benefit to using AI either—apart that is from the spike at the very top end.

So what’s the deal with the spike? Might we cling to it as proof of the “promise” of AI? Well, here’s a good lesson on why one should always be careful eyeballing charts without access to the relevant underlying data, because when I asked Strömberg how many Used AI students persisted in studying for at least 75 minutes, he told me this (via email, with my emphasis):

It is very rare for students who have adopted AI to spend 75 minutes on homework. This occurs for only 20 students, and for each of them only in a single month (0.2% of AI student-month observations). More than five months after AI adoption, we never observe students spending 75 minutes on homework. In fact, in this group, only four students spend more than 65 minutes on homework.

Let’s get real. Given this study involved almost 27,000 students, indexing on this vanishingly small number of studious AI-using students isn’t just putting lipstick on a pig, it’s smearing its body in Revlon from snout to tail. We need to stop pretending there is some massive benefit to learning if only we trained kids properly on how to use AI. It’s fundamentally harmful.

A different and more sophisticated counterargument might proceed along the following lines: This study tracked student usage of AI stemming from its earliest days, when the tools were less capable than they are today. Perhaps relatedly, the researchers here found evidence that it was the early AI adopters most harmed by generative AI, insofar as “the estimated AI learning penalty fell from around 25 percent in early 2023 to around 16 percent by June 2025.” As such, perhaps this study constitutes the “high-water mark” of AI-induced harm, and perhaps the AI learning penalty will continue to drop. Or so we might hope, anyway.

But as the cliche goes, hope is not a strategy, and there are some problems with this counterclaim. For one thing, the rapid evolution of AI cuts both ways—we now have AI companies explicitly marketing “AI agents” to students to complete their tasks for them. Agents are even worse than chatbots from a cognitive development standpoint—at least the latter require an interaction of some sort to produce output. For another, even if the magnitude of the learning penalty continues to diminish, there’s a question of volume, too. Recall that 20 percent of students managed to resist using AI prior to June 2025. Do you think that number has gone up or down since then? I know my bet.

Finally, I can imagine someone saying I’m placing too much weight on this research—it’s just one study from China, after all. On that front, and as a self-sanity check, I asked three PhD education researchers to review the methodology employed, and all three came back with positive reviews (“it’s very good work,” said one). And China is surely the one country in the world that can match the US for AI adoption and enthusiasm, though it may surprise you to learn that AI companies in China disable their products completely during the high-stakes testing periods. (OpenAI, in revealing contrast, heavily promotes ChatGPT on college campuses during finals week in the US.)

Perhaps more importantly, if you are an AI-in-Education Enthusiast, I feel confident in saying that you will not be able to produce research of comparable rigor that shows positive long-term education impact of generative AI in real-world conditions comparable to those here. If there were such evidence, my inbox would be filled with people jamming it down my throat, trust me. And no, this single study from 2024 involving roughly 150 physics students at Harvard is not going to cut it, sorry.


The 50 Percent Problem will not disappear of its own accord. The Edu-Cognoscenti continues to chatter about learning loss related to school closures during the pandemic. Well, the learning loss stemming from generative AI appears more substantial, it’s happening right now, and it may endure for far longer. So to all the policymakers and philanthropists and so-called thought leaders who purport to take education evidence seriously, I ask you: What are you doing to prevent ongoing educational harms of generative AI? Are you doing anything at all?

We are in cognitive crisis.

I’ll close with this. As I was drafting this essay, my friend Dan Willingham published his perspective about when students should use AI. Please read it. Although he’s a tad more measured (or perhaps just realistic) about its role in education, his core contention echoes what I’ve been arguing for several years, and stems from a basic understanding of human cognition:

[T]he point of assignments is the mental processes required to complete them, and the point of the mental processes is learning. That seems to suggest a simple litmus test for the use of AI. Artificial Intelligence tools should not substitute for tasks wherein students would benefit from doing the mental work themselves. Only use AI for what you already know how to do.

A tool that should only be used once you already know something is not a learning tool. We must stop gesturing at AI’s imagined potential, and focus our efforts instead on mitigating the 50 Percent Problem it’s created.

How, you might reasonably ask? It won’t be easy. But I have some emerging ideas, stemming from recent investigations into communities of technological refusal. It’s been quite the learning journey. More soon.


My thanks to David Strömberg for providing his underlying data and to my anonymous academic friends who reviewed the study and this essay—all errors mine and mine alone, of course.

Subscribe now

1

In my view, 50 percent is a conservative estimate because the researchers themselves describe the core problem in more expansive terms: “The negative effects on learning outcomes appear to be mostly driven by the 81 percent of AI-using students, who spend less time on homework than even the fastest non-AI student, receive high homework scores matching the capability of generative AI tools they are using, and yet very low exam scores.” So I was tempted to call this the 81 Percent Problem, but as discussed above, not all of the 81 percent of AI-using students suffered the AI learning penalty (but nor did they gain any meaningful benefit). Ultimately, it’s the half of students using AI to complete their homework that I’m most worried about.

2

Alert, nerdy readers may be wondering why “student observations” is listed on the Y axis rather than just “students.” Answer: because the students groups were not static and evolved in composition as students adopted AI, the researchers used “student-month” as their unit of analysis, meaning, the data for students was parsed by month—e.g., a single individual student might produce 12 separate “observations” over a year within a single subject. I know, it’s wonky.

3

Of course, whether China or any other education system should employ high-stakes testing to this degree is a highly charged topic, but I’m not interested in having that conversation right now, please and thank you.

4

The Economist also cited this recent study involving the use of chatbots with roughly 200 undergraduates at Middlebury College, conducted over two sessions approximately one week apart. This is a perfect example of a point-in-time education study that bears no resemblance to the reality of how most students are actually using AI.

Read the whole story
mrmarchant
19 hours ago
reply
Share this story
Delete

Melon’s Odyssey On The Black Market For Life-Saving Cat Medicine

1 Share

For a month this spring, Melon was truly living up to her name. She had always been a round cat but never quite this gourd-like—small neck billowing out to a majestic corpulence. This sudden plump came with an attitude. She had abandoned her sweet old habits: sitting on the toilet seat to watch me shower, running back and forth across my apartment until she panted, and leaping on my back to scope out unreachable shelves. I chalked this up to the fact that Melon, now 4 years old, was growing up. Maybe our close bond, which had always felt ineffable to me in ways I cannot articulate without sounding like a TikTok cat mystic, was not actually special, but rather the relationship of a child who needed her parent until, one day, she didn't.

There were other warning signs. Melon had become less and less interested in eating. But she'd always been picky, and I had gone through some drastic life changes—a breakup that came with a division of our two cats—to which I assumed she was still adjusting. Her mane looked terrible, limp and stringy and unkempt, but Melon had never been fastidious about her personal grooming. She'd gotten her annual checkup a few months earlier and left with a clean bill of health. Besides, I was busy, distracted by said life changes and preparing for a vacation and a month off work to write a book. I dropped Melon off at my ex's place, splashed around in Puerto Rico, then came home and picked her up. Neither of us had any idea that anything was wrong. Later that week, my friend Elaine, a fellow cat freak, watched as Melon turned her nose up from a fresh can of wet food. "You know," she said, "we learned Hamlet had cancer when he stopped eating."

My mind began to spin. Hamlet was older when he got cancer, I told myself. Maybe her hunger strike was her acting out for me going on vacation. Friday night, Melon wobbled onto the bed with me and narrowed her eyes into slits. I lay down next to her and studied her face. I tossed, turned, and then spirited us to the emergency animal hospital, empty at 1 a.m. They whisked Melon to the back and I read a book, anticipating the relief I would feel when they would send us home soon with an expensive but clean bill of health. But then I finished my book, and started another. By 3 a.m., I had become too worried to read. I paced my waiting-room cell, decorated only with an ominous daguerreotype of a tuxedo cat.



Read the whole story
mrmarchant
23 hours ago
reply
Share this story
Delete

I made a hologram!

1 Share
I made a hologram!

Recently my family gave me a hologram-making kit that they found at an antique mall in Indiana. I was with them when they first spotted it among the alien masks and vintage comics, and when they pointed it out, my first thought was "yeah right there's no way that's real holograms" followed by "oh wow it looks like actual real holograms".

I made a hologram!
Despite how beat-up the box looks, it still had all its original parts and film, still in their original packaging.

As a laser scientist this was basically the perfect gift for me, and they sneaked back to the antique mall to pick it up. Fortunately for me, the antique mall hologram kit was not all that antique, just a few years old, and the film was still good. The company Litiholo in fact still makes these kits.

The kit included a red laser, and a bunch of plastic holders that pieced together to hold the film and the laser in the right positions. A little rectangle the size of a deck of cards indicated where I could put the 3D object that I wanted to turn into a hologram - they supplied some dice so my first hologram would be of something that would probably work. For example, they recommend not trying to make a hologram of plants because they move too much (!) during the five-minute exposures.

I made a hologram!

I've made holograms in the lab with fancy lasers and floating tables and climate-controlled rooms, so I took their instructions seriously when they told me to sit absolutely still and silent during the hologram exposures. The cats were not allowed in the room.

I made a hologram!
This is the setup for recording holograms. The laser is at the upper right and its film is at the lower left.

The key to the hologram setup is that half of the laser beam hits the film directly, while the other half bounces off the dice and then hits the film. When the two halves interfere with each other at the film, they embed the film with information about the shape of the light bouncing off the dice. Then, when I remove the dice, the film recreates what the dice was doing to its half of the laser beam, as if the dice were still there.

The result is a hologram that changes depending on what angle you look at it, just like you were looking around the edges and over the tops of the original dice. For this video I scooted the dice out from behind the film so now there's nothing back there at all.

You can really see that in this video of some cool calcite crystals; the camera swings up behind the film to show that the calcite isn't there anymore.

Obviously I haven't perfected the technique yet (maybe the film is a little old after all), but I'm having fun experimenting with making holograms. What thing (that's about the size of a deck of cards or smaller) would you want to see a hologram made out of?

Read the whole story
mrmarchant
23 hours ago
reply
Share this story
Delete

A Simplified Mental Model of LLMs

1 Share

Introduction

As of now (late 2026) LLM (large language model) technology providers, users, and work products flood the public commons. It therefore makes sense to have even a primitive mechanistic mental model of these technologies. You are forced to have an opinion. Without a mechanism or model one tends to fall into disempowering anthropomorphic language. Some clear thoughts on this can be found here and here.

In this note I would like to try and outline a (very) simplified mental model of LLM mechanics and mechanisms. By “mental model” I mean a cartoon to work through in your mind, not a model of the LLMs as having their own mind. I won’t be teaching the history of LLMs, how to build them, how to use them, or their moral or philosophic implications. I will only try to give a very rough outline how the current (2026) LLMs work.

The mental model I would like to bring you to is:

  • LLMs are implemented as a flow of numeric signals from a limited number of “attention heads” to output text.
  • LLMs are used to realize text transformation and text construction/fabrication. In particular they are approximate plausible “un-censoring” or “un-deletion” functions.

This note will try to make the above two points concrete and clear. After that I will use the model to drive some discussion/speculation.

Here is an example to explain the type of analogy I am hoping to deliver. A common useful mental model for an internal combustion engine car is: it combines air and fuel to produce motive torque, waste heat, and potentially toxic exhaust. This isn’t enough to build a car, but is enough to tell you not to idle one in an enclosed space.

Caveat

I am assuming the current private frontier LLMs are architecturally similar to GPT-4 (2023), but larger and with improvements. So this note is valid for at most such models.

LLM Implementation

Current LLMs take their form from many engineering decisions, three of the most important (in my opinion) being:

  • Large scale use of artificial “neural networks” (also called deep learning architecture or connectionist architecture). I am going to take the Bender/Inie advice and try to use the non-standard, but much less loaded, term “weighted network.”
  • Clever use of a “un-censor the missing word” training procedures (which led to useful tools such as embeddings).
  • Use of bookmark like structures called “attention.” The primitive components of a weighted network do not actually pay “attention” to anything. Instead they imply weights and selective routing of intermediate values. To not lose this distinction, I will use the term “attention heads” instead of “attention.”

We will describe each of these in turn.

Weighted networks

LLMs are implemented in terms of weighted networks. A weighted network is a representation of nested mathematical expressions or formulae, and not a faithful representation of biology. The earliest weighted networks took a number of input signals (say numbers, or voltages) and combined them into one or more output signals. We can imaging the mechanism as in the following diagram.



In this diagram each of the first three volt-meters (v1, v2, v3) represents input signal values, say the length, width, and height of a box. The three knobs (w1, w2, w3; called “weights” or “parameters”) represent how much of each input signal is passed along the arrows to the next node. The complicated vacuum tube amplifier represents a small function of the inputs: in this case 1/(1 + exp(w1 v1 + w2 v2 + w3 v3)). This weighted network converts 3 input values into one output value (itself represented by the last output meter). These nets are not usually realized using electrical components, but as software specifying calculations in GPUs, TPUs, or NPUs.

The knob settings are called the parameters or weights. The knob-settings are picked in a processed called “training” where we adjust the knobs until the weighted network’s outputs are very close to specified results for a great number of training examples. A training example is a pair of an input example (in this case 3 numbers) and the desired output (in this case one number). Even for very restricted topologies, training can be difficult. For the right choice of the weights (knob settings) this circuit may imitate enough of the example input/output pairs to approximate a useful function. However, researchers have been able to implement and train variations of these networks since the 1950s (ref). It is rumored to have cost around $100 million to train GPT-4 (ref). Current LLMs are much larger and more expensive than that.

The choice of the layout of the circuit is called the “topology” of the weighted network. Our small net’s topology has a feature typical to weighted networks: we can sort the nodes into layers and each layer only connects to later layers (never back or laterally). Our example weighted network consists of one node in one layer with 3 knobs or weights. GPT-4 (the state of the art back in 2023) was thought to have millions of input nodes, possibly billions of intermediate nodes, tens of thousands of output nodes, and about 1.8 trillion weights (knobs or parameters) arranged in possibly 120 layers (ref).

Some things to notice is: even a large weighted network is much weaker than a cheap computer.

  • It has no scratch-pad or short-term memory. When we change its inputs, its output changes independent of where the inputs used to be. Patterns from the training data determine the weights (or knob-settings), but once training is over the knobs are not moved again.
  • No outputs are routed back to earlier portions of the network. This means the calculation can not repeat or iterate steps.

One could implement variations that don’t have the above shortcomings (such as recurrent weighted networks, or trying online reinforcement learning ideas). However current LLMs are thought not to depend heavily on such techniques, as they make training much more expensive for little realized benefit. If a weighted network were modeling biology it would have to have features like the above (as biological neurons are not strictly in layers, and do seem to carry mutable state), but the current known engineering trade-offs are against such features so they tend not to be used.

Clever un-censor training

One hot encoding- the un-clever step

LLMs are demonstrated processing text, not values or numbers as our earlier weighted network did. Researchers adapt weighted networks to text with a very brutal idea called “one hot encoding.” Let’s approach this using an example.

Suppose we with to build a weighted network that works over 9 word utterances from a dictionary of 14 words or tokens. One such utterance is “the quick brown fox jumped over the lazy dog.” To build our adapted net we would build a 9 row (one row for each word in our utterance) by 14 column (one column for each work in our dictionary) paddle-switch array that applies +10 volts where a switch is on and 0 volts where off such as the following.

a

brown

dog

dug

earnest

fox

jumped

lazy

over

quick

red

slow

the

under

the a brown dog dug earnest fox jumped lazy over quick red slow the under
quick a brown dog dug earnest fox jumped lazy over quick red slow the under
brown a brown dog dug earnest fox jumped lazy over quick red slow the under
fox a brown dog dug earnest fox jumped lazy over quick red slow the under
jumped a brown dog dug earnest fox jumped lazy over quick red slow the under
over a brown dog dug earnest fox jumped lazy over quick red slow the under
the a brown dog dug earnest fox jumped lazy over quick red slow the under
lazy a brown dog dug earnest fox jumped lazy over quick red slow the under
dog a brown dog dug earnest fox jumped lazy over quick red slow the under

The voltages from these switches feeds a larger weighted network with many knobs, nodes, and layers. Most of the above cells are switches in the down position. In each row the single switch in the up position is the word the row represents. The property of having one switch on in each row is where the name “one hot encoding” comes from. Current LLMs have an input switch array representing thousands of words over a dictionary of tens of thousands of tokens.

The above representation is a minimal idea that works. It is incredibly inefficient- taking tens of thousands of input switches (or voltages) to represent a single word. It is fairly rigid as the exact positions of the switches are used to encode the words, disallowing ideas such as using different sets of switches for different regions of the input document. And it understands nothing: two rows are either identical (have the same switch up) or disagree in exactly two columns (there is at this point no notion of similarity or synonyms).

Clever un-censorship

Now we are ready for the clever bit. I first saw this in an important research paper introducing a neat text embedding (defined later) called word2vec. The clever idea is the following.

Take our switch array and turn off all of the switches in one row. In this case we have suppressed the fourth row which used to encode “fox.” We wil treat the voltages implied by the new switch array as a single training input.

a

brown

dog

dug

earnest

fox

jumped

lazy

over

quick

red

slow

the

under

the a brown dog dug earnest fox jumped lazy over quick red slow the under
quick a brown dog dug earnest fox jumped lazy over quick red slow the under
brown a brown dog dug earnest fox jumped lazy over quick red slow the under
? a brown dog dug earnest fox jumped lazy over quick red slow the under
jumped a brown dog dug earnest fox jumped lazy over quick red slow the under
over a brown dog dug earnest fox jumped lazy over quick red slow the under
the a brown dog dug earnest fox jumped lazy over quick red slow the under
lazy a brown dog dug earnest fox jumped lazy over quick red slow the under
dog a brown dog dug earnest fox jumped lazy over quick red slow the under

The weighted network will produce an output of meter readings as a function of the input (given above) and the positions of the weight/parameter knots. Here is one possible output.

a

brown

dog

dug

earnest

fox

jumped

lazy

over

quick

red

slow

the

under

a brown dog dug earnest fox jumped lazy over quick red slow the under

Now we construct a single row switch array encoding the missing word (in this case “fox”). Treat the voltages from this switch array as the desired training output.

a

brown

dog

dug

earnest

fox

jumped

lazy

over

quick

red

slow

the

under

a brown dog dug earnest fox jumped lazy over quick red slow the under

Training is just jittering the weight/parameter knobs a small bit so that the result meter needles for this input are closer to zero in the wrong words (down switch positions) and 10 volts in the target word (up switch position). The more serious term for this is stochastic gradient descent. What is amazing is small improvements can accumulate, instead of canceling each other out as we move from training example to example. The training procedure embodies the lesson of the LLM methodology: harvest an unreasonable number of small improvements to yield an approximation of a seemingly impossible desired outcome.

This one sentence could in fact give us 9 training examples- as we cycle through which word-position we wish to un-censor. We use these training examples and many others to train up a weighted network that simulates un-censoring a single word out of sentences! Obviously the simulation can’t be perfect (censorship loses information), but the weighted network settings route signal to plausible replacement word positions. Training is about appropriateness (using only sensible utterances as training data, so there are word relations to learn) and scale (having a lot of training data, for commercial LLMs: most of the web, must help/discussion forums, most social media, most books and periodicals, most technical and scientific papers).

After training is finished we use the weighted network as before on inputs. However we decode these outputs by picking a highest indicating meter as the plausible answer (in this case the 6th meter, which is +10v at “fox”) and get the following one-hot style result.

a

brown

dog

dug

earnest

fox

jumped

lazy

over

quick

red

slow

the

under

a brown dog dug earnest fox jumped lazy over quick red slow the under

Note: the word2vec paper popularized an additional concept of a semantic embedding. One of the layers of the word2vec weighted network was restricted to be only 300 nodes, much smaller than the input or output layers. This “constriction” layer tends to result in trained networks where similar meaning words yield similar voltage patters at the intermediate layer (and different meaning words induce very different voltage patterns). This is in contrast to the original one-hot encoding where different words always disagree in exactly two positions (so there is no useful notion of similar or dissimilar). Embeddings went on to be a core idea and produce additional products such as semantic databases.

The clever training method has given us a new encoding of words- where words that can be used in similar places tend to get similar numeric representations. We are now ready for the last of the big ideas: attention heads.

Attention heads

In my opinion the final component that explains current LLM performance is “attention”, a term defined in the paper “Attention is All You Need.” Attention is a bit anthropomorphic, so I will call them attention heads; think of them as signal routers, position pointers, or text bookmarks.

Current LLMs treat all of your input instructions, the input text, and currently generated output text as encoded inputs as we described above. At first there is no output, so only the system prompts and user inputs are encoded. Then highest LLM-scored word is chosen as the next output word. This process is then repeated by the LLM operator to generate the output text one word at a time in order. By our analogy we are pretending there is a pre-existing plausible output but it has been censored or hidden and the LLM operator is un-censoring an approximation of the output one word at a time. This repetition isn’t part of the LLM, it is supplied by the operator serving the LLM results.

“Attention heads” are just bookmarks that point to positions in the input (and also partially generated output) and also to earlier sections of the weighted network. The positions of the heads are a function of the inputs, so they can appear to move between re-applications of the LLM. This allows effects such as generating words or tokens to complete a sentence (by having a head point into the uncompleted sentence until an ending token is generated), starting or stopping a paragraph, using the same name, and many other seemingly meaningful long-range text interactions. It even can allow semantic effects such as making a point only once, by not pointing the attention head at a given input question if there is what appears to be a related answer already in the partial output. This is likely why LLMs appear to follow instructions- they leave attention heads in the instruction region of the text input.

It is likely the amount of training material and training time is rises very fast in the number of attention heads (probably even exponentially fast). So attention heads are likely expensive even for the rich. I believe they will be a limiting feature of LLM output for a while.

Conclusions/Speculation

I hope you now can envision LLMs as transformations on text realized as a very brutal encoding of input and partial-output text into a flow of numeric signals. The LLM server iterates a “plausible next word” process to generate a sequence of output tokens, as the LLM itself doesn’t implement repetition or iteration. The bookmarks or attention heads help prevent this process from drifting too fast to text unrelated to the original inputs.

I believe features of LLM text (good, bad, and amazing) can be explained in terms of word clustering, approximate un-censorship, and bookmarks. That is we are not forced to explain observed texts in terms of goals, desire, intent, and memory.

LLMs are largely a triumph of scale (size of net, number of knobs/parameters, size and diversity of training data). The LLM weighted networks are of previously unimaginable size. The LLM training corpus can be effectively many times larger than the sum of all written text, as the un-censor training procedure can build many examples from a given text. And LLMs can show amazing results on tasks that don’t need too many attention heads such as specializing or translating a description of a mathematical or engineering technique from the LLM training data into a specific problem application at query time. However, current LLMs have poor performance on seemingly simple tasks that burn attention heads: such as my example of failing at uniquely sorting words.

Unless you are taking the trouble to run a local model, you never directly observe LLM behavior independent of the infrastructure and staff of the service provider. It is hard to tell what is LLM behavior, and what is cached-results or additional custom tools or services. For example LLMs themselves can’t repeat or iterate, however LLM service results are usually the result of iterating “generate next plausible word.” What one is seeing is the result of the LLM plus the service stack.

I’d invite you to try to apply the above (simplified, so not fully realistic) model of LLMs to try and think on a number of scenarios. What are your opinions on the likely outcomes and results of the following thought experiments>

  • We take a known mathematical fact (say the Pythagorean theorem), and ask the LLM for a proof.
  • We take a pre-existing published math paper, present the first half to the LLM and ask that it complete the paper.
  • We take a pre-existing published empirical chemistry paper (concentrating on lab work and results), present the first half to the LLM and ask that it complete the paper.
  • We take a new non-published empirical chemistry paper (concentrating on lab work and results), present the first half to the LLM and ask that it complete the paper.

Your answer to the last should vary depending if you treat the LLM as an approximate text processor, or as having a tiny chemist and lab trapped somewhere in its clockworks.

Appendices

GPT-4

GPT-4 is partially documented here. In particular (quotes from article):

  • “Transformer-based model pre-trained to predict the next token in a document.”
  • “GPT models are often trained in two stages. First, they are trained, using a large dataset of text from the Internet, to predict the next word. The models are then fine-tuned with additional data, using an algorithm called reinforcement learning from human feedback (RLHF), to produce outputs that are preferred by human labelers.”

Note we don’t comment on the full complexity of transformers, just the attention head feature.

On Hallucination

From the GPT-4 Technical Report.

GPT-4 has the tendency to “hallucinate,” i.e. “produce content that is nonsensical or untruthful in relation to certain sources.”

I think of this as anthropomorphizing, but the online dictionaries don’t seem to support me:

hallucinate (third-person singular simple present hallucinates, present participle hallucinating, simple past and past participle hallucinated)

  • (ambitransitive) To seem to perceive things (with one or more of one’s senses) which are not really present; to have visions; to experience a hallucination.
    Synonyms: imagine, see things
  • (artificial intelligence, of a model) To produce information that is not supported by the model’s training data.

Joking aside: for a non-technical audience “hallucinate” evokes perception and mental state, not a mismatch from training data. The LLM output was always a construct or fabrication, even when it matches the truth.

On Recursive Self-Improvement

Investors have been hoping for recursive self-improvement where it turns out one of the things LLMs are good at is suggesting game changing improvements to LLMs (and then trigger some sort of technological singularity). Things are in fact moving very fast in the LLM space. So there are some issues in working out if unfounded confident-sounding advice from an LLM is the best steering for a long and expensive training cycle. Optimizing in the presence of delayed feedback is notoriously treacherous.

Note on Experiments

Note both the word2vec and attention papers are very good experiments in that they deliberately use overly simplified complementary tools and procedures to show the claimed positive effects are from the claimed technology. So not only are the results reproducible, one can do better by swapping in better complementary tools (such as tokenizers, embedding choices, and so on).

Things LLMs should be bad at

Under our mental model LLMs should produce bad results when there is a dominant plausible wrong answer and when there are many relations between bits of the answer to maintain. The ideas being if no answer is plausible the LLM result will likely be equivocal and unconvincing. When there are a lot of relations to maintain in the answer (such as puzzle conditions) then attention heads are used up mapping marking relations between parts of the answer text, moving them off relations to the input text and so-called instructions and question. Another attack is to have an input text that superficially looks like a common puzzle, this way the LLM output tends to be aligned to the related answer.

Some failing examples include:

  • Failing to uniquely sort words. This is exploiting the presumably limited number of attention heads.
  • Failing on the “surprise the doctor is your Mother, not a man!” puzzle. This is the result essentially being a copy of the answer to a similar puzzle, not the one asked. Note the claimed “reasoning” is better described as “initial tokens.” Notice the so-called reason trace does start with text close to the question and with text at the correct answer, however it is full of weird non-sequitur stops and starts. It is text that plausibly looks like reasoning, probably not reasoning. The ideas of additional state heads and state-reprocessing are in fact good, they just do not necessarily work in the way the author or even I think.
  • The “should I walk to the carwash” example. Trick questions often exploit missing context or corner-cases of reasoning. This is not in fact a trick question: for a human going to the car wash almost implies it is to get the car washed. Yes it could be to buy an air-freshener or pick up an already committed car, but those are the exceptional cases. That the LLM suggesting walking is evidence against it using non-textual semantics.

The question isn’t: can we make silly examples LLMs get wrong. It is: are the equivalents of these problems lurking in our important project we delegated to the LLMs?

Image credits

https://commons.wikimedia.org/wiki/File:Mcintosh_MC275_european_version.jpg#/media/File:Mcintosh-MC275-glow.jpg ,
https://hackaday.com/wp-content/uploads/2022/09/AMSAI.png , and the author.

Read the whole story
mrmarchant
23 hours ago
reply
Share this story
Delete
Next Page of Stories