It used to be enough to mention AI on an earnings call for Wall Street to celebrate. But a more discerning reality is setting in.
Grand ambitions of AI technologies are propped up by gargantuan costs — from extreme demands on natural resources to immense hardware investments. Big Tech’s enormous valuations seem less justified, butting up against the improbable state of affairs in AI development.
Now earnings season is coming, and AI is once again driving a handful of mega stocks. But the latest wave of skepticism suggests the hyped-up returns may never arrive.
The web’s collection of content — the material that inspires advanced models to generate contrived images or churn out convincing LinkedIn posts — is itself a finite resource. Even the vastness of the internet ends somewhere.
That’s triggered a mad dash among AI companies to seek more content: pilfer copyrighted works, transmogrify videos into text, or even use AI-generated material as training data for AI systems.
But relying on synthetic data degrades the quality and reliability of AI models, as research has shown. That highlights a major limitation in the promise of advanced AI.
Researchers at Rice University likened the danger of training generative models on synthetic material to “feeding cattle with the remains (including brains) of other cattle”, crafting an AI training analogy to mad cow disease.
The explosion in AI tools has already littered the web with synthetic content, which continues to make up a greater and greater share of the internet. You’ve probably already noticed it gaming search engine results — authorless, synthetic, and, in the end, useless articles that get your click and brief attention as you search for trustworthy, human information.
This, of course, means that existing AI systems have already ingested their own results.
“It really is about brains corrupting future brains,” said Richard Baraniuk, professor of electrical and computer engineering at Rice University, who co-authored the paper.
Other drags on the AI dream are closer to home.
Tech companies are scrambling to reduce their dependence on outside suppliers of AI chips, pouring billions into hardware and infrastructure. Google (GOOG, GOOGL) and Meta (META) unveiled new homegrown chips this week, flashing their costly commitments.
The investments are tickets to prosperity in the AI-led future. But the spending — like the warnings over data and resources — will bring them closer to having to prove it.