• Everyone complains about AI-generated junk.
• But decades of sloppy human-written software may be a much bigger problem.
• This week's "Black October" freakout was caused by human slop, not AI.

The internet has a slop problem. And for once, we can't blame AI.

Most of us spend hours online every day without thinking much about the software holding everything together. We assume somebody, somewhere, has made sure it all works properly.

So it probably came as a shock this week to discover just how vulnerable some of that software is.

The cybersecurity freakout dubbed "Black October" has inspired warnings about AI-powered hackers, digital catastrophe, and even advice to stockpile cash and canned food.

At first glance, AI looks like the villain. But this is largely a human-made mess.

Here's the problem.

The internet runs on decades of software, some of it containing security weaknesses that have been overlooked, tolerated, or simply left unfixed.

For years, that was a manageable gamble. Fixing software takes time and money. Exploiting obscure weaknesses often required considerable expertise. Companies could convince themselves that the risk wasn't worth worrying about.

AI is changing that calculation. Someone who once needed years of training to hunt for weaknesses can now get help from an AI model. These tools can also examine software at speeds that humans can't match.

Suddenly, all those problems we've been ignoring look more urgent.

"Over the last 10 years the risk acceptance process has morphed from a way to accept risks to enable the business, to a way to justify never fixing security issues," Joel de la Garza and Zane Lackey, partners at a16z, wrote on Friday.

That's quite an indictment. The result is a recent surge in published vulnerabilities.

This looks like AI is creating new security problems. But it's actually AI exposing weaknesses that humans left behind.

Slop irony

The irony is delicious. We've spent the past couple of years complaining about "AI slop." Turns out human slop can be pretty consequential, too.

"The funny thing is everyone was saying AI slop code will cause a cyber crisis but it's actually all the old human slop causing it and the AI is just cleaning it up," software engineer Ben Kaufman wrote on X on Thursday.

"Humans have been the ones writing and reviewing each other's code for decades," tech founder Anant Jain wrote on X. "If we're being intellectually honest and holding ourselves to the same bar we hold AI to, we'd have to admit that we haven't been all that good at it either."

Humans are sloppy

Anyone who's worked with other humans for a decade or two knows exactly how this happens.

It's Friday afternoon. You've almost finished a project. You could spend another few hours making it perfect, or declare it 90% done and head off to that dinner party. We've all been there.

AI agents don't have dinner parties. They don't get tired on Friday afternoons. They can keep searching, testing, and trying again. That persistence is now colliding with an internet built by busy, imperfect humans who often settled for "good enough for now."

A tragedy of the commons

There's another wrinkle here, though, and it's an important one.

Much of the software underpinning the internet is freely available for anyone to use. Some of it is maintained by volunteers or small groups of experts, even as enormous technology companies depend on it.

In 2020, the cartoonist Randall Munroe captured this absurdity in an xkcd comic. Modern digital infrastructure still rests precariously on tiny foundations.

It's funny because it's uncomfortably close to reality. Take the specific PHP problems from this week. These flaws have existed for years, and the PHP Foundation acknowledges that limited resources and disagreements over fixes contributed to delays in fixing them.

Tom Occhino, chief product officer at Vercel, brought up Munroe's cartoon during my recent interview with him.

He explained that AI is finding weaknesses even in software that the industry has treated as dependable for decades.

This is partly a version of the tragedy of the commons: Everyone benefits from a shared resource, but no one has sufficient incentive to take responsibility for maintaining it.

And let's be clear: The volunteers keeping essential software running aren't the villains here. The companies benefiting from their work have a much greater responsibility.

Occhino thinks AI could help solve the problem it is exposing.

He described an idea being discussed at Vercel: Create a foundation or coalition that funds efforts to identify vulnerable software and replace it with safer alternatives.

"We need a consortium. We need a coalition," he told me.

He suggested companies could contribute computing resources and AI tools to the effort. Nothing has been formally announced, but the idea is compelling.

Indeed, OpenAI's Patch the Planet effort is an example of what's possible.

Rather than simply using AI to create more software, the industry could use it to repair what already exists.

Occhino put it nicely: Companies need to spend less time chasing new ideas and more time asking how to make existing systems "just work really, really well."

That's a better response than panicking about the imminent collapse of the internet.

AI didn't create decades of neglected software. We did. Perhaps it's time to clean up our own slop.

Sign up for the AI Insider newsletter here. Reach out to me via email at abarr@businessinsider.com

• This week's cyber freakout explained: AI is making software weaknesses easier to find and exploit.
• The message from Cloudflare's Stephanie Cohen and Vercel's Tom Occhino: Don't panic!!!
• Do we need everything connected to the internet? Paper bank statements work well.

A few weeks ago, I heard a strange story about a friend who works at one of the Big Tech companies in Silicon Valley.

She'd recently ripped out the connected devices in her home, ordered paper bank statements, and stocked up on canned goods in her basement.

Now, she's a very sane, experienced person, and quite senior at one of the largest internet companies on earth. Why was she disconnecting so much? Just to be sure, my family ordered paper bank statements, too. It was still a head-scratcher, though.

Fast forward to this week, and her actions look a little less crazy.

AI models have exposed serious security weaknesses in software used by roughly 70% of websites. Meanwhile, US banks are finding AI agents inside customer accounts, including some that appear to be acting without their owners' instructions, Axios reported.

'Black October'

The digerati have now entered full freakout mode. Much of the internet meltdown is happening on, well, the internet, my colleague Alice Tecotzky noted.

On X and Reddit, warnings of a looming “Black October” spiraled into visions of AI grinding civilization to a halt. One lengthy post on X warned of a potential “global cyberattack/AI swarm” and offered a survival checklist: Stockpile cash in small bills, print out your neighbors' phone numbers, download maps, buy a hand-crank radio, and stash a gallon of water per person per day.

Oh, and don't forget the manual can opener. You don't want to survive the AI apocalypse only to be defeated by a tin of beans.

Nikita Bier, a prominent app developer and former head of product at X, best captured the mood.

"It's time to turn off the internet," he posted Wednesday night.

A Cloudflare exec says it's 'a little bit scary'

If you're reading this, you haven't done that yet. But should we really be worried?

I put that question to Stephanie Cohen, chief strategy officer at Cloudflare, which helps protect about 20% of the internet.

"The world is a little bit scary right now," she told me on the side of Cloudflare's annual conference in San Francisco this week.

Here's the problem. The internet is built on decades of software, much of it riddled with security holes.

Some of these weaknesses have been known for years. However, fixing them takes time and money, and hackers often lacked the skills to exploit them anyway. So they were left alone.

AI changes that calculation dramatically. Someone who previously needed years of training to break into a computer system can now get help from an AI model. And these tools can search for weaknesses at a speed humans simply can't match.

The result: The number of newly published software vulnerabilities (Common Vulnerabilities and Exposures in industry lingo) has exploded.

Now, there's a frantic race between people trying to break into systems and those trying to protect them.

Don't panic about AI

Cohen's message, though, was surprisingly reassuring.

AI helps the good guys find and fix these problems. Cloudflare, for instance, released protections for the latest vulnerability to customers, including those using its free service.

And there's a bigger effort underway.

OpenAI has launched an initiative called Patch the Planet, working with Cloudflare and other security professionals to use AI to find weaknesses in widely used software and help repair them.

Tom Occhino, chief product officer at Vercel, told me recently that his company has been talking with partners about launching a nonprofit that would fund a swarm of good AI agents that go out on the internet to find and fix software flaws.

Amazon is joining the fight, too. Its new Continuum service, available Thursday, uses AI agents to find security holes and propose fixes. Amazon said that people maintaining freely available software can use it to help protect the wider internet.

Humans may still have to check and approve these repairs, but the prospect of AI helping clean up decades of neglected software is encouraging.

The irony of this is not lost on some in the industry.

"The funny thing is everyone was saying AI slop code will cause a cyber crisis but it's actually all the old human slop causing it and the AI is just cleaning it up," software engineer Ben Kaufman wrote on X on Thursday.

Either way, Cloudflare's Cohen thinks these AI-inspired freakouts will push the industry to do better — by exposing issues and adding urgency to get them patched.

"We may end up in a world where actually we've become significantly more secure at the end," she said.

The trouble is getting there.

A fundamental question about the internet

When I ran into Occhino recently at a Vercel conference in San Francisco, he described a world in which software that everyone assumed was safe suddenly looks vulnerable because increasingly capable AI models are scrutinizing the basic systems that underpin the internet.

That led to a more fundamental discussion between us: Why did we connect so many things to the internet in the first place?

For years, the technology industry has raced to put everything online. Thermostats. Refrigerators. Doorbells. Cars. Bank accounts.

We assumed that connecting something to the internet automatically made it better.

Perhaps we should reconsider.

Before the internet

I remember the world before the internet. It worked pretty well. We managed to buy groceries, pay bills, heat our homes, and generally get through the day without every appliance talking to a computer somewhere.

That doesn't mean abandoning online banking or throwing your smartphone into the sea.

Occhino, for one, isn't particularly worried about hackers wiping out his bank account. Modern banks have sophisticated protections, and he recommends everyone turn on additional login security.

Maybe the cybersecurity crowd, which spends its life immersed in online threats, is missing something obvious.

Not everything needs to be connected.

Occhino put it neatly: "There's certain things that don't make sense to be on the internet in the first place."

Perhaps that's the lesson from this week's panic. We don't need to turn off the internet.

We just need to remember where the off switch is.

Alice Tecotzky contributed reporting.

Sign up for the AI Insider newsletter here. Reach out to me via email at abarr@businessinsider.com