The world is not a database
One of the most important pieces of AI commentary: "software brain" is important to understand if we want to get through this era with our humanity intact.
Link: The People Do Not Yearn For Automation, by Nilay Patel in The Verge
This piece is important to internalize — particularly for the terminally AI-pilled and people who might want to force everyone into using LLMs to do work they were previously doing themselves.
AI is incredibly unpopular, and it’s not because it’s bad at marketing. These are multi billion dollar companies that have attracted some of the brightest talent from across Silicon Valley across all disciplines. AI vendors are not underdogs who just need to get their message across.
Indeed:
“You can’t advertise people out of reacting to their own experiences. This is a fundamental disconnect between how tech people with software brains see the world and how regular people are living their lives.”
“Software brain” is a fantastic name for a worldview that sees everything as databases that can be controlled, normalized, and optimized. As Nilay Patel puts it: “the idea that we can force the real world to act like a computer and then have AI issue that computer instructions.” This is not a new problem that has arrived with AI: we’ve been talking about people who were very good at making software who therefore thought they were geniuses who could take on any global challenge for a very long time.
Taking human experience, which is beautifully ambiguous and nuanced and nondeterministic, and trying to fit it into a database shape, is inherently extractive. Nilay points out that it flattens people, which is totally true, but it also transfers ownership of that experience from their subjective truth into a centralized database that someone else controls, sets the standards for, and profits from.
And yes: computers should support people. People shouldn’t support computers. The idea that we’ll all be left behind if we don’t pour our experiences, information, source material, communications, creativity, and all the rest of it into a computer system is absurd and offensive. By extracting that experience, flattening it, and changing ownership of it, it inherently devalues us, the humans who were its previous custodians. It certainly devalues labor, which is a problem in itself, but it also devalues all of the frictionful, living, breathing parts of being an actual human being.
The tools are useful. I think software development has probably changed forever. But they’re not useful for everything, and they’re not going to change everything. Everything isn’t a database. And if we think the world becomes better if we turn everything into one, we probably weren’t all that excited about humanity to begin with.
