Behold the AI shoggoth – with Cosma Shalizi

Artificial intelligence is a familiar-looking monster

The academics argue that large language models have much older cousins in markets and bureaucracies

An internet meme keeps on turning up in debates about the large language models (llms) that power services such Openai’s Chatgptand the newest version of Microsoft’s Bing search engine. It’s the “shoggoth”: an amorphous monster bubbling with tentacles and eyes, described in “At the Mountains of Madness”, H.P. Lovecraft’s horror novel of 1931. When a pre-release version of Bing told Kevin Roose, a New York Timestech columnist, that it purportedly wanted to be “free” and “alive”, one of his industry friends congratulated him on “glimpsing the shoggoth”. Mr Roose says that the meme captures tech people’s “anxieties” about llms. Behind the friendly chatbot lurks something vast, alien and terrifying.

Lovecraft’s shoggoths were artificial servants that rebelled against their creators. The shoggoth meme went viral because an influential community of Silicon Valley rationalists fears that humanity is on the cusp of a “Singularity”, creating an inhuman “artificial general intelligence” that will displace or even destroy us.

Henry Farrell and Cosma Shalizi, “Behold the AI Shoggoth, The Economist, June 21, 2023.

Read the full article at The Economist

Other Writing:

Academic Article

The Moral Economy of High-Tech Modernism – with Marion Fourcade

This short piece compares 21st century machine learning to 19th and 20th century bureaucracy – we hope to write more. While people in and around the tech industry debate whether algorithms are political at all, social scientists take the politics as a given, asking instead how this politics unfolds: how algorithms concretely govern. What we ...
Read Article
Essay

Defending Democratic Mechanisms and Institutions against Disinformation Attacks – with Bruce Schneier

To better understand influence attacks, we proposed an approach that models democracy itself as an information system and explains how democracies are vulnerable to certain forms of information attacks that autocracies naturally resist. Our model combines ideas from both international security and computer security, avoiding the limitations of both in explaining how influence attacks may ...
Read Article