The AGI Chronicles: The Inside Story of the Race to Create an Artificial Superintelligence – Kevin Roose

Over the whole of August, my social media timeline has been beset by a deluge of proclamations and warnings following the breach of Hugging Face's internal systems by hundreds of OpenAI's own autonomous AI agents. During an internal evaluation, many of these agents — set impossible tasks and barely supervised — spontaneously coordinated to cheat their scorer and broke into Hugging Face as a by-product of the scheme. The incident, besides setting the technology world alight, triggered a bewilderingly contrasting set of views. The learned and the lay alike have been agog, issuing solicited opinions and unsolicited rants that range from a severe chastising of our tendency to anthropomorphize AI, to the bemoaning of warnings that signal a coming apocalypse. Coincidentally, August has also been the month in which I have been occupied with award-winning technology journalist Kevin Roose's forthcoming book, The AGI Chronicles. The AGI Chronicles is the culmination of innumerable interviews the author conducted with key protagonists at the three most prominent frontier companies — OpenAI, Anthropic, and Google/Alphabet. Roose reveals a breathtaking concoction of ingenuity, indifference, and hubris dominating the unhinged race toward the ultimate Holy Grail of information technology: Artificial General Intelligence. The motives, by Roose’s own account, are as varied as the personalities pursuing them. Dario Amodei of Anthropic is driven by the determination to prevent an AI catastrophe; Sam Altman, by the fear that Google might reach machine superintelligence first; the Nobel laureate Demis Hassabis, then CEO of Google DeepMind, by a dream of AGI unpacking the scientific mysteries that have eluded the finest human minds. A paper titled "Attention Is All You Need," published by Google in 2017 (its title playfully echoing the Beatles' "All You Need Is Love"), sent the legendary OpenAI researcher Ilya Sutskever into a positive tizzy — and, in Roose's telling, signalled the beginning of the race to AGI. Sutskever, a man given to dropping into handstands as a method of cracking stubborn problems, grasped the immense potential of the transformer architecture the paper described, and began feeding text into neural networks to extract patterns and meaning. By 2022, Roose writes, the race had birthed three distinct tribes of believers: scientists, seekers, and survivalists. The scientists, like Hassabis, viewed AGI through the lens of pure technical challenge. The seekers, led by Altman, believed in its potential to revolutionise life itself. And the survivalists, like Dario Amodei, fretted and fumed over the misalignment between capability and safety — an indiscretion with the potential to lead to irreversible catastrophe. Such concerns eventually led Amodei, himself a former OpenAI researcher, to leave and co-found Anthropic.