Tag Archives: ai

Neurons And Intelligence: A Birdbrained Perspective

Elephants have bigger brains than humans, so why aren’t they smarter than we are? The classic answer has been to play down absolute brain size in favor of brain size relative to body. Sometimes people justify this as “it takes … Continue reading

Posted in Uncategorized | Tagged , | 139 Comments

Gwern’s AI-Generated Poetry

Gwern has answered my prayers and taught GPT-2 poetry. GPT-2 is the language processing system that OpenAI announced a few weeks ago. They are keeping the full version secret, but have released a smaller prototype version. Gwern retrained it on … Continue reading

Posted in Uncategorized | Tagged , | 186 Comments

My Plagiarism

I was going back over yesterday’s post, and something sounded familiar about this paragraph: A very careless plagiarist takes someone else’s work and copies it verbatim: “The mitochondria is the powerhouse of the cell”. A more careful plagiarist takes the … Continue reading

Posted in Uncategorized | Tagged | 55 Comments

GPT-2 As Step Toward General Intelligence

A machine learning researcher writes me in response to yesterday’s post, saying: I still think GPT-2 is a brute-force statistical pattern matcher which blends up the internet and gives you back a slightly unappetizing slurry of it when asked. I … Continue reading

Posted in Uncategorized | Tagged | 262 Comments

Do Neural Nets Dream Of Electric Hobbits?

Last week OpenAI announced its latest breakthrough. GPT-2 is a language model that can write essays to a prompt, answer questions, and summarize longer works. For example (bold prompt is human-written, all other text is the machine-generated response): Prompt: For … Continue reading

Posted in Uncategorized | Tagged | 189 Comments

Technological Unemployment: Much More Than You Wanted To Know

[I am not an economist or an expert on this topic. This is my attempt to figure out what economists and experts think so I can understand the issue, and I’m writing it down to speed your going through the … Continue reading

Maybe The Real Superintelligent AI Is Extremely Smart Computers

I. By Ted Chiang, on Buzzfeed: The Real Danger To Civilization Isn’t AI: It’s Runaway Capitalism. Chiang’s science fiction is great and I highly recommend it. This article, not so much. The gist seems to be: hypothetical superintelligent AIs sound … Continue reading

Posted in Uncategorized | Tagged , | 363 Comments

Where The Falling Einstein Meets The Rising Mouse

Eliezer Yudkowsky argues that forecasters err in expecting artificial intelligence progress to look like this: …when in fact it will probably look like this: That is, we naturally think there’s a pretty big intellectual difference between mice and chimps, and … Continue reading

Posted in Uncategorized | Tagged , | 278 Comments

Two Kinds Of Caution

Financial Times: What We Get Wrong About Technology. It cites boring advances like barbed wire and shipping containers to argue that some of the most transformative inventions are not the product of complicated high technology but just some clever hacks … Continue reading

Posted in Uncategorized | Tagged | 394 Comments

SSC Journal Club: AI Timelines

I. A few years ago, Muller and Bostrom et al surveyed AI researchers to assess their opinion on AI progress and superintelligence. Since then, deep learning took off, AlphaGo beat human Go champions, and the field has generally progressed. I’ve … Continue reading

Posted in Uncategorized | Tagged , | 286 Comments