Seventy years to get here
AI looks like it suddenly got good. It's actually a very old story. Along the way people announced "we've basically done it" several times, and several times they were wrong.
The fastest way to see how wrong is to look. Every card below is a prediction someone really made. Read the front and decide whether it came true.
They missed in both directions
How many did you call right? The number to look at isn't your score — it's which way each one missed.
Three said it would happen too soon. Twenty years. Two months over a summer. Any moment now.
Two said it would never happen. A hundred years for Go. No chess-only machine could do it.
Clever people missed in both directions. And every time they missed, people got disappointed and the money and attention drained away. That happened twice.
So why did it suddenly get good?
Here's where most people guess wrong. They assume somebody had a brilliant new idea.
Most of the ideas are old.
The matchbox learning machine you'll meet in Part 3 is from the 1960s
The idea of calculating the way brain cells do turned up in the 1940s. A machine built on it came in the 1950s
A way to teach many layers stacked together turned up in the 1980s
So what changed? Two things.
① There is vastly more material. People started putting photos and text on the internet. In the 1980s you could show a machine a few hundred cat photos. Now it's hundreds of millions.
② The arithmetic got fast. And from an unexpected direction. Graphics cards were built to draw game screens quickly — and it turned out the sums they do are almost exactly the sums AI does.
Which adds up to this.
| 1980s | Now | |
|---|---|---|
| The ideas | Mostly already there | Mostly the same ones |
| Material (data) | A few hundred | Hundreds of millions |
| Computing power | Takes days | Takes minutes |
It wasn't a new idea. It was material and power.
Then we should look at those sums
If the material is photos and the arithmetic got fast — what exactly is a photo, to a machine?
That's where Part 2 starts.
Sources for this chapter
- 1 McCulloch & Pitts, "A Logical Calculus of the Ideas Immanent in Nervous Activity", Bulletin of Mathematical Biophysics 5 (1943)
- 3 Turing, "Computing Machinery and Intelligence", Mind 59(236) (1950)
- 5 McCarthy, Minsky, Rochester & Shannon, "A Proposal for the Dartmouth Summer Research Project on Artificial Intelligence" (1955)
- 8 "New Navy Device Learns By Doing", The New York Times (1958-07-08)
- 10 Michie, MENACE (1961) · "Experiments on the Mechanization of Game-Learning", The Computer Journal 6(3) (1963)
- 23 Simon, The New Science of Management Decision (Harper & Row, 1960 · 1965)
- 24 George Johnson, "To Test a Powerful Computer, Play an Ancient Game" (interview with Piet Hut), The New York Times (1997-07-29)
- 25 Moravec, Mind Children (Harvard University Press, 1988)
- 26 Hofstadter, Gödel, Escher, Bach (Basic Books, 1979)
- 29 Rumelhart, Hinton & Williams, "Learning representations by back-propagating errors", Nature 323 (1986)