Malcolm Gladwell’s “Blink” presents the marvels of expert intuition and Nassim Taleb’s “The Black Swan” highlights the flaws of expert intuition. Well, Srinivas Ramanujan’s first letter to Hardy exemplifies both – the marvels and the flaws of expert intuition. Let’s see how.
Genius or fraud? “I beg to introduce myself to you as a clerk in the Accounts Department of the Port Trust Office at
The letter: The letter contained theorems in number theory, calculus, infinite series etc. Some of the formulae were familiar to Hardy, while others “seemed scarcely possible to believe”. For some reason, Hardy decided to consult his fellow mathematician Littlewood to reach a verdict on whether the author is a genius or a fraud. The duo spent three hours – from 9pm till midnight – going through the manuscript. At the end they concluded that its author is “a mathematician of the highest quality, a man altogether exceptional originality and power”. Some of the results Ramanujan sent to Hardy in his letter belonged to breakthrough category – Hardy was to conclude later. Hardy persuaded Ramanujan and the government to bring him to
The marvel of intuition: Ramanujan’s Indian friend in
Ask yourself “What is 2 x 2 = “ and now ask yourself “What is 19 x 37 =” An answer would come to your mind immediately in the former case while nothing comes to your mind immediately in the latter case. Daniel Kahneman explains in “Thinking, fast & slow” that there are two different modes of thinking: a fast mode and a slow mode. The fast mode (called system-1) is intuitive, effortless and automatic while the slower mode (called system-2) is rule-based, effortful and controlled. You could choose to start the computation of “19 x 37” using the rules of multiplication learnt in school and also stop in between if you wish to do so (slow mode). You had no such control for “2 x 2”. The answer came to mind automatically (fast mode).
For an expert, such as a chess master, when he looks at a board position, several patterns and associated offensive and defensive moves come to mind immediately (like “2 x 2”). They come from a vocabulary of 50,000 to 100,000 patterns stored in memory. Psychologists believe that it takes 10,000 hours (about 6 years of playing chess 5 hours a day) to reach this level of expertise (or active vocabulary). Had Ramanujan done this kind of practice?
By 1900 (age 12) Ramanujan had mastered S. L. Loney’s Trigonometry. However, the year 1903 was a turning point when he found a book written by Carr containing 5000 equations related to algebra, trigonometry, calculus, analytical geometry, differential equations. From this point, life of Ramanujan who graduated from school that year with a reputation of being “off-scale” went off-balance. He didn’t do anything other than mathematics. He failed four attempts to pass in college in 1904, 1905, 1906 and 1907, lost scholarship and didn’t do well even as a math tutor. And yet, this five year period of 1904 to 1909 was the most productive time in his life because, in all likelihood, he was at home manipulating equations in all of his waking hours – on a slate, on a paper and in the mind. It is also quite possible that his fast mode of thinking was so active that during sleep it continued to work on the half-solved problems. The fast mode is known to be working even when we are not conscious. Ramanujan had easily finished his quota of 10,000 hours well before 1909.
Did his intuition ever trick him? Yes, it did, occasionally and it showed in his first letter to Hardy as well.
The flaw of intuition: In his first letter, Ramanujan had written that he had found a function which exactly represents the number of prime numbers less than x. After Hardy demanded a proof, Ramanujan sent one. And Littlewood figured out that it was wrong. Well, Ramanujan’s formula wasn’t bad. It was off by only 53 for calculating primes up to first nine million (which are 602,489). However, the difference became bigger as numbers grew larger. And this is what Ramanujan failed to see.
Checking a sketchy proof rigorously, at least partly, is a responsibility of the slow thinking mode. As Kahneman observes that the slow thinking mode is inherently lazy. If an answer given by the fast mode looks fine, it just endorses the verdict. In Ramanujan’s case the slow mode was not just lazy, it was weak. Because he never formally learnt how to write a rigorous proof until he reached
What was interesting about Ramanujan was not that his intuition was sometimes wrong. Even a great mathematician like Andrew Wiles also had a serious hole in his first proof of the Fermat’s Last Theorem. What was different about Ramanujan before coming to
Two key learnings from this story: One, a rich vocabulary of several hundreds of thousands of patterns resulting from a prolonged practice and timely invocation of appropriate patterns by the fast mode of thinking creates expert intuition. Two, knowing when not to trust the instincts is an important characteristic of a true expert. Ask yourself, "Which are the possible situations in which my instincts could be on a slippery ground?"
Conditions for intuitive expertise, Daniel Kahneman & Gary Klein, American Psychologist, Sept 2009.
My most favorite YouTube video and the marvels and the flaws of intuition, Sept 19, 2010 (On Kahneman's lecture at Berkeley on the same topic).
Impossible problems and successful approaches: story of Fermat's Last Theorem, Oct 28, 2008 (On Andrew Wile's successful attempt at solving 350 old most famous open problem).