Wednesday, January 5, 2011
[http://johnlawrenceaspden.blogspot.com/2011/01/effortless-superiority.html]
This isn't a boast. It starts off sounding like one. Actually it's a confession of utter stupidity, blindness and laziness. I write it as catharsis now it's far too late, and as a warning.
There is a phrase, 'Effortless Superiority'. I've always thought it was the motto of one of the Oxford Colleges, but apparently not.
I used to take it seriously. As an ideal.
I don't know my times tables. I never had to learn them. I can work out what they have to be if I need them. I could do that fast enough to beat all the other children at primary school on arithmetic tests by an overwhelming margin. So I never bothered learning the tables, or practising multiplication. I just used to sit around thinking about other things, and then win the test anyway.
I was told at primary school. At primary school. That I'd never amount to anything, because I was too lazy. That I'd never get any 'O' levels1. By a teacher called Mr Nicholson. He made a special point of telling my parents the same thing. I thought he was an idiot. I think my parents probably did too.
I never did any work at school. I certainly never did any homework. I did usually pay attention in class. It was often interesting.
Once or twice I remember finding something mathematical that I didn't understand immediately.
Come to think of it, I still can't do integration by substitution. I remember noticing that I couldn't, and deciding that it must be a silly, uninteresting special-purpose trick.
On one particular occasion (a problem in dynamics. something to do with balls on wire hoops.) I was worried that there was a maths-thing I couldn't do, and so I worked through a couple of examples in the back of the textbook, and I remember the light dawning.
That should have been a clue. But it was lost in the noise.
I remember learning a table of German vocabulary once for an exam. It took about half an hour, and I got it perfectly. I thought this was an utter waste of time. I don't know why I did it. When I took the exam and got a near perfect score, and it was obvious that if I hadn't bothered I'd still have aced it, I remember thinking that that had been a complete waste of half an hour in which I could have been doing something more interesting2.
When A-level Chemistry got to the point where I had to learn the colours of the transition metal ions, a table of apparently random text which must have had oooh, twenty entries?, I gave up the subject.
I am not joking. I remember asking the teacher if I could carry on doing the practicals, which I enjoyed, and not come to the theory lessons. He wouldn't let me, so I just gave up the course entirely. I used to spend the time in the school canteen (we had a nice sixth form common room where you could smoke) playing pool.
I was still entered for the exam, so I took it anyway. Despite having only gone to the first year of a two year course, I got a B because I could deduce most of the required answers from physics and from what I remembered of 'Teach Yourself Organic Chemistry', and 'Asimov on Chemistry', which I'd devoured when I was about ten years old.
Chemistry had been my first love. The first thing I was passionate about. I used to make little plasticine models of hydrocarbons and take them to school, where I would try to persuade Mr Nicholson to hang them from wires on the ceiling to represent my idea of what a gas was.
When, at around ten or eleven, I had my first fevered dreams about the bodies of women, I had equally fevered dreams about space-filling molecular models of such exotica as DNA, which could be purchased for insanely high prices from glossy catalogues that my father would bring home from work, along with copies of New Scientist donated by his friends.
And in spite of never lifting a finger I was always clearly the best at anything intellectual. I seem to remember, back in 1986 or whenever, thinking that I was probably the cleverest sixth-former in my home city, on the basis that I didn't know anyone who'd done as well at A-level as me.
The thing is, this might actually have been true.
I've mentioned where my B in chemistry came from. My A at physics, and my grade 1 at physics S-level (a special form of super-A level that most people don't know about), came on the back of exams that I'd taken while coming down from LSD, which I'd taken a couple of days before in the sure knowledge that I'd have straightened up enough by the time of the exam to sail it anyway. This was, to say the least, not the first experience I'd had with drugs, and even allowing for the after-effects of acid I knew I wasn't going to have any trouble with Physics.
By that time, I'd decided that I wanted to be a mathematician. That seemed to be the subject where everything was obvious. Nothing needed to be learned or memorized or anything vulgar like that.
People just said things that were obviously true, and once you'd heard them it was like you'd been born knowing them, and it had just needed someone to draw your attention to the fact that you knew them.
Slightly to my surprise, Cambridge University turned me down when I applied there.
I'd taken my maths A-level a year early and got a B, so that was the only evidence they had at the interview. And in the interview, they'd asked me a question I couldn't do.
My school were furious, disbelieving.
With my typical modesty, I decided that Cambridge were wrong.
I had been planning a year off (taking drugs) anyway, and so I asked the University of London if they'd hold open their unconditional offer of a place for a year, and I applied to Cambridge again. To the same college.
Chosen because I thought it was the prettiest one and because it was both particularly hard to get into and top of the academic table of Colleges at the time. To do what was famously the hardest maths course in the world, at what I thought was the best university in the world.
Don't misunderstand. I didn't decide to work harder or anything. I just thought they had been wrong, and I'd give them another chance to make the correct decision.
I sat my A-levels, S-levels, and STEPS (Cambridge Entrance Exam), and aced them apart from the B in Chemistry and dropping a grade or two in one of the two STEP papers, which it turned out didn't matter.
King's gave me a second interview, and I did really well in this one. They accepted me.
At College I had the disturbing experience of not being the brightest person I knew any more.
There were people who'd been to public schools, who'd been prodigies and competed in scary things called Olympiads that I'd never heard of, and who had been appropriately stretched by gifted teachers. There were other people from comprehensive schools like me, but who'd worked insanely hard to get in.
I reckoned that I was about halfway up my group of twelve. But several of them have told me since that they were scared stiff of me, who didn't seem to try, and had had a standard state education, and yet who seemed given to flashes of insight.
I'm not sure that I actually did anything you'd call 'work' in the first year. But they did have this supervision system, where you'd get question lists handed out and you were supposed to solve as many as possible before going to see one of the Fellows about them.
I used to have a go at these sheets. I used to find that I could do the first five or six questions without trouble, and then everything else would be too hard. But if you turned up to the supervision, the Fellow in question would then explain how to do the remaining five or six.
I thought that's what they were for.
In my first year exams I came in about the top ten per cent of my year. I scored below a couple of my college-mates, both of whom were well educated public schoolboys who'd been to schools for gifted kids, and were obviously very bright as well.
I figured that was good enough. I had girls and alcohol to worry about. I was up to my neck in both. I'd given up on drugs because they were all boring except for LSD, and I'd given up on LSD because I'd had one too many bad trips. But I'd filled the gap with heavy drinking and socializing. Mainly I think because it got you laid, but it was also great fun in itself.
So in the second year, I just gave up. I still went to all my lectures, because I enjoyed them. In fact despite near-constant partying, I think I missed two lectures in my entire time at college. I didn't love mathematics any less than I had.
But I no longer had any sort of go at the example sheets. I just turned up to supervisions and got the supervisors to explain how to do the problems. I could usually do the first couple off the top of my head anyway. As far as I know, my teachers still thought I was pretty good, because of my initial solid first, and the fact that I asked the right questions about the subjects I found interesting.
And at the end of the second year, I got a second. I was about half way up the list. I remember that my teachers seemed quite disappointed, and my reputation took a bit of a hit.
I'd been expecting it. I'd deliberately taken the year off, but I was never under any illusions about what my capabilities were. I knew that if I actually practised answering exam questions I'd be able to do them faster, and the tripos exam was like every other exam that I'd ever sat, a speed test rather than a test of understanding.
I still knew how all the questions worked, it just took me more time to solve them than I was allowed to spend. The reason that other people were doing better than me was because I hadn't cheated by practising doing exam questions. I understood it all as well as they did. Most of them were just half-remembering formulae they'd picked up from spending many sleepless nights revising.
Everything was going according to plan.
The plan that I'd had, ever since I first thought what I should do as an adult, to sail effortlessly into a tenured academic job (when I'd been growing up, that had been a very easy thing to do), and to carry on learning and teaching and who knows, maybe think of something new and interesting one day.
It had never really occurred to me to do anything else.
If I thought about the 'real world' at all, then it was as a sort of sewer, filled with people who did tedious and unchallenging things because they wanted money.
Academic salaries and PhD grants weren't great in the way that they had once been, but still plenty enough to support a studenty lifestyle, and that was all I wanted. I saw myself as being one of those kindly unmarried dons who hangs around in college and lives in college rooms, and lets the undergraduates substitute for the children he would have had if he hadn't been devoted to his craft. It looked great.
But if I wanted to do a PhD in pure mathematics3, I needed a first-class degree. There was no funding available otherwise.
So I went back to my first year routine of having a half-hearted go at the example sheets before heading off to supervisions to have it all explained face to face. To be spoon-fed the answers without having made the effort to think of them myself.
It was a bit harder this time, because as well as having to work out what the new stuff was about, I realised that I hadn't really understood the second year stuff even though I thought I had4, and so I needed to work out how all that worked while working out what the new stuff meant.
But it all worked out OK, almost. I was actually good enough to start catching up again.
I didn't bother with the third year computer project, despite that I'd been programming since the age of 10, would have found it very easy, and it was worth a full third of the credit that I'd need to get a first5.
I didn't want to do something that I wouldn't learn anything from. I wanted to be a mathematician, not a programmer. And I was already as good a programmer as I'd ever need to be6.
By the time the final exam was close enough to worry about, my first class degree was in the bag.
I had actually stooped to trying my hand at some past papers under exam conditions, which I still thought was cheating, but getting a first looked important enough to cheat at, and after the first couple of papers, I'd got good enough at it to reliably score the marks necessary for a first.
Rather to my surprise, (remember that this was the first time I'd ever taken an exam seriously enough to practise doing it), I found that I rather enjoyed the process. And even more surprisingly, learning to do the questions quickly actually seemed to make the ideas behind them clearer and more beautiful. They achieved a sort of focus that they hadn't had before.
Knowing that I was going to do well in the exam, I took Easter term pretty much off. The sunshine was lovely, this was my last year with all my friends, there was punting to do, and cricket to play, and riverside pubs to sit in, and parties to go to, and not many lectures to go to, and I understood enough subjects in enough detail to be confident that even if the questions turned out to be particularly hard, I'd pass. (I thought anything lower than a first was a fail.)
And of course I failed7.
I have excuses, of course, for the failure of my confident prediction:
The questions in my particular favourite subjects deviated from their usual predictable patterns. The first paper was much harder than I expected. One particular topology question (one of the two subjects where I really could have given the lectures) was so incomprehensible that all I could do for an answer was to draw a picture and write underneath 'It works because of this'. I had no idea how to do a formal proof as asked for.
My finals were four exams over two days, three hours each. After the first day I knew I'd done badly. I couldn't sleep for worry. The questions in the third and fourth exams were more in line with normal, but I actually managed to go to sleep in the fourth exam because I was so tired after two gruelling days awake.
When the results came out I wasn't surprised. I'd calculated my mark afterwards, and it was on the line between a second and a first. I fell just the wrong side8.
Cambridge Mathematics has a charming tradition of reading out the results at a big ceremony in the Senate House. They read out the names of everyone who has got a first, in alphabetical order. I remember the list of names going Aa.... Ab..... Ascot (or something), Bagg...
Bagg was my college mate Jenny. As soon as I heard her name I knew I'd screwed it. Without any previous warning in about twenty-one years, I'd managed to be not as good at something as I needed to be.
That was pretty much the end for me.
No first meant no PhD funding in the thing I wanted to do. I didn't have a plan B. It literally hadn't occurred to me in the month or so before the exam that I could fail it.
I fell on my feet after a fashion. Someone told me of a PhD place for a specific project in Imperial College, London, which had its funding allocated already, but where the student in question had dropped out. I rang the man who controlled the funding, he invited me to London, we talked for an hour and the place was mine.
But it didn't work out. I didn't get on particularly well with my supervisor, I wasn't interested in the thing I was supposed to be studying, he wasn't interested in any of my ideas, and there was no one else to talk to.
I'd been looking forward to London. I'd always enjoyed going there as a boy. But it turned out to be awful. A lonely wasteland of concrete and filth. And being an academic didn't look like much fun in London. More of a sort of glorified schoolteacher job, and not that glorified either.
And then my intuition failed. One day I was trying to read a research paper, and I found out that it was just squiggles. No pictures, no handle on what it meant. Not even a vague feeling that if I tried just changing this bit, something would happen. It was suddenly all Greek to me.
I understood, for the first time in my life, what it was to not understand a piece of mathematics.
And I figured that was the end of the line. All my life I'd watched people give up maths, because it didn't seem to mean anything to them. I knew that however hard they tried, it wouldn't ever make proper sense to them like it did to me.
It just seemed that that had happened to me. There's obviously a point beyond which you can't go, and it just so happened that mine was about half-way through a PhD.
I don't think it occurred to me that I might be able to work my way through this. That just wasn't the way I thought it worked. By that time I didn't care anyway. Two years in London had put me off the whole idea of academia.
I moved back to Cambridge because that's where most of the people I liked lived.
At about this time, I started to run out of money.
The near limitless ability of the 1980s British State to subsidize lazy good-for-nothing layabouts who thought the world owed them a living had met its match in me. I had an overdraft, accounted for pretty much exactly by six years of booze and cigars. Even though today's self-funded students will laugh at my tiny £6,000 debt, it seemed to me that I was so poor that I had to give up smoking. I even gave up 2000AD, a comic that I'd read regularly since I was a boy, because the 50p it cost every two weeks was a noticeable expense.
Of course when the PhD funding ran out, I managed to start drawing unemployment benefit. But this wasn't quite as much, so there was further belt tightening to be done, and I didn't fancy it. My supervisor said that I'd got about another six months work to do before I'd be able to hand in a doctorate, and I was pretty sure that meant about twelve months. Also it was going to be a complete piece of shit. Nobody would ever read it out of interest, and I wasn't in the least interested in writing it.
I got a job, programming. It was great fun, it turned out. People gave you things to do that they didn't know how to do themselves, but they were usually quite easy things, so they were fun and got done quickly, and (and this was the real revelation) people were actually grateful when you solved their problems.
I mean that you felt like you'd done them a good turn rather than jumped through some hoop they were holding.
This was a revelation to me. I loved it. After about two months I had this awful dream where I'd gone back to London to try to finish my PhD. I woke up in a cold sweat of terror, and at that point I knew I was never going to be Dr Aspden.
Which was strange. I'd always thought that Mr was what you were called from about 16 to about 24. A sort of probationary title. It was like I'd been told I'd never be able to get a driving licence.
I got used to being mediocre. I was good enough to have got a Cambridge maths degree. I was probably top quartile. But there are a fair number of people like that in the world.
I've thoroughly enjoyed it. I'm pretty good at what I do, and it's fun.
I took up other hobbies. I'd always liked playing sports, even though I was useless at it, and, almost by accident, I took up rowing, which is the local sport here, for us townies as well as for the university.
There was no reason to expect to be anything other than rubbish at rowing. I'm average height, stronger than most men my size, but not vastly so, and I smoke, which doesn't go well with a sport where the chief physical variable is a capacity for consuming oxygen.
And I was terrible at it. For years.
But I enjoyed it, and I practised it, and I thought about it, and I got good at it. I was never in a million years going to be any sort of star at it, even in the rather limited competitive environment of Cambridge town. But I ended up being, if not actually any good, better than I would ever have believed possible to start with.
And somehow it taught me that if you work at something, you get better at it.
And I decided a few years ago that I should learn LISP, an antique computer language out of the dark ages, because there seemed to be something special about the way LISP people talked.
So I got the standard textbook: The Structure and Interpretation of Computer Programs, and I found it harder than most things to do with computers. But I was damned if I was going to let some sort of computer-thing be hard, because nothing in computers is even a bit hard. So I did the exercises in the book to see if they would make it clear, and found that solving carefully chosen example problems is fun, and you know what, the more of the exercises I solved, the more I understood the book, and the better I understood, the more of the book I could read.
And it taught me that if you work at something intellectual, you get better at it.
Which I didn't believe for the first thirty years of my life.
I thought that you were born good at things. I thought if you weren't good at things, working hard at them was just a path to ruining your life with fruitless toil, to fail one level higher than you would have failed anyway.
To be honest, I still believe something like that, just not as extreme a version as I once did.
Why would I not have believed this? You cannot read a newspaper without people praising the special quality of genius. You cannot read a book without finding out that authors and poets and musicians have their works come to them fully formed. The special genius of my heroes: Feynman, Einstein, Newton, Von Neumann, is trumpeted from the rooftops.
You never hear that they lifted a finger apart from doing exactly what seemed most amusing to them at the time.
And it had been absolutely true for me for twenty years. I'd been told over and over again that I needed to work harder. And every time I'd ignored the advice and turned out to be right.
And then when I was twenty-one years old the 'Problem of Induction' had hit me over the head with a whisky bottle during my final exams. And I was stone dead and I didn't even notice because twenty years of confirming evidence isn't overturned in one day by a human mind just like that.
And I've only just noticed.
Recently, a young friend from rowing asked me to teach him enough maths to get him onto an engineering degree. I loved doing this. Sitting down and talking with him and taking him through trial problems and trying to work out where his mental blocks were and blowing them away was the best fun I've had in ages. And he's now doing his engineering degree, although he's going to screw it up by, ironically, spending so much time rowing really seriously that he'll be too tired to think about engineering.
And I've been reading the collected works of the brilliant philosopher Eliezer Yudkowsky, who's built a whole philosophy and predicted the entire future of the human race convincingly using, amongst other intellectual tools Bayes' Theorem, a trivial piece of arithmetic with profound implications.
And I figured if I'm going to understand Eliezer Yudkowsky's thoughts I'd better understand Bayes' Theorem and its consequences as well as he does, which I'm still arrogant enough to think that I can do.
And so from a combination of these effects, I've started doing mathematics, recreationally, for the first time in my life. And indeed mathematics at all, for the first time in about fifteen years.
And it turns out I'm still pretty good at it. I shouldn't be, because I'm forty years old now, and no one's as good at maths at forty as they were at twenty. But if my powers have declined I can't tell.
I'm reading David MacKay's beautiful book Information Theory, Inference, and Learning Algorithms, and it's like reading a thriller. I've patiently worked through the examples in the first two or three chapters, even the ones that look boring, because I remember that the boring-looking examples in SICP always turned out to teach unique and thrilling lessons.
I've sort of got my head round the introductions to Information Theory and Inference, and I think I already see why the Noisy-Channel Coding Theorem is going to turn out to be true in chapter 6 or wherever it is, and why it is also going to turn out to be of little practical value.
And I can't wait to find out if I'm right.
And this has brought back memories, and when I start remembering things these days I start writing, and all this has come out like a flood, and suddenly it occurs to me, because I promise you that the above is as true as my fallible memory can make it, that I may actually have been as good as I once thought I was.
And fuck the research angle and doctorates and names on interesting discoveries. I love teaching. And I'm good at it. And that's what I should have been doing with my life. Teaching mathematics and computers to bright young people. I would have loved it. And I didn't do it. And it's too late now.
And I want to call bullshit on the idea of Effortless Superiority, which it now occurs to me I may have been the only human on the planet stupid enough to take seriously.9
Just in case that wasn't already long enough, here are some bits of text from the essay I started writing, which was different. I can't see how to fit them in to the main thing:
Right until halfway into a PhD that I didn't find interesting. At that point the wellspring failed, and within twelve months of realising that it was gone I wasn't a mathematician any more. Part of the problem was that I'd never had to try at anything before, and I didn't know how to deal with anything that required effort.
Would you believe that at the time I sat my finals, I still thought that practising exam questions was cheating. I thought it was vulgar. Like you were trying to fool the examiners into thinking you were cleverer than you were.
I realized that I wasn't clever enough to bank on a first (I mean I still thought I'd get one, it's just that I'd realized there was a *chance* I wouldn't), so towards the end of my third year, I cheated a bit. But it was too little too late, and it didn't help much. I got the second I'd feared.
This only confirmed me in my belief that it was silly to try. That nothing that had to be worked at was worth having. It was easy to maintain this belief.
Lots of people have to try very hard to get into university. They slog away at A-levels, ruining evenings and weekends that should be spent being young and happy. And when they crowbar their way in, somehow managing to convince an interviewer far cleverer than they are that the lights are on in their heads, they find that it's all ashes. For nothing.
For it gets harder once you're not at school. And the only strategy these people have is to work harder. But they already worked as hard as they could.
They react predictably. They burn the candle at both ends for three years, and at the end of it they scrape low seconds and thirds. Some, released from parental pressure, realize that the game isn't worth it and drop out, pretending they didn't care in the first place.
I was terrified of being one of these people. I guess I still am.
English school leaving exams. A-levels are the optional ones two years later, on which University Entrance depends, S-levels are a special form of A-levels, on the same syllabus but the questions are much harder. STEP is similar to S-level, but set by Cambridge University and used as part of its entrance requirement.
Even though I was good at foreign languages, they seemed like a completely stupid rigmarole. It wasn't like they were any use for anything except passing foreign language tests.
Somehow, at around this same time, I was teaching myself Latin out of a book my father had left lying around where I could find it. Latin was interesting and useful, because you could read about the Roman Empire and other cool things in the Romans' own words. And you could see where lots of our words came from. And their poetry was better than ours.
I've wondered if I'd have done modern languages for my degree if my school had managed to make living German and French anything like as interesting as Francis Kinchin Smith managed to make dead Latin and Greek in his two Teach Yourself ... books. Cheap self-help manuals that were doubtless intended by the publishers to be read only as far as the third chapter. From the love and care and scholarship and cleverness lavished on them I think Francis had higher goals for them. I wonder if he ever got fan mail? If I could go back and write it I would. What did a child know? I've just googled him. He died in 1958 apparently. Too early for him to have got my letter even if I had thought to write. The fact that I can remember his name after 28 years tells you how much I liked those books. I wish I'd had a chance to tell him.
But the tedium of French and German was as nothing compared to the Horror of Music and the Calvary of Religious Education.
How, how for the love of Christ did they manage to make Music boring to a human child?
And for that matter, the King James Bible is one of my favourite books.
I am as bleak an atheist as it is possible to be, and yet I often read the Gospel According to St Matthew on Easter Day. I wonder how many Christians do?
By this time I'd begun to despise applied maths, which seemed to be a bag of stupid half-understood magic tricks that was overdue to be swept away by computer simulation.
Weirdly it only seems to be taught like that in Cambridge. In London later on I found it interesting again.
As someone once pointed out, what the hell did I think it meant for someone to understand something if they couldn't use it fluently?
I had done some computer stuff in the second year out of interest, but I'd found that it didn't teach me anything interesting. I already knew how to program. I can't even remember whether I bothered completing it.
I know, I know, I was a moron. But actually it did look singularly unchallenging. Now if they'd taught SCHEME rather than matrix multiplication algorithms, who knows...
got a second.
As I remember, the topology question that I'd drawn the answer to was bastard hard, only a couple of people had attempted it, and my picture had been given almost the maximum mark. So in fact I needn't have worried. If I'd known that, I might have been able to sleep that night.
I'm not whining for the sake of it, by the way. I've loved life, and I'd do the first forty years over again exactly the same way like a shot if I had the chance.
But if you recognise yourself in the above, young person, for God's sake do the exercises in the textbooks, and practise exam questions. It's not cheating. It helps you understand. A lot.
If you do the exercises, and play with the examples, then you will find that your intuition, already powerful, starts to get brighter, and rather than finding as I did that as you go forward, you start to run out of dry places to stand in the swamp, until eventually there's nowhere new to go, you'll find that as you brighten the swamp recedes ahead of you faster than you can walk.
On the other hand, if you find yourself working every hour God sends on something and you're not enjoying it for its own sake, give up.
Nothing's worth that sort of life. I still think success probably comes fairly easily if you're any good. What I'm trying to warn against is pig-headedly not lifting a fucking finger to practise something you enjoy because you think that's something lesser beings have to do to make up for being lesser.
"If at first you don't succeed, try, and try again. Then give up. No sense making a fool of yourself." -- Homer
Also I consider myself a young bright mind. I would love to learn any computer science topic you would want to teach.
There is a huge lack of online advanced computer programming/science recourses. Why don’t you try your hand at creating some. It takes time and effort but instead of just reaching 300 students a year you can reach tens of thousands.
It’s never too late. Plenty of people go back and do their phds.
Just go work at a prestige company for a year or two and they will be dying for you to do your PhD.
There are also teaching professors where you aren’t required to do research.