Tuesday, August 30, 2011

Algorithms are smarter than people

On the topic of algorithmic trading, I recently posted on some evidence documenting the benefits it brings to markets -- more liquidity, lower spreads and trading costs, etc. On a related topic, Ole Roleberg at Freakynomics has a nice post reviewing some of the evidence that automated decision tools actually make better decisions that real people when confronting many different kinds of problems. As he notes,
There’s a host of studies showing that human judgment is poor at synthesizing and weighting a large number of different types of evidence, and that simple, statistical models can outperform humans on tasks such as predicting recidivism, making clinical judgments (psychiatry and medicine), predicting divorce, predicting future academic success, etc. (for an entrypoint to this literature, see here for a blogpost I found that has some good quotes from J.D. Trout and Michael Bishop).

I guess the point is that algorithmic trading can be good or bad depending on the algorithm – and that the danger it brings is more if the ecology of trading algorithms active in a market is of a kind that could create cascading ripples destabilizing the market: One set of algorithms lowering the price of a set of stocks, triggering another set of algorithms to sell these stocks to avoid loss, triggering another set of… and so on.
This is precisely the point I've made before about the dangers of algorithms -- it's not one algorithm that might blow things up, but potentially explosive webs of feedback running between many.

But I think the superior performance of algorithms at making decisions is itself quite striking and not generally recognized. The article to which Rogeberg links makes the following all-too-plausible remark:
Training of large numbers of experts by universities has probably had the perverse effect of increasing the number of people running around making highly confident but wrong judgements. But the tendency to not notice our errors and to place excessive confidence in our subjective judgements is something that all humans suffer from to varying degrees.
One final interesting read -- again thanks to Rogeberger for pointing this out -- is a profile in The Atlantic of Cliff Asness of the quant hedge fund Applied Quantitative Research. AQR was one of the hedge funds involved in the infamous "quant meltdown" of August 2007 which was driven precisely by a positive feedback loop, in the case one which caused a violent de-leveraging among a number of hedge funds using similar strategies and invested in similar assets. This is one of the few cases in which we have a pretty good quantitative model explaining how these kinds of feedback loops emerge essentially in the same way violent storms (or hurricanes) do in the atmosphere -- through ordinary processes which create the conditions in which explosive events become virtually certain. In the profile, Asness describes the dynamics behind the quant meltdown, which weren't as complex, mysterious or irrational as many people seem to think:
He told the New York Post that he blamed the sudden losses not on AQR's computer models but on "a strategy getting too crowded ... and then suffering when too many try to get out the same door" at the same time.

10 comments:

  1. If the dynamics of these algorithmic feedback loops are so well-known, why do they still happen?

    ReplyDelete
  2. This is of course why human judgment is more powerful in the end. One cannot program around feedback loops. There are all sorts of such theorems in an area of math (or logic) known as computability.

    ReplyDelete
  3. Hey guys, I have found an excellent site that has Financial Data charts with statistical functions to analyze data : www.thinknum.com Check it out

    ReplyDelete
  4. I read blogs on a similar topic, but I never visited your blog. I added it to favorites and I’ll be your constant reader.company career sites

    ReplyDelete
  5. My partner and i condiment the actual meliorates that will astonishingly stunned myself this envelop associated with fashion should be more than from the stock options fold in addition in the same way seeks the knowledge an individual bum!perfumes lacoste

    ReplyDelete
  6. What a wonderful interview. I hope you were able to scoop up something from his tag sale!varidesk reviews

    ReplyDelete
  7. There is a huge craze in the market for these MUVs, I have seen these vehicles in many showrooms. A new car dealership has just launched in our area, I have heard they also have a couple of MUVs in their showroom, Popcorn Machines

    ReplyDelete
  8. This information helped me gain more knowledge on Education Loan. For Study Abroad, do refer this:
    Education loans India

    ReplyDelete
  9. من افضل شركات منطقة مكة المكرمة التي تعمل في مجال تنظيف وتعقيم المنازل تلك الشركة الجيدة التي تقدم خدمات جيدة في تنظيف المنازل من الداخل ومن الخارج وتسمى شركه تنظيف منازل بجده وهي التي تختص بأعمال التنظيف للمنازل الجديدة والمفروشة في مدينة جدة والتي تقوم بها افضل شركه تنظيف فلل لها خبرة طويلة بالمجال
    وقد تقوم تلك الشركات في جدة ايضا بتقديم خدمات غسيل المفروشات والكنب والسجاد تحت مسمى آخر مثل شركة تنظيف كنب بالبخار بجدة وتقوم تلك الشركات بتقديم تلك الخدمات بأسعار جيدة وخدمات مقبولة
    في العاصمة المقدسة التي هي مكة المكرمة توجد لدينا امكانيات كبيرة في مجال تنظيف المنازل والشقق والفلل كما في شركة تنظيف منازل بمكة المكرمة فلو تريد تنظيف بيتك او منزلك وانت في مكة تواصل معنا في حالة ان كان المنزل جديد
    اما في حال ان كان المنزل مفروش واصاب الفرش من الأوساخ والأتربة مثل الكنب والمجالس والسجاد وتريد التنظيف بالبخار تواصل مع شركة تنظيف بالبخار بمكة المكرمة وهي شركة متميزة في أعمال الغسيل والتنظيف بالبخار في نفس الموقع

    ReplyDelete