{"id":5445,"date":"2015-09-02T09:46:37","date_gmt":"2015-09-02T13:46:37","guid":{"rendered":"http:\/\/www.jasonapollovoss.local\/?p=5445"},"modified":"2018-09-21T02:03:42","modified_gmt":"2018-09-21T06:03:42","slug":"alpha-wounds-bad-adjunct-methodologies","status":"publish","type":"post","link":"https:\/\/jasonapollovoss.com\/web\/2015\/09\/02\/alpha-wounds-bad-adjunct-methodologies\/","title":{"rendered":"Alpha Wounds: Bad Adjunct Methodologies"},"content":{"rendered":"<p><span style=\"font-size: 16px;\">Active management has taken a lot of\u00a0body blows\u00a0recently. The principal criticism: <a href=\"http:\/\/www.valuewalk.com\/2015\/05\/active-managers-minus-fees\/\">Active managers contribute no alpha once their fees are factored in<\/a>. So is it time to write active management&#8217;s obituary? Not quite. But active management\u00a0certainly is feeling pain.<\/span><\/p>\n<p><span style=\"font-size: 16px;\">A few weeks ago, I argued that\u00a0<a href=\"http:\/\/blogs.cfainstitute.org\/investor\/2015\/07\/28\/alpha-wounds-benchmark-tail-wags-the-portfolio-management-dog\/\">many of the alpha wounds plaguing active management are self-inflicted<\/a>. But this month, I will discuss injuries\u00a0to active managers that are not of their own making. Specifically, I will talk about those wounds resulting from the bad evaluative methodologies employed by the investment industry\u2019s adjuncts: consultants, academics, research institutions, and so forth.<\/span><\/p>\n<p><span style=\"font-size: 16px;\"><strong>Volatility Is Not Risk<\/strong><\/span><\/p>\n<p><span style=\"font-size: 16px;\">I began my analysis career working as an intern at Portfolio Management Consultants (PMC) in Denver, Colorado. Back then, among other measures, we utilized alpha, beta, Sharpe ratios, and Treynor ratios to quantify whether an investment manager was better than her peers.<\/span><\/p>\n<p><span style=\"font-size: 16px;\">Over time we started to notice something very interesting for which we could not account: namely, investment managers who beat their benchmarks handily in 17 of 20 quarters and had barely trailed their benchmark in the remaining three quarters. On a graph, this outperformance was especially dramatic. However, we would then look back to our list of quantitative measures \u2014 alpha, beta, and Sharpe and Treynor ratios \u2014 and see that these managers ranked poorly compared to those who had barely beaten the same benchmark over the same time period and who had led during fewer quarters. How can this be? This result\u00a0\u2014 all too common in the investment management industry \u2014\u00a0is due to one simple fact: Volatility is not risk.<\/span><\/p>\n<p><span style=\"font-size: 16px;\">Yes, I have heard the argument that for investors entering and exiting funds, volatility <em>is<\/em> risk. But why is this the concern of the investment manager? Absent a lock-up period for an investor&#8217;s funds, how is the investment manager (active or passive) supposed to account for the anxiety of the end consumer? This is like holding physicians responsible for whether or not their patients smoke, drink, or eat hot dogs covered in trans fats. Or blaming psychologists for whether or not their patients continue to talk to their exes or take cruise ship vacations with the in-laws.<\/span><\/p>\n<p><span style=\"font-size: 16px;\"><strong>A Definition of Risk<\/strong><\/span><\/p>\n<p><span style=\"font-size: 16px;\">The discussion of whether\u00a0volatility differs from risk also depends on a critical assumption overlooked by most of the industry: Only in finance do we define risk as volatility. Different dictionary definitions of risk all converge on something like the &#8220;chance of loss.&#8221;\u00a0<a href=\"http:\/\/dictionary.reference.com\/browse\/risk\">Here is one such example<\/a>:<\/span><\/p>\n<p><span style=\"font-size: 16px;\"><em>noun<\/em><\/span><\/p>\n<ol>\n<li><span style=\"font-size: 16px;\"><em>exposure to the chance of injury or loss; a hazard or dangerous chance<\/em><\/span><\/li>\n<li><span style=\"font-size: 16px;\">Insurance<\/span>\n<ol>\n<li><span style=\"font-size: 16px;\"><em>the hazard or chance of loss.<\/em><\/span><\/li>\n<li><span style=\"font-size: 16px;\"><em>the degree of probability of such loss.<\/em><\/span><\/li>\n<li><span style=\"font-size: 16px;\"><em>the amount that the insurance company may lose.<\/em><\/span><\/li>\n<li><span style=\"font-size: 16px;\"><em>a person or thing with reference to the hazard involved in insuring him, her, or it.<\/em><\/span><\/li>\n<li><span style=\"font-size: 16px;\"><em>the type of loss, as life, fire, marine disaster, or earthquake, against which an insurance policy is drawn.<\/em><\/span><\/li>\n<\/ol>\n<\/li>\n<\/ol>\n<p><span style=\"font-size: 16px;\"><em>verb<\/em><\/span><\/p>\n<ol>\n<li><span style=\"font-size: 16px;\"><em>to expose to the chance of injury or loss; hazard<\/em><\/span><\/li>\n<li><span style=\"font-size: 16px;\"><em>to venture upon; take or run the chance of<\/em><\/span><\/li>\n<\/ol>\n<p><span style=\"font-size: 16px;\"><em>idiom<\/em><\/span><\/p>\n<ol>\n<li><span style=\"font-size: 16px;\"><em>at risk<\/em><\/span>\n<ol>\n<li><span style=\"font-size: 16px;\"><em>in a dangerous situation or status; in jeopardy<\/em><\/span><\/li>\n<li><span style=\"font-size: 16px;\"><em>under financial or legal obligation; held responsible<\/em><\/span><\/li>\n<\/ol>\n<\/li>\n<li><span style=\"font-size: 16px;\"><em>take\/run a risk: to expose oneself to the chance of injury or loss; put oneself in danger; hazard; venture.<\/em><\/span><\/li>\n<\/ol>\n<p><span style=\"font-size: 16px;\">Notice that not a single definition includes volatility as a part of its explanation. Dictionary definitions and popular understandings of risk might differ from a business definition, yet a popular business dictionary describes over a dozen\u00a0different forms of risk, ranging from <a href=\"http:\/\/www.investopedia.com\/articles\/forex\/021114\/exchange-rate-risk-economic-exposure.asp\">exchange rate risk<\/a> to <a href=\"http:\/\/www.investopedia.com\/terms\/u\/unsystematicrisk.asp\">unsystematic risk<\/a>, all of which focus on the chance of loss. The insurance business is an industry critically dependent on an understanding of risk, and an insurance licensing tutorial\u00a0says that &#8220;<a href=\"https:\/\/www.kfeducation.com\/downloads\/NAT_P&amp;C_LEM_FINALONLINE.pdf\">Risk means the same thing in insurance that it does in everyday language. Risk is the chance or uncertainty of loss<\/a>.&#8221;<\/span><\/p>\n<p><span style=\"font-size: 16px;\">Only in finance is risk defined as volatility. Why? In the early days of investment management analysis in the 1950s, academics recognized that average and standard deviation and the entirety of hundreds of years of statistics research thinking could be borrowed to analyze the performance of investment portfolios \u2014 if some of the definitions could be bent to their aims. Also, it was very difficult to run calculations of any sort in an automated fashion when calculators did not even exist and all computations were done by slide rule. So a simple measure was needed. Here, of course, I am talking about standard deviation. With standard deviation transformed into \u201crisk,\u201d the complex work of analyzing portfolios could begin and theories could be developed. Surely the math would take care of itself as the analysis was improved.<\/span><\/p>\n<p><span style=\"font-size: 16px;\">Take a look at the calculation of standard deviation and you will see that it is essentially the weighted average variation from a mean. There are two interesting things to note here:<\/span><\/p>\n<ul style=\"margin-left: 5%;\">\n<li style=\"padding-bottom: 3%;\"><span style=\"font-size: 16px;\">Variations are both above and below the mean, so besting your benchmark handily is also called \u201crisk\u201d in finance.<\/span><\/li>\n<li style=\"padding-bottom: 3%;\"><span style=\"font-size: 16px;\">Because larger variations from the mean are weighted more, any very large outperformance above your benchmark is even \u201criskier.\u201d<\/span><\/li>\n<\/ul>\n<p><span style=\"font-size: 16px;\">These two facts illuminate how, back in the day at PMC, we found investment managers consistently outperforming (and when they underperformed, it wasn\u2019t by much), but who would look bad from the point of view of alpha, beta, and Sharpe and Treynor ratios. So we developed investment management analytics at PMC that used a more accurate definition of \u201crisk.\u201d For example, we considered the return on US Treasury securities with the same maturity as the investment manager\u2019s preferred investment time horizon to be the appropriate comparison for whether there was risk. Specifically, a manager\u2019s return in a quarter was compared with the US Treasury. If the manager did not beat the Treasury, then it was characterized as a \u201closs\u201d and became part of the time series used to calculate a downside-only standard deviation. We also adjusted the time series for each of our benchmarks as well for comparability.<\/span><\/p>\n<p><span style=\"font-size: 16px;\">Not surprisingly, this adjustment (among others omitted for the sake of brevity) began to highlight the performance of those truly outstanding managers rather than punishing them for terrific outperformance to the upside that the old measures said was \u201crisk.\u201d If you dig into the mathematics of alpha, beta, and the Treynor ratio, you find that they also punish managers who beat their benchmarks by too much. This is because the mathematics for all of these measures is\u00a0sensitive to\u00a0variability around a mean or trend line, rather than about only examining the downside.<\/span><\/p>\n<p><span style=\"font-size: 16px;\"><strong>Do Active Managers Beat Their Benchmarks?<\/strong><\/span><\/p>\n<p><span style=\"font-size: 16px;\">But what does all of this matter? Don\u2019t active managers underperform passive managers? It depends. Again, back in the day, I made it the focus of my masters program in business school to look at <a href=\"https:\/\/jasonapollovoss.com\/web?p=4908\">the performance of investment managers both using the traditional measures of \u201crisk\u201d and those metrics that I preferred<\/a>. Guess what I found? If I used the traditional risk-adjusted return measures, I got the traditional result: Active managers underperform passive managers. Yet, when I used measures more like risk (the chance of loss), the average active manager outperformed the benchmark. In other words, the outcomes were reversed. This result held for multiple time frames. Subsequently, I updated this research while I was a money manager in 2003 (these results are proprietary to my old employer), and I found the exact same result as before. It would be lovely if someone would please update this research, don\u2019t you think?<\/span><\/p>\n<p><span style=\"font-size: 16px;\"><strong>The Same Tired Paper<\/strong><\/span><\/p>\n<p><span style=\"font-size: 16px;\">From where came the refrain about active managers not beating passive managers? If you trace many of the threads to their origin, you discover something fairly interesting: Most of these articles and stories all point to the same paper \u2014 and that paper was published a long time ago.<\/span><\/p>\n<p><span style=\"font-size: 16px;\">Here is one such thread: State Street\u2019s Center for Applied Research and the Fletcher School at Tufts University recently published a white paper, entitled \u201c<a href=\"http:\/\/fletcher.tufts.edu\/SovereigNet\/Research\/The-Quest-for-Performance\">By the Numbers: The Quest for Performance<\/a>,\u201d that reported\u00a0that only 1% of active money managers deliver alpha after fees. What was their source for this oft-repeated claim? It was a 2012 article written by Charles D. Ellis, CFA, in the <em>Financial Analysts Journal,<\/em> entitled \u201c<a href=\"http:\/\/www.cfapubs.org\/doi\/pdf\/10.2469\/faj.v68.n4.2\">Murder on the Orient Express: The Mystery of Underperformance.<\/a>\u201d Bad: This paper is three years old. Worse: The paper itself was not the original source of the data; instead, the data was from a paper written in 2010, entitled \u201c<a href=\"http:\/\/papers.ssrn.com\/sol3\/papers.cfm?abstract_id=869748\">False Discoveries in Mutual Fund Performance: Measuring Luck in Estimated Alphas<\/a>,\u201d that was published in the<em> Journal of Finance<\/em>. Worst: The return data used in this piece was only from up until 2006. The research also uses Sharpe ratios as the basis for its evaluation.<\/span><\/p>\n<p><span style=\"font-size: 16px;\">In other words, researchers and journalists are quoting nine-year-old data as the definitive coroner\u2019s statement on whether active managers are better than passive managers. Furthermore, they are using measures of performance that punish upside outperformance in contradiction of most people\u2019s definition of risk. Lastly, I know that passive strategies (most of the money in which tracks a well-published index) tend to perform better in up markets since these strategies encourage $billions to buy the same list of assets. I also know they tend to perform worse in down markets for the same reason. Would the results be replicated if the research used returns through the end of 2009? Hard to say, because such research\u00a0is not often quoted if it exists.<\/span><\/p>\n<p><span style=\"font-size: 16px;\"><strong>Remedies<\/strong><\/span><\/p>\n<p><span style=\"font-size: 16px;\">So what can be done about this alpha wound, the one that is inflicted\u00a0by the use of bad methodology on the part of the investment industry\u2019s adjuncts?<\/span><\/p>\n<ul style=\"margin-left: 5%;\">\n<li style=\"padding-bottom: 3%;\"><span style=\"font-size: 16px;\">Research into new measures of risk needs to be done. Sortino ratios are a start. But what are the full statistical ramifications of a semi-beta or alpha calculated on downside performance?<\/span><\/li>\n<li style=\"padding-bottom: 3%;\"><span style=\"font-size: 16px;\">Once these measures are developed, then performance should be reevaluated for both active and passive managers \u2014\u00a0and after fees, of course.<\/span><\/li>\n<li style=\"padding-bottom: 3%;\"><span style=\"font-size: 16px;\">Investment industry adjuncts need to stop quoting the same outdated research papers. It is the modern era and this data should be assessed in an automated fashion.<\/span><\/li>\n<\/ul>\n<p style=\"font-size: smaller;\"><span style=\"font-size: 16px;\">Image credit:\u00a0iStockphoto.com\/CSA-Archive<\/span><\/p>\n<p>&nbsp;<\/p>\n<p><span style=\"font-size: 16px;\"><em>Originally published on CFA Institute\u2019s \u00a0<a href=\"https:\/\/blogs.cfainstitute.org\/investor\/\">Enterprising Investor<\/a>.<\/em><\/span><\/p>\n","protected":false},"excerpt":{"rendered":"<p>Active management has taken a lot of\u00a0body blows\u00a0recently. The principal criticism: Active managers contribute no alpha once their fees are factored in. So is it time to write active management&#8217;s obituary? Not quite. But active management\u00a0certainly is feeling pain. A few weeks ago, I argued that\u00a0many of the alpha wounds plaguing active management are self-inflicted. [&hellip;]<\/p>\n","protected":false},"author":2,"featured_media":5446,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_et_pb_use_builder":"","_et_pb_old_content":"","_et_gb_content_width":"","footnotes":""},"categories":[318,12,3],"tags":[195,266,280,278,151,279],"class_list":["post-5445","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-alpha-wounds","category-best-of-the-blog","category-the-blog","tag-alpha","tag-alpha-wounds","tag-beta","tag-sharpe-ratio","tag-standard-deviation","tag-treynor-ratio"],"_links":{"self":[{"href":"https:\/\/jasonapollovoss.com\/web\/wp-json\/wp\/v2\/posts\/5445","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/jasonapollovoss.com\/web\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/jasonapollovoss.com\/web\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/jasonapollovoss.com\/web\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/jasonapollovoss.com\/web\/wp-json\/wp\/v2\/comments?post=5445"}],"version-history":[{"count":0,"href":"https:\/\/jasonapollovoss.com\/web\/wp-json\/wp\/v2\/posts\/5445\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/jasonapollovoss.com\/web\/wp-json\/wp\/v2\/media\/5446"}],"wp:attachment":[{"href":"https:\/\/jasonapollovoss.com\/web\/wp-json\/wp\/v2\/media?parent=5445"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/jasonapollovoss.com\/web\/wp-json\/wp\/v2\/categories?post=5445"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/jasonapollovoss.com\/web\/wp-json\/wp\/v2\/tags?post=5445"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}