<?xml version="1.0" encoding="UTF-8"?>
<?xml-stylesheet type="text/xsl" media="screen" href="/~d/styles/rss2full.xsl"?><?xml-stylesheet type="text/css" media="screen" href="http://feeds.feedburner.com/~d/styles/itemcontent.css"?><rss xmlns:content="http://purl.org/rss/1.0/modules/content/" xmlns:wfw="http://wellformedweb.org/CommentAPI/" xmlns:dc="http://purl.org/dc/elements/1.1/" xmlns:atom="http://www.w3.org/2005/Atom" xmlns:sy="http://purl.org/rss/1.0/modules/syndication/" xmlns:slash="http://purl.org/rss/1.0/modules/slash/" xmlns:feedburner="http://rssnamespace.org/feedburner/ext/1.0" version="2.0">

<channel>
	<title>Optimal Behavior</title>
	
	<link>http://www.dpegan.com/blog</link>
	<description>Applied behavioral finance</description>
	<lastBuildDate>Sat, 21 Apr 2012 20:13:17 +0000</lastBuildDate>
	<language>en</language>
	<sy:updatePeriod>hourly</sy:updatePeriod>
	<sy:updateFrequency>1</sy:updateFrequency>
	<generator>http://wordpress.org/?v=3.3.1</generator>
		<atom10:link xmlns:atom10="http://www.w3.org/2005/Atom" rel="self" type="application/rss+xml" href="http://feeds.feedburner.com/OptimalBehavior" /><feedburner:info uri="optimalbehavior" /><atom10:link xmlns:atom10="http://www.w3.org/2005/Atom" rel="hub" href="http://pubsubhubbub.appspot.com/" /><item>
		<title>Financial advice: (potential) market failure edition</title>
		<link>http://feedproxy.google.com/~r/OptimalBehavior/~3/iKqQvjUZnf8/</link>
		<comments>http://www.dpegan.com/blog/?p=385#comments</comments>
		<pubDate>Sat, 21 Apr 2012 20:13:17 +0000</pubDate>
		<dc:creator>Daniel Egan</dc:creator>
				<category><![CDATA[Uncategorized]]></category>

		<guid isPermaLink="false">http://www.dpegan.com/blog/?p=385</guid>
		<description><![CDATA[The issue of what financial advisers are paid for comes up often, mostly when there is a question about whether they have fulfilled their fiduciary duty in giving advice. There are a variety of different models for how advisers get paid, and all have &#8230; <a href="http://www.dpegan.com/blog/?p=385">Continue reading <span class="meta-nav">&#8594;</span></a>]]></description>
			<content:encoded><![CDATA[<p>The issue of what financial advisers are paid for comes up often, mostly when there is a question about whether they have fulfilled their <a href="http://en.wikipedia.org/wiki/Financial_adviser" target="_blank">fiduciary duty</a> in giving advice. There are a variety of different models for how advisers get paid, and all have at least the appearance of some problem with them. There are two main issues:</p>
<ol>
<li><a href="http://en.wikipedia.org/wiki/Principal%E2%80%93agent_problem" target="_blank">Agency</a>: Are the advisers incentives aligned with yours &#8211; will they be a trustworthy agent? To my knowledge, no firm charges fees which are <em>perfectly</em> incentive aligned. Clients would have to agree to pay based upon how much value advisers have added compared to what the client would have done on their own &#8211; a hard counter-factual to assess.</li>
<li>Quality: How do you know you the advice you are getting is worth paying for?</li>
</ol>
<p>In the UK, the Retail Distribution Review is changing how financial advisers can charge for their advice, and many advisers will be moved to an up-front fee basis, or having to give &#8220;on-going&#8221; advice, i.e. initiating interactions with the client depending (usually) on what the market does.</p>
<p>To focus on the second issue, many advisers are quite rightly scared that this might hurt their business significantly, but mostly for a psychological reason - people have a real problem paying for up-front financial advice. They aren&#8217;t sure of the quality of it (the adviser often knows better than them), and they will not know if the advice was of high quality until a point far in the future.</p>
<p>This opens up a possibility of market failure to (among other things) <a href="http://en.wikipedia.org/wiki/Information_asymmetry" target="_blank">asymmetric information</a>. A client cannot directly assess an advisers’ quality ahead of time, and thus will discount the value of advice to incorporate the risk it is low quality. Advisers who give high quality advice will know it, and not want to accept low-quality prices for their high-quality advice. As a result, fewer people will pay (up-front) for financial services, because it seems too expensive relative to what they expect from it.</p>
<p>Recently my parents went to a financial adviser to help them plan their transition into retirement. They were a bit shocked by the $800 price tag for about 2 hours of time with the financial adviser - yet this is incredibly cheap by many standards. Wealth management and financial advisers often charge in the region of 0.60% up to 2.5% of assets under management per year, and clients have historically accepted those charges. My parents charge would have amounted to less than 0.005%, yet they were still floored by it.</p>
<p>Independent Financial Advisers already are a well-established market, but it will be interesting to see how people react if they have to pay up front.</p>
<p>&nbsp;</p>
<div style="float: right; margin-left: 10px;"><a href="http://twitter.com/share?url=http://www.dpegan.com/blog/?p=385&via=daniel_egan&text=Financial advice: (potential) market failure edition&related=:&lang=en&count=horizontal" class="twitter-share-button">Tweet</a><script type="text/javascript" src="http://platform.twitter.com/widgets.js"></script></div><img src="http://feeds.feedburner.com/~r/OptimalBehavior/~4/iKqQvjUZnf8" height="1" width="1"/>]]></content:encoded>
			<wfw:commentRss>http://www.dpegan.com/blog/?feed=rss2&amp;p=385</wfw:commentRss>
		<slash:comments>0</slash:comments>
		<feedburner:origLink>http://www.dpegan.com/blog/?p=385</feedburner:origLink></item>
		<item>
		<title>The perverse role of debt in feeling wealthy</title>
		<link>http://feedproxy.google.com/~r/OptimalBehavior/~3/DteXjAmxZnY/</link>
		<comments>http://www.dpegan.com/blog/?p=381#comments</comments>
		<pubDate>Sat, 03 Mar 2012 13:32:33 +0000</pubDate>
		<dc:creator>Daniel Egan</dc:creator>
				<category><![CDATA[Uncategorized]]></category>

		<guid isPermaLink="false">http://www.dpegan.com/blog/?p=381</guid>
		<description><![CDATA[I had the pleasure of meeting up with Abby Sussman of Princeton last night, who investigates the psychology of wealth &#8211; assets and liabilities. Her recent piece in Psychological Science sums it up well: We studied the perception of wealth &#8230; <a href="http://www.dpegan.com/blog/?p=381">Continue reading <span class="meta-nav">&#8594;</span></a>]]></description>
			<content:encoded><![CDATA[<p>I had the pleasure of meeting up with Abby Sussman of Princeton last night, who investigates the psychology of wealth &#8211; assets and liabilities. Her <a href="http://pss.sagepub.com/content/23/1/101" target="_blank">recent piece</a> in Psychological Science sums it up well:</p>
<blockquote><p>We studied the perception of wealth as a function of varying levels of assets and debt. We found that with total gross wealth held constant, people with positive net worth feel and are seen as wealthier when they have lower debt (despite having fewer assets). In contrast, people with equal but negative net worth feel and are considered wealthier when they have greater assets (despite having larger debt). This pattern persists in the perception of both the self and others. We explore consequences for the willingness to borrow and lend and briefly discuss the policy implications of these finding</p></blockquote>
<p><a href="http://www.google.com/url?sa=t&amp;rct=j&amp;q=&amp;esrc=s&amp;source=web&amp;cd=3&amp;cts=1330780425975&amp;ved=0CDkQFjAC&amp;url=http%3A%2F%2Fleeds.colorado.edu%2Fasset%2Fconsumerdecisions%2F2011%2Fsussman.pptx&amp;ei=ChlST77hIKTq0gGJvtDRDQ&amp;usg=AFQjCNEulKkGh4jo_OIt57rMS2oPsoxcCQ&amp;sig2=XlXJIKI5waLGVIpqXb57Ow" target="_blank">Here is a presentation</a> laying it out. Get this:</p>
<blockquote><p>Comparing two people in the black, 93% would rather have low debt and low assets. For people in red, 66% would rather have high debt and high assets.</p>
<p>In playing the role of a loan officer, comparing the two profiles in the black, 75% would grant a loan to the person with low debt and low assets. For profiles in the red, 74% would grant the loan to the person with high debt and high assets.</p></blockquote>
<p>So if we have positive net wealth, we are motivated to pay-down our debt, to feel and be considered wealthier. If we have negative net wealth (underwater home owners, ahem), we are motivated to take on more debt.</p>
<p>And as outsiders, we apparently agree.</p>
<p>&nbsp;</p>
<p>&nbsp;</p>
<div style="float: right; margin-left: 10px;"><a href="http://twitter.com/share?url=http://www.dpegan.com/blog/?p=381&via=daniel_egan&text=The perverse role of debt in feeling wealthy&related=:&lang=en&count=horizontal" class="twitter-share-button">Tweet</a><script type="text/javascript" src="http://platform.twitter.com/widgets.js"></script></div><img src="http://feeds.feedburner.com/~r/OptimalBehavior/~4/DteXjAmxZnY" height="1" width="1"/>]]></content:encoded>
			<wfw:commentRss>http://www.dpegan.com/blog/?feed=rss2&amp;p=381</wfw:commentRss>
		<slash:comments>0</slash:comments>
		<feedburner:origLink>http://www.dpegan.com/blog/?p=381</feedburner:origLink></item>
		<item>
		<title>Government disclaimers and ineffective communication</title>
		<link>http://feedproxy.google.com/~r/OptimalBehavior/~3/sKaVLfO3ioI/</link>
		<comments>http://www.dpegan.com/blog/?p=376#comments</comments>
		<pubDate>Thu, 01 Mar 2012 12:51:35 +0000</pubDate>
		<dc:creator>Daniel Egan</dc:creator>
				<category><![CDATA[Uncategorized]]></category>

		<guid isPermaLink="false">http://www.dpegan.com/blog/?p=376</guid>
		<description><![CDATA[From a working paper by Kesten Green and Scott Armstrong We were unable to find evidence that consumers have benefitted from government-mandated disclaimers in advertising. Indeed, experiments and common experience show that admonishments to change or avoid behaviors often have &#8230; <a href="http://www.dpegan.com/blog/?p=376">Continue reading <span class="meta-nav">&#8594;</span></a>]]></description>
			<content:encoded><![CDATA[<p>From a <a href="http://kestencgreen.com/g&amp;a-mandatory.pdf" target="_blank">working paper</a> by Kesten Green and Scott Armstrong</p>
<blockquote><p>We were unable to find evidence that consumers have benefitted from government-mandated disclaimers in advertising. Indeed, experiments and common experience show that admonishments to change or avoid behaviors often have effects opposite to those intended. We found 18 experimental studies that provided evidence relevant to mandatory disclaimers. Mandated messages increased confusion in all, and were ineffective or harmful in the 15 studies that examined perceptions, attitudes, or decisions.</p></blockquote>
<p>Be careful in jumping to the conclusion that the reason is that the government mandated it, rather than that they are often poorly executed. Lobby groups may in fact spend a lot of time making sure the messages are ineffective. Note that when private enterprise has low incentives to communicate clearly, they don&#8217;t do any better. Credit card agreements are a great example, via <a href="http://www.npr.org/blogs/money/2011/03/18/134664249/the-friday-podcast-4th-graders-read-a-credit-card-agreement" target="_blank">Planet Money</a>. The before-and-after examples are striking.</p>
<p>Edward Tufte <a href="http://www.edwardtufte.com/bboard/q-and-a-fetch-msg?msg_id=0000K4" target="_blank">has noted</a> that smoking warnings are usually formatted as if they are meant to be ineffective, with an over-reliance on bold and underlining which actually overwhelms the message itself. I think this derives from non-experts in communication being responsible for what is, in essence, a marketing effort. Typing in bold caps <strong>FEELS LIKE YELLING</strong>, but that doesn&#8217;t mean yelling is effective in changing behavior.</p>
<p>&nbsp;</p>
<p>&nbsp;</p>
<p>&nbsp;</p>
<div style="float: right; margin-left: 10px;"><a href="http://twitter.com/share?url=http://www.dpegan.com/blog/?p=376&via=daniel_egan&text=Government disclaimers and ineffective communication&related=:&lang=en&count=horizontal" class="twitter-share-button">Tweet</a><script type="text/javascript" src="http://platform.twitter.com/widgets.js"></script></div><img src="http://feeds.feedburner.com/~r/OptimalBehavior/~4/sKaVLfO3ioI" height="1" width="1"/>]]></content:encoded>
			<wfw:commentRss>http://www.dpegan.com/blog/?feed=rss2&amp;p=376</wfw:commentRss>
		<slash:comments>1</slash:comments>
		<feedburner:origLink>http://www.dpegan.com/blog/?p=376</feedburner:origLink></item>
		<item>
		<title>“Fooled by Compounding”</title>
		<link>http://feedproxy.google.com/~r/OptimalBehavior/~3/sXD2oGmA8es/</link>
		<comments>http://www.dpegan.com/blog/?p=370#comments</comments>
		<pubDate>Sat, 11 Feb 2012 06:00:52 +0000</pubDate>
		<dc:creator>Daniel Egan</dc:creator>
				<category><![CDATA[Uncategorized]]></category>

		<guid isPermaLink="false">http://www.dpegan.com/blog/?p=370</guid>
		<description><![CDATA[A new paper in the Journal of Portfolio Management (non-gated copy available here). Abstract: Compounding can make things appear to be larger than they really are. This confusion can arise when the return from an event is compounded over a &#8230; <a href="http://www.dpegan.com/blog/?p=370">Continue reading <span class="meta-nav">&#8594;</span></a>]]></description>
			<content:encoded><![CDATA[<p><a href="http://www.iijournals.com/doi/abs/10.3905/jpm.2012.38.2.108" target="_blank">A new paper</a> in the Journal of Portfolio Management (non-gated copy available <a href="http://papers.ssrn.com/sol3/papers.cfm?abstract_id=1485179" target="_blank">here</a>). Abstract:</p>
<blockquote><p>Compounding can make things appear to be larger than they really are. This confusion can arise when the return from an event is compounded over a long holding period, and the return from compounding is described as the return from the event. In this article, McLean reviews several examples of this common mistake, which are found in a popular book on rare events, newspaper articles, investment advisors’ research reports, and finance journal articles. He also shows how compounding can distort inference in event studies and in the measurement of mutual fund performance. McLean describes alternative methods of return measurement that are not affected by compounding and shows that these methods can lead to different inferences than do measures that include compounding.</p></blockquote>
<p>While the examples and reasoning in the paper aren&#8217;t novel or groundbreaking, it&#8217;s yet another example of how easy it is to be mislead by compound or exponential growth.</p>
<p>Related: McKenzie, C. R. M., &amp; Liersch, M. J. (in press). Misunderstanding savings growth: Implications for retirement savings behavior. <span style="text-decoration: underline;">Journal of Marketing Research</span>. [<a href="http://psy2.ucsd.edu/~mckenzie/McKenzie&amp;LierschInPressJMR.pdf"><em>pdf</em></a>]</p>
<blockquote><p>People systematically underestimate exponential growth. The current studies illustrate this phenomenon, its implications, and potential interventions in the context of saving for retirement, where savings grow exponentially over long periods of time. Experiment 1 showed that the majority of participants expected savings over 40 years to grow linearly rather than exponentially, leading them to grossly underestimate their account balance at retirement. Experiment 2 demonstrated that this misunderstanding of savings growth led to underestimating the cost of waiting to save, which makes putting off saving more attractive than it should be. Finally, Experiments 3-5 showed that highlighting the exponential growth of savings motivated both college students and real employees to save more for retirement. Making clear to employees the exponential growth of savings &#8212; just before they make crucial decisions about how much to save &#8212; may be a simple and effective means of increasing retirement savings.</p></blockquote>
<div style="float: right; margin-left: 10px;"><a href="http://twitter.com/share?url=http://www.dpegan.com/blog/?p=370&via=daniel_egan&text="Fooled by Compounding"&related=:&lang=en&count=horizontal" class="twitter-share-button">Tweet</a><script type="text/javascript" src="http://platform.twitter.com/widgets.js"></script></div><img src="http://feeds.feedburner.com/~r/OptimalBehavior/~4/sXD2oGmA8es" height="1" width="1"/>]]></content:encoded>
			<wfw:commentRss>http://www.dpegan.com/blog/?feed=rss2&amp;p=370</wfw:commentRss>
		<slash:comments>0</slash:comments>
		<feedburner:origLink>http://www.dpegan.com/blog/?p=370</feedburner:origLink></item>
		<item>
		<title>Unexpected Utility</title>
		<link>http://feedproxy.google.com/~r/OptimalBehavior/~3/c5TQx_n_SxY/</link>
		<comments>http://www.dpegan.com/blog/?p=373#comments</comments>
		<pubDate>Fri, 10 Feb 2012 12:37:39 +0000</pubDate>
		<dc:creator>Daniel Egan</dc:creator>
				<category><![CDATA[Uncategorized]]></category>

		<guid isPermaLink="false">http://www.dpegan.com/blog/?p=373</guid>
		<description><![CDATA[I believe unexpected utility* is one of the most under-researched ideas in behavioral finance and economics. I, for one, experience it occasionally, and it is the best kind of utility. What, exactly is &#8220;unexpected utility&#8221;? It&#8217;s an experience, usually and &#8230; <a href="http://www.dpegan.com/blog/?p=373">Continue reading <span class="meta-nav">&#8594;</span></a>]]></description>
			<content:encoded><![CDATA[<p>I believe <em>unexpected utility*</em> is one of the most under-researched ideas in behavioral finance and economics. I, for one, experience it occasionally, and it is the best kind of utility.</p>
<p>What, exactly is &#8220;unexpected utility&#8221;? It&#8217;s an experience, usually and hopefully positive, that you completely didn&#8217;t remotely see coming. The <em>expectation</em> is key here. Daniel Kahneman, in his recent book, uses the example that the same meal, when made by someone else, often tastes better. When you are making a meal, you are at some level pre-experiencing it &#8211; you think about what the ingredients will taste like, you are smelling them as you cook. By the time you actually eat you&#8217;ve actually experienced a reasonable amount of the meal.  Because we care much more about changes than we do levels, going from no-meal-experience to full-meal-experience, as you do in a restaurant, makes a much bigger impression.</p>
<p>It is one thing, for example, to enter into a prize draw for $100, and then win. At some level, you knew it was possible, and you&#8217;ve already thought about it, and at some level, experientially discounted it. Contrast that with finding $100 in the pocket of pants you haven&#8217;t worn for a while (yes, hard for me to imagine too). That would be much more happiness generating.</p>
<p>Because unexpected utility is so powerful, I really wish it was a bigger, more frequent part of our lives. If we all helped out someone who didn&#8217;t see it coming, for example, we&#8217;d probably make all of us quite a bit happier. If we set our lives up to have more unexpectedly good experiences (perhaps by doing safe, but novel things), we might end up surprisingly content.</p>
<p>Any ideas about how to encourage unexpected utility?</p>
<p>&#8212;&#8212;&#8212;&#8212;&#8212;&#8212;&#8212;&#8212;&#8212;&#8212;&#8212;&#8212;&#8211;</p>
<p>* The blog <a href="When someone else cooksyou get a real hit from the  " target="_blank">Unexpected Utility</a> is good as well&#8230; And what a great name!</p>
<div style="float: right; margin-left: 10px;"><a href="http://twitter.com/share?url=http://www.dpegan.com/blog/?p=373&via=daniel_egan&text=Unexpected Utility&related=:&lang=en&count=horizontal" class="twitter-share-button">Tweet</a><script type="text/javascript" src="http://platform.twitter.com/widgets.js"></script></div><img src="http://feeds.feedburner.com/~r/OptimalBehavior/~4/c5TQx_n_SxY" height="1" width="1"/>]]></content:encoded>
			<wfw:commentRss>http://www.dpegan.com/blog/?feed=rss2&amp;p=373</wfw:commentRss>
		<slash:comments>0</slash:comments>
		<feedburner:origLink>http://www.dpegan.com/blog/?p=373</feedburner:origLink></item>
		<item>
		<title>Why rebalance? A simple statistical story (part I)</title>
		<link>http://feedproxy.google.com/~r/OptimalBehavior/~3/WwB_Toel46Y/</link>
		<comments>http://www.dpegan.com/blog/?p=363#comments</comments>
		<pubDate>Thu, 09 Feb 2012 08:00:20 +0000</pubDate>
		<dc:creator>Daniel Egan</dc:creator>
				<category><![CDATA[Uncategorized]]></category>
		<category><![CDATA[Asset Allocation]]></category>
		<category><![CDATA[Behavior]]></category>
		<category><![CDATA[Portfolio]]></category>
		<category><![CDATA[R]]></category>
		<category><![CDATA[Rebalancing]]></category>

		<guid isPermaLink="false">http://www.dpegan.com/blog/?p=363</guid>
		<description><![CDATA[Once we have picked an asset allocation model, how often, or why should we rebalance? <a href="http://www.dpegan.com/blog/?p=363">Continue reading <span class="meta-nav">&#8594;</span></a>]]></description>
			<content:encoded><![CDATA[<p style="text-align: left;" align="center">Once we have picked an asset allocation model, how often, or why should we rebalance? I&#8217;ve seen multiple conflicting findings about the usefulness of rebalancing. Many such conflicts happen in time-series data because the sample you use can influence things quite strongly. I therefore wanted to see if there was a simple, purely statistical basis for rebalancing.</p>
<p>To do this, I simulated some pretty vanilla portfolios with the desired characteristics. Note that as this isn’t real data, it doesn’t have some of the finer characteristics of true returns data such as auto-correlation of volatility.</p>
<p>Method:</p>
<p>1. Create a portfolio of three assets, (mean returns= (0.01, 0.03, 0.06), vol=2x e(r), corrs=0.3). Weights=(0.4, 0.3, 0.3)</p>
<p>2. Simulate 300 such portfolios over 5 years, monthly periods.</p>
<p>3. Take the mean and volatility of these portfolios.</p>
<p>4. Vary the above by frequency of rebalancing  to the correct weights.</p>
<p>Results:</p>
<ol>
<li>The expected return goes up by not rebalancing. This is likely because without rebalancing, over time the higher expected return assets make up a larger proportion of the portfolio, which increases the expected returns overall.</li>
<li>However, the volatility of the portfolio goes up as you rebalance less frequently as well. In fact, it goes up faster, so that the return per volatility decreases.</li>
<li>The return/volatility decreases by about 0.3 per year you wait to rebalance. Nothing huge, but nothing to ignore either.</li>
</ol>
<p><a href="http://www.dpegan.com/blog/wp-content/uploads/2012/02/rebalancing.png"><img class="aligncenter size-full wp-image-364" title="Rebalancing" src="http://www.dpegan.com/blog/wp-content/uploads/2012/02/rebalancing.png" alt="Rebalancing" width="550" height="400" /></a></p>
<p>So on purely statistical grounds, rebalancing appears to be helpful. But can we improve upon this?</p>
<ol>
<li>We can specify thresholds which the individual asset classes shouldn’t breach, or when they do, we rebalance back at that point.</li>
<li>We can use recent market movements to indicate things which are expensive vs cheap, and purchase accordingly.</li>
</ol>
<p>Next time!</p>
<p><a href="http://www.dpegan.com/blog/simple_rebalancing.r" target="_blank"> R Code here</a></p>
<div style="float: right; margin-left: 10px;"><a href="http://twitter.com/share?url=http://www.dpegan.com/blog/?p=363&via=daniel_egan&text=Why rebalance? A simple statistical story (part I)&related=:&lang=en&count=horizontal" class="twitter-share-button">Tweet</a><script type="text/javascript" src="http://platform.twitter.com/widgets.js"></script></div><img src="http://feeds.feedburner.com/~r/OptimalBehavior/~4/WwB_Toel46Y" height="1" width="1"/>]]></content:encoded>
			<wfw:commentRss>http://www.dpegan.com/blog/?feed=rss2&amp;p=363</wfw:commentRss>
		<slash:comments>0</slash:comments>
		<feedburner:origLink>http://www.dpegan.com/blog/?p=363</feedburner:origLink></item>
		<item>
		<title>The problem with control groups in the real world</title>
		<link>http://feedproxy.google.com/~r/OptimalBehavior/~3/3tUCIdtxwt4/</link>
		<comments>http://www.dpegan.com/blog/?p=360#comments</comments>
		<pubDate>Tue, 07 Feb 2012 02:15:10 +0000</pubDate>
		<dc:creator>Daniel Egan</dc:creator>
				<category><![CDATA[Uncategorized]]></category>

		<guid isPermaLink="false">http://www.dpegan.com/blog/?p=360</guid>
		<description><![CDATA[A problem I occasionally encounter when trying to improve behaviour in the real world is the fairness of control groups. Imagine you have a potential cure for a problem, but you have no proof that it actually works. A standard &#8230; <a href="http://www.dpegan.com/blog/?p=360">Continue reading <span class="meta-nav">&#8594;</span></a>]]></description>
			<content:encoded><![CDATA[<p>A problem I occasionally encounter when trying to improve behaviour in the real world is the fairness of control groups. Imagine you have a potential cure for a problem, but you have no proof that it actually works. A standard experiment would randomly allocate individuals to treatment and control conditions, run the experiment for a set period of time, and compare outcome variables. You’d then know if there was a strong effect.</p>
<p>However, suppose the treatment turns out to be effective. Those individuals who did not receive it- control group &#8211; could claim that they had been treated unfairly, as others received a potential benefit which they did not. The fact that the treatment was suspected to improve outcomes is sufficient to indicate that an unfair advantage was being conferred, despite the fact that it was not yet <em>known</em> to be effective.</p>
<p>Sometimes, not always, this fear works against our ability to create new knowledge, and definitively improve outcomes. A business confronted by such a prospect might have the following thoughts:</p>
<p>-          This might improve our clients’ outcomes, but we have no proof.</p>
<p>-          If we run an experiment, those people in the control might feel they have been treated unfairly, and either stop being customers, or even worse, sue us.</p>
<p>-          We’d therefore have to give it to everyone.</p>
<p>-          But then we’d have no proof that it helped.</p>
<p>-          Let’s just not do it.</p>
<p>Note that in this case, no-one benefits from the potential improvement.</p>
<p>I’ve been surprised how often this chain of thought is worked through, and the odds seem 50/50 that they come out this way. It takes more courage to find the truth than to continue with the status quo.</p>
<p>Related: <a href="http://www.johndcook.com/blog/2008/08/05/subjecting-fewer-patients-to-ineffective-treatments/">Subjecting fewer patients to ineffective treatments</a></p>
<p class="MsoNormal">A problem I occasionally encounter when trying to improve behaviour in the real world is the fairness issues around control groups. Imagine you have a potential cure for a problem, but you have no proof that it actually works. A standard experiment would randomly allocate individuals to treatment and control conditions, run the experiment for a set period of time, and compare outcome variables. You’d then know if there was a strong effect.</p>
<p class="MsoNormal">However, suppose the treatment turns out to be effective. Those individuals who did not receive it- control group &#8211; could claim that they had been treated unfairly, as others received a potential benefit which they did not. The fact that the treatment was suspected to improve outcomes is sufficient to indicate that an unfair advantage was being conferred, despite the fact that it was not yet <em>known</em> to be effective.</p>
<p class="MsoNormal">Sometimes, not always, this fear works against our ability to create new knowledge, and definitively improve outcomes. A business confronted by such a prospect might have the following thoughts:</p>
<p class="MsoListParagraphCxSpFirst" style="text-indent: -18.0pt; mso-list: l0 level1 lfo1;"><!--[if !supportLists]-->-<span style="font: 7.0pt 'Times New Roman';">          </span><!--[endif]-->This might improve our clients’ outcomes, but we have no proof.</p>
<p class="MsoListParagraphCxSpMiddle" style="text-indent: -18.0pt; mso-list: l0 level1 lfo1;"><!--[if !supportLists]-->-<span style="font: 7.0pt 'Times New Roman';">          </span><!--[endif]-->If we run an experiment, those people in the control might feel they have been treated unfairly, and either stop being customers, or even worse, sue us.</p>
<p class="MsoListParagraphCxSpMiddle" style="text-indent: -18.0pt; mso-list: l0 level1 lfo1;"><!--[if !supportLists]-->-<span style="font: 7.0pt 'Times New Roman';">          </span><!--[endif]-->We’d therefore have to give it to everyone.</p>
<p class="MsoListParagraphCxSpMiddle" style="text-indent: -18.0pt; mso-list: l0 level1 lfo1;"><!--[if !supportLists]-->-<span style="font: 7.0pt 'Times New Roman';">          </span><!--[endif]-->But then we’d have no proof that it helped.</p>
<p class="MsoListParagraphCxSpLast" style="text-indent: -18.0pt; mso-list: l0 level1 lfo1;"><!--[if !supportLists]-->-<span style="font: 7.0pt 'Times New Roman';">          </span><!--[endif]-->Let’s just not do it.</p>
<p class="MsoNormal">Note that in this case, no-one benefits from the potential improvement.</p>
<p class="MsoNormal">I’ve been surprised how often this chain of thought is worked through, and the odds seem 50/50 that they come out this way. It takes more courage to find the truth than to continue with the status quo.</p>
<p class="MsoNormal">Related: <a href="http://www.johndcook.com/blog/2008/08/05/subjecting-fewer-patients-to-ineffective-treatments/">Subjecting fewer patients to ineffective treatments</a></p>
<div style="float: right; margin-left: 10px;"><a href="http://twitter.com/share?url=http://www.dpegan.com/blog/?p=360&via=daniel_egan&text=The problem with control groups in the real world&related=:&lang=en&count=horizontal" class="twitter-share-button">Tweet</a><script type="text/javascript" src="http://platform.twitter.com/widgets.js"></script></div><img src="http://feeds.feedburner.com/~r/OptimalBehavior/~4/3tUCIdtxwt4" height="1" width="1"/>]]></content:encoded>
			<wfw:commentRss>http://www.dpegan.com/blog/?feed=rss2&amp;p=360</wfw:commentRss>
		<slash:comments>0</slash:comments>
		<feedburner:origLink>http://www.dpegan.com/blog/?p=360</feedburner:origLink></item>
		<item>
		<title>Forecasting extremes on the S&amp;P500</title>
		<link>http://feedproxy.google.com/~r/OptimalBehavior/~3/AQBAdtRJeyc/</link>
		<comments>http://www.dpegan.com/blog/?p=349#comments</comments>
		<pubDate>Sat, 04 Feb 2012 23:41:29 +0000</pubDate>
		<dc:creator>Daniel Egan</dc:creator>
				<category><![CDATA[Uncategorized]]></category>

		<guid isPermaLink="false">http://www.dpegan.com/blog/?p=349</guid>
		<description><![CDATA[I’m occasionally participating in an on-going forecasting competition (Forecast World Events), and the financial forecasts in particular are interesting. Today I received a request for a forecast relating to the S&#38;P500: What will be the largest single-day GAIN or LOSS &#8230; <a href="http://www.dpegan.com/blog/?p=349">Continue reading <span class="meta-nav">&#8594;</span></a>]]></description>
			<content:encoded><![CDATA[<p>I’m occasionally participating in an on-going forecasting competition (<a href="http://forecastwe.org/" target="_blank">Forecast World Events</a>), and the financial forecasts in particular are interesting. Today I received a request for a forecast relating to the S&amp;P500:</p>
<blockquote><p>What will be the largest single-day GAIN or LOSS for any trading day between 2012-2-06 and 2012-02-10?</p>
<p>Allocate 100% probability across these categories:</p>
<ol>
<li>&lt;1%</li>
<li>1% to 1.99%</li>
<li>2% to 2.99%</li>
<li>3% or more</li>
</ol>
</blockquote>
<p>The status right now is below:</p>
<p><a href="http://www.dpegan.com/blog/wp-content/uploads/2012/02/consensus.png"><img class="aligncenter size-full wp-image-356" title="consensus" src="http://www.dpegan.com/blog/wp-content/uploads/2012/02/consensus.png" alt="" width="698" height="643" /></a></p>
<p>&nbsp;</p>
<p>Unless you have very precise estimates of what will happen over the next 5 trading day, a good estimate would come from history. So using the<a href="http://cran.r-project.org/" target="_blank"> incredibly convenient R </a>program (code below), I pulled historical data on the S&amp;P500. We can check this question in history a couple of ways:</p>
<ol>
<li>Using all week periods since 1980</li>
<li>Using all week periods in February since 1980</li>
</ol>
<p>The results are surprisingly consistent with history. As of Feb 4, 2012, the consensus was expecting the upcoming week to be more volatile than history, with double the odds of seeing a 3%+ movement up or down, and double odds of a movement between 2 and 3%. The modal historical outcome of between 1% and 2% is underweight by about 13%, not a massive difference.</p>
<p><a href="http://www.dpegan.com/blog/wp-content/uploads/2012/02/forecast2.png"><img class="aligncenter size-full wp-image-355" title="forecast" src="http://www.dpegan.com/blog/wp-content/uploads/2012/02/forecast2.png" alt="" width="488" height="294" /></a></p>
<p>What would be interesting is seeing how “common” this view is, i.e. is the consistency with history because the majority of people are close to history, or are a majority of extreme positions cancelling each other out?</p>
<p>&nbsp;</p>
<p>R Code:</p>
<pre lang="”rsplus”">rm(list=ls())
install.packages(quantmod)
library(quantmod)&lt;
sp500&lt;- getSymbols("^GSPC",auto.assign=FALSE,from="1980-01-01")
rets&lt;-periodReturn(sp500,period="daily")
cat.rets&lt;-as.data.frame(rets)
str(cat.rets)
cat.rets$ret.cat=NA
cat.rets$ret.cat[abs(cat.rets$daily.returns)&lt;0.01]=1
cat.rets$ret.cat[abs(cat.rets$daily.returns)&gt;=0.01]=2
cat.rets$ret.cat[abs(cat.rets$daily.returns)&gt;=0.02]=3
cat.rets$ret.cat[abs(cat.rets$daily.returns)&gt;=0.03]=4
cat.rets$year&lt;-as.POSIXlt(as.POSIXct(strptime(as.character(row.names(cat.rets)),format="%Y-%m-%d")))$year+1900
table(cat.rets$year,cat.rets$ret.cat)

cat.rets$dow&lt;-cat.rets$dow&lt;-as.POSIXlt(as.POSIXct(strptime(as.character(row.names(cat.rets)),format="%Y-%m-%d")))$wday
#Using Monday as anchor, define greatest return over the next 5 days

cat.rets$max.week.ret&lt;-NA
for (i in 1:nrow(cat.rets)) {
  if (cat.rets$dow[i]==1) {
    j=i+5
    cat.rets$max.week.ret[i]&lt;-max(cat.rets$ret.cat[i:j],na.rm=TRUE)
  }
  else next
}

table(cat.rets$max.week.ret)
prop.table(table(cat.rets$max.week.ret))

################################
#Just Februaries
nrow(cat.rets)
cat.rets$month&lt;-as.POSIXlt(as.POSIXct(strptime(as.character(row.names(cat.rets)),format="%Y-%m-%d")))$mon
table(cat.rets$month)

cat.rets$max.feb.week.ret&lt;-NA
for (i in 1:nrow(cat.rets)) {
  if (cat.rets$month[i]!=1) {
  if (cat.rets$dow[i]==1) {
    j=i+5
    cat.rets$max.feb.week.ret[i]&lt;-max(cat.rets$ret.cat[i:j],na.rm=TRUE)
  }
  }
  else next
}
row.names(probabilities)&lt;-c("&lt;1%","1-2%","2-3%","&gt;=3%")
prop.table(table(cat.rets$max.feb.week.ret))
probabilities&lt;- cbind(c(.13,.37,.32,.18),prop.table(table(cat.rets$max.week.ret)),prop.table(table(cat.rets$max.feb.week.ret)))</pre>
<div style="float: right; margin-left: 10px;"><a href="http://twitter.com/share?url=http://www.dpegan.com/blog/?p=349&via=daniel_egan&text=Forecasting extremes on the S&P500&related=:&lang=en&count=horizontal" class="twitter-share-button">Tweet</a><script type="text/javascript" src="http://platform.twitter.com/widgets.js"></script></div><img src="http://feeds.feedburner.com/~r/OptimalBehavior/~4/AQBAdtRJeyc" height="1" width="1"/>]]></content:encoded>
			<wfw:commentRss>http://www.dpegan.com/blog/?feed=rss2&amp;p=349</wfw:commentRss>
		<slash:comments>2</slash:comments>
		<feedburner:origLink>http://www.dpegan.com/blog/?p=349</feedburner:origLink></item>
		<item>
		<title>When winning is losing</title>
		<link>http://feedproxy.google.com/~r/OptimalBehavior/~3/8wO3k0lYLl0/</link>
		<comments>http://www.dpegan.com/blog/?p=347#comments</comments>
		<pubDate>Wed, 01 Feb 2012 01:08:04 +0000</pubDate>
		<dc:creator>Daniel Egan</dc:creator>
				<category><![CDATA[Uncategorized]]></category>

		<guid isPermaLink="false">http://www.dpegan.com/blog/?p=347</guid>
		<description><![CDATA[An article in the most recent JDM makes two valuable points – sometimes winning is losing, and we’re ok with that. Some individuals are more likely to over-bid, purchasing a lottery for more than it’s best possible value. Why might &#8230; <a href="http://www.dpegan.com/blog/?p=347">Continue reading <span class="meta-nav">&#8594;</span></a>]]></description>
			<content:encoded><![CDATA[<p style="text-align: left;" align="center"><a href="http://journal.sjdm.org/11/11331/jdm11331.pdf">An article</a> in the most recent JDM makes two valuable points – sometimes winning is losing, and we’re ok with that. Some individuals are more likely to over-bid, purchasing a lottery for more than it’s best possible value. Why might they do this? Because to some people, very competitive people, it seems that “winning” is as (more?)  important than making a genuine profit.</p>
<p style="text-align: left;">This effect is probably reinforced in circumstances that meet the <a href="http://en.wikipedia.org/wiki/Winner's_curse">Winners Curse</a>, in which optimism about ones incomplete information is compounded by a desire to “win”. The very word winning has such positive connotations, how could we not want to win an auction?</p>
<p>For some people, the joy of winning is worth over-paying. And these are the people you DEFINITELY want to invite to your poker game.</p>
<div style="float: right; margin-left: 10px;"><a href="http://twitter.com/share?url=http://www.dpegan.com/blog/?p=347&via=daniel_egan&text=When winning is losing&related=:&lang=en&count=horizontal" class="twitter-share-button">Tweet</a><script type="text/javascript" src="http://platform.twitter.com/widgets.js"></script></div><img src="http://feeds.feedburner.com/~r/OptimalBehavior/~4/8wO3k0lYLl0" height="1" width="1"/>]]></content:encoded>
			<wfw:commentRss>http://www.dpegan.com/blog/?feed=rss2&amp;p=347</wfw:commentRss>
		<slash:comments>0</slash:comments>
		<feedburner:origLink>http://www.dpegan.com/blog/?p=347</feedburner:origLink></item>
		<item>
		<title>In praise of calorie counting</title>
		<link>http://feedproxy.google.com/~r/OptimalBehavior/~3/hIGzKEnCGsk/</link>
		<comments>http://www.dpegan.com/blog/?p=343#comments</comments>
		<pubDate>Sun, 29 Jan 2012 15:26:24 +0000</pubDate>
		<dc:creator>Daniel Egan</dc:creator>
				<category><![CDATA[Uncategorized]]></category>

		<guid isPermaLink="false">http://www.dpegan.com/blog/?p=343</guid>
		<description><![CDATA[The second half of last year was not kind to my waistline. Between getting married and leaving the UK there were many causes for dinners and drinks out, which always seem to be less healthy than those at home. So &#8230; <a href="http://www.dpegan.com/blog/?p=343">Continue reading <span class="meta-nav">&#8594;</span></a>]]></description>
			<content:encoded><![CDATA[<p>The second half of last year was not kind to my waistline. Between getting married and leaving the UK there were many causes for dinners and drinks out, which always seem to be less healthy than those at home. So when I got settled in the US, I was very disappointed to see I was about 20lbs (1.5 stones, or 9kg)  overweight.</p>
<p>However, unlike many problems in life, that problem is simple, very solvable and controllable. If you want to lose weight, you must expend more calories than you consume. In many ways, it is like a financial budget &#8211; if you want to save (lose weight), you must spend (eat) less than you earn (expend). This is not to say it is always <em>easy</em>, but is is straightforward and doable.</p>
<p>However, how do we track how many calories we consume, and how many we expend? This has historically been the biggest problem with calorie counting diets &#8211; they tended to be very imprecise in both foods, and exercise. Many diet programs were based on eating specific foods so that you knew exactly how many calories you consumed. But now, we have a wide variety of applications which can help us to keep track of our calories, both consumed and expended. As an android phone user, I use <a href="http://www.myfitnesspal.com/" target="_blank">MyFitnessPal </a>to keep track of calories. I&#8217;ve rarely not been able to find the food I was looking for in it.</p>
<p>And these programs lead us to understand exactly the trade-offs we need to make. To lose 1.5 lbs/week, I need to consume, net of exercise, 1520 calories. This doesn&#8217;t mean I only eat 1520 calories though &#8211; it means I can earn more by exercising. It makes explicit the fact that if I want to drink another beer I need to run for at least 10 minutes. So a night out on the town will cost me about an hour of exercise, which seems like a good deal in both ways. The fact that the approach of<a href="http://www.npr.org/blogs/thesalt/2011/12/16/143790349/exercise-info-not-calorie-counts-helps-teens-drop-sodas" target="_blank"> equating food to exercise</a> has beneficial effects therefore doesn&#8217;t surprise me.</p>
<p>In this way, calorie counting is actually quite useful and allows me to know precisely how much I can eat, or how much I need to exercise at the end of the day. The fact that these trade-offs are made explicit what makes it difficult for us. I have to decide between <em>both</em> drinking a beer and doing 10 min. more exercise, or not doing either.</p>
<p>Because trade-offs are uncomfortable, people seek to trick themselves into this behavior without explicitly counting calories.  They use diets such as only eating meat, eating only during certain hours or the day, or only eat certain foods so that they can achieve exactly the same thing. Almost all forms of diets seek to restrict caloric consumption. Some of them do seek to change your metabolism as well, however at the end of the day if you are losing weight you are doing it by expending more calories than you consume.</p>
<p>This is a clear case the difficulty lying not in knowing<em> what</em> to do, but simply doing it.</p>
<p>However, contrast those budget trade-offs with alcohol consumption. I have no way to earn more alcohol units. I cannot exercise or do any other virtuous behavior the results in being able to drink more and maintain my health. Simply put there is a natural limit which I have no ability to increase. Now being able to make those calorie trade-offs seems great. I have the ability to earn more.</p>
<div style="float: right; margin-left: 10px;"><a href="http://twitter.com/share?url=http://www.dpegan.com/blog/?p=343&via=daniel_egan&text=In praise of calorie counting&related=:&lang=en&count=horizontal" class="twitter-share-button">Tweet</a><script type="text/javascript" src="http://platform.twitter.com/widgets.js"></script></div><img src="http://feeds.feedburner.com/~r/OptimalBehavior/~4/hIGzKEnCGsk" height="1" width="1"/>]]></content:encoded>
			<wfw:commentRss>http://www.dpegan.com/blog/?feed=rss2&amp;p=343</wfw:commentRss>
		<slash:comments>0</slash:comments>
		<feedburner:origLink>http://www.dpegan.com/blog/?p=343</feedburner:origLink></item>
	</channel>
</rss>

