<?xml version="1.0" encoding="UTF-8"?><rss version="2.0"
	xmlns:content="http://purl.org/rss/1.0/modules/content/"
	xmlns:wfw="http://wellformedweb.org/CommentAPI/"
	xmlns:dc="http://purl.org/dc/elements/1.1/"
	xmlns:atom="http://www.w3.org/2005/Atom"
	xmlns:sy="http://purl.org/rss/1.0/modules/syndication/"
	xmlns:slash="http://purl.org/rss/1.0/modules/slash/"
	>

<channel>
	<title>Visualab</title>
	<atom:link href="http://www.visualab.org/index.php/feed" rel="self" type="application/rss+xml" />
	<link>http://www.visualab.org</link>
	<description>Of Math and Travelling</description>
	<lastBuildDate>Mon, 14 Jan 2019 13:50:37 +0000</lastBuildDate>
	<language>en-US</language>
	<sy:updatePeriod>hourly</sy:updatePeriod>
	<sy:updateFrequency>1</sy:updateFrequency>
	<generator>https://wordpress.org/?v=5.0.3</generator>
	<item>
		<title>Maxwell Demon – Extracting Energy from a System</title>
		<link>http://www.visualab.org/index.php/maxwell-demon-extracting-energy</link>
		<comments>http://www.visualab.org/index.php/maxwell-demon-extracting-energy#respond</comments>
		<pubDate>Thu, 10 Jan 2019 22:32:20 +0000</pubDate>
		<dc:creator><![CDATA[Mario Alemi]]></dc:creator>
				<category><![CDATA[Entropy]]></category>
		<category><![CDATA[information]]></category>
		<category><![CDATA[physics]]></category>

		<guid isPermaLink="false">http://www.visualab.org/?p=773</guid>
		<description><![CDATA[<p>Energy and thermodynamics Maxwell's demon is famous for threatening the second law of thermodynamics. But does it? Here we will look at Maxwell original writing, and how we can interpret Maxwell's thought experiment. Thermodynamics is the branch of physics that deals with energy management. Thermodynamics, like all other branches of science, identifies laws that we [&#8230;]</p>
<p>The post <a rel="nofollow" href="http://www.visualab.org/index.php/maxwell-demon-extracting-energy">Maxwell Demon – Extracting Energy from a System</a> appeared first on <a rel="nofollow" href="http://www.visualab.org">Visualab</a>.</p>
]]></description>
				<content:encoded><![CDATA[
<h3>Energy and thermodynamics</h3>



<p>Maxwell's demon is famous for threatening the second law of thermodynamics. But does it? Here we will look at Maxwell original writing, and how we can interpret Maxwell's thought experiment.</p>



<p>Thermodynamics is the branch of physics that deals with energy management. Thermodynamics, like all other branches of science, identifies laws that we believe nature must abide by. Without a doubt, the most important law of thermodynamics, is the second.<br></p>



<p>There are various statements that derive from the second law. The simplest and most intuitive of these states that<strong> it is impossible for a heat engine to produce energy if it exchanges heat only with bodies at a single fixed temperature.</strong><br></p>



<p>To understand the second law, let us consider a simple engine, consisting of two heat reservoirs and a piston in a cylinder full of air. Imagine one moves the piston from one reservoir to the other. If the reservoirs are at different temperatures, the air in the cylinder expands and contracts. This drives the piston up and down, just like a piston in a steam engine or an internal combustion engine.</p>



<p>But if the two reservoirs are at a single fixed temperature, the volume of the gas is the same. This means the piston does not move up and down when we move the cylinder. If someone could invent a way to produce energy using such a system, they’d have solved humanity’s energy problems. We could in fact take two points in the sea and use them as "reservoirs". In this way, we could transform part of the thermal energy stored in the ocean into mechanical energy.<br></p>



<p>The second law of thermodynamics states that this is impossible. <br></p>



<p>But is it?</p>



<h3>The little demon</h3>



<p>In the late 1800s, Clerk Maxwell was laying the cornerstones of physics.  But he also appeared to challenge the second law in a "thought” experiment. Maxwell does not speak about a demon in reality, and winds up his “Theory of heat” as follows:</p>



<p>“… the second law of thermodynamics … is undoubtedly true as long as we can deal with bodies only in mass, and have no power of perceiving or handling the separate molecules of which they are made up. But if we conceive a being whose faculties are so sharpened that he can follow every molecule in its course, such a being, whose attributes are still as essentially finite as our own, would be able to do what is at present impossible to us. </p>



<p>For we have seen that the molecules in a vessel full of air at uniform temperature are moving with velocities by no means uniform, though the mean velocity of any great number of them, arbitrarily selected, is almost exactly uniform. Now let us suppose that such a vessel is divided into two portions, A and B, by a division in which there is a small hole, and that a being, who can see the individual molecules, opens and closes this hole, so as to allow only the swifter molecules to pass from A to B, and only the slower ones to pass from B to A. He will thus, without expenditure of work, raise the temperature of B and lower that of A, in contradiction to the second law of thermodynamics.”<br></p>



<p>Maxwell concludes by explaining that his theory does not necessarily clash with the laws of thermodynamics: “This is<em> only one of the instances</em> in which conclusions which we have drawn from our experience of bodies consisting of an immense number of molecules may be found not to be applicable to the more delicate observations and experiments which we may suppose are made by one who can perceive and handle the individual molecules”<br></p>



<h3>Maxwell and Socrates' demons</h3>



<p>In practice, Maxwell says: "We cannot know the velocity of each molecule. Therefore the second law is valid for the macroscopic world". The second law is a “statistical” law. It is valid if we consider many molecules as if they were one single body. We use statistical instruments because we do not have sufficient information on the position of each single molecule. We are ignorant.<br></p>



<p>But you won’t find many who agree with this. Maxwell’s door-opening being was called a “demon”, a very appropriate name. The city accused Socrates of believing more in his own personal demons than in the Gods. Maxwell was attacked merely for having dared to imagine his demon challenging the "divine laws" of thermodynamics. </p>



<p>In reality, Maxwell was only recognising his (and our) ignorance. And like Socrates was attacked for that: the city indeed accused Socrates of believing what the oracle of Delphi said, that he was the wisest of all men. And he explained he actually believed he was the wisest because he was the only one recognising and accepting his own ignorance: "I am better off than he [a conceited politician] is - for he knows nothing, and thinks that he knows. I neither know nor think that I know. In this latter particular, then, I seem to have slightly the advantage of him".</p>



<h3>Attacking the demon</h3>



<p> On 28 February 1879, Lord Kelvin gave a lesson at the Royal Institution. Soon later, the American Popular Science Monthly published this editorial: “There is a certain class of minds whose efforts to explain things generally leave them more obscure than they were before. … A marked illustration of this is afforded by a lecture delivered … by the eminent physicist and mathematician, Sir William Thomson [Lord of Kelvin], who announced as his topic of discourse the <em>curious subject</em>, ‘Maxwell's Sorting Demons.’”<br></p>



<p>The editor of the American monthly, today published as Popular Science, didn’t really understand Kelvin’s lesson. He thought Maxwell used the demon to explain diffusion processes. ??. <br></p>



<p>In his confused interpretation, the editor stumbled on something that scientists later connected to the demon: the demon had a hand in “the origin of terrestrial life”.</p>



<p>The concept of the demon, in fact, seems to suggest that the origin of life derived from the capacity to take another approach to nature and therefore extract energy in ways in which other, less capable beings, had failed.<br></p>



<p>But how can this have been possible? Does the second law only apply to us, but not to microscopic life forms?<br></p>



<p>It was actually the concept of entropy that required more in-depth study, and Maxwell’s note on the differences between macroscopic and microscopic is crucial.</p>



<p>Entropy and probability: what is the connection? (future post)</p>
<p>The post <a rel="nofollow" href="http://www.visualab.org/index.php/maxwell-demon-extracting-energy">Maxwell Demon – Extracting Energy from a System</a> appeared first on <a rel="nofollow" href="http://www.visualab.org">Visualab</a>.</p>
]]></content:encoded>
			<wfw:commentRss>http://www.visualab.org/index.php/maxwell-demon-extracting-energy/feed</wfw:commentRss>
		<slash:comments>0</slash:comments>
		</item>
		<item>
		<title>Mille miliardi di persone</title>
		<link>http://www.visualab.org/index.php/mille-miliardi-di-persona-sul-pianeta</link>
		<comments>http://www.visualab.org/index.php/mille-miliardi-di-persona-sul-pianeta#respond</comments>
		<pubDate>Sun, 04 Nov 2018 18:52:13 +0000</pubDate>
		<dc:creator><![CDATA[Mario Alemi]]></dc:creator>
				<category><![CDATA[Articles]]></category>
		<category><![CDATA[antropologia]]></category>

		<guid isPermaLink="false">http://www.visualab.org/?p=741</guid>
		<description><![CDATA[<p>Quanta energia usa l'umanità? Non ci vuole matematica avanzata: così com'è, l'essere umano è lontano dalla sostenibilità. La quantità di energia disponibile non è sufficiente a sostenere la società tecnologica. La potenza (energia per unità di tempo) media usata dagli esseri umani, watt, è un decimillesimo di quanto arriva sulla terra, watt. Può sembrare poco, [&#8230;]</p>
<p>The post <a rel="nofollow" href="http://www.visualab.org/index.php/mille-miliardi-di-persona-sul-pianeta">Mille miliardi di persone</a> appeared first on <a rel="nofollow" href="http://www.visualab.org">Visualab</a>.</p>
]]></description>
				<content:encoded><![CDATA[<h3>Quanta energia usa l'umanità?</h3>
<p>Non ci vuole matematica avanzata: così com'è, l'essere umano è lontano dalla sostenibilità. La quantità di energia disponibile non è sufficiente a sostenere la società tecnologica.</p>
<p><span style="font-weight: 400;">La potenza (energia per unità di tempo) media usata dagli esseri umani, <span class='MathJax_Preview'><img src='http://www.visualab.org/wp-content/plugins/latex/cache/tex_084368c26a89111dd49de57d6b473bb0.gif' style='vertical-align: middle; border: none; ' class='tex' alt="1.8\cdot 10^{13}" /></span><script type='math/tex'>1.8\cdot 10^{13}</script> watt</span><span style="font-weight: 400;">, è un decimillesimo di quanto arriva sulla terra, <span class='MathJax_Preview'><img src='http://www.visualab.org/wp-content/plugins/latex/cache/tex_deb896cf47de9ba7329f2186caf1209b.gif' style='vertical-align: middle; border: none; ' class='tex' alt="1.6\cdot 10^{17}" /></span><script type='math/tex'>1.6\cdot 10^{17}</script> watt. Può sembrare poco, ma non lo è. Gli organismi che trasformano l'energia solare in energia "da bruciare" (petrolio, legno, carbone, gas etc) assorbono, sia pure molto approssimativamente, il 5% dell'energia solare (Hall, 1999)</span><span style="font-weight: 400;">, quindi noi assorbiamo il 2 per mille di quello che viene effettivamente assorbito dalle piante. </span></p>
<p><span style="font-weight: 400;">Sembrerebbe sostenibile. Ma. Considerando che buona parte di questa energia da sintesi clorofilliana non viene usata nella sintesi di combustibili (carboidrati), si stima che consumiamo dal 30 al 40% dell'energia che, attraverso le piante, entra a far parte della catena alimentare del pianeta (Christian, 2011).</span></p>
<p>Altro che sostenibilità:<span style="font-weight: 400;"> siamo di gran lunga oltre il limite della sostenibilità. La nostra sopravvivenza è possibile nel breve periodo –qualche secolo– solo perché stiamo consumando gli idrocarburi fossili, le fonti appunto non rinnovabili.</span></p>
<h3>Il sapiens e la formica</h3>
<p><span style="font-weight: 400;">La quantità di energia che l'</span><i><span style="font-weight: 400;">Homo sapiens</span></i><span style="font-weight: 400;"> estrae dall'ambiente è enorme, soprattutto se comparata ad altre forme di vita. </span></p>
<p><span style="font-weight: 400;">Un formicaio di 60 kg, il peso medio di una persona, consumerebbe quasi 10.000 chilocalorie al giorno (Macom, 1995) –più delle 1.500 che consumiamo in cibo. </span></p>
<p><span style="font-weight: 400;">Detto con altre unità di misura, noi consumiamo come una lampadina di 100 watt scarsi, un formicaio del nostro peso come una da 500 watt. Il singolo umano consuma meno del superorganismo composto da formiche.</span></p>
<p><span style="font-weight: 400;">Ma se andiamo a guardare l'organizzazione umana, i numeri cambiano radicalmente. Le società umane consumano –in energia elettrica, combustibili etc– <span class='MathJax_Preview'><img src='http://www.visualab.org/wp-content/plugins/latex/cache/tex_084368c26a89111dd49de57d6b473bb0.gif' style='vertical-align: middle; border: none; ' class='tex' alt="1.8\cdot 10^{13}" /></span><script type='math/tex'>1.8\cdot 10^{13}</script> watt.</span></p>
<p><span style="font-weight: 400;"> Questo vuol dire, considerando una popolazione al 2012 di 7 miliardi di persone, quasi 2.500 watt a testa. Cinque volte le formiche e ben 25 volte una singola persona. </span></p>
<h3>Perché pesiamo come 1000 miliardi</h3>
<p><span style="font-weight: 400;">Consideriamo solo l'Unione Europea a 28. Nel 2016 abbiamo consumato una potenza media di 4.300 watt a testa</span><span style="font-weight: 400;">. In pratica, un </span><i><span style="font-weight: 400;">sapiens</span></i><span style="font-weight: 400;"> europeo oggi richiede all'ambiente quasi quanto 50 </span><i><span style="font-weight: 400;">sapiens</span></i><span style="font-weight: 400;"> arcaici. </span></p>
<p><span style="font-weight: 400;">Detto in altri termini, <strong>dal punto di vista dello sfruttamento dell'ambiente</strong> è come se i primi colonizzatori del continente, i cosiddetti "European early modern humans", identificati normalmente con i <strong>Cro-Magnon</strong>, si fossero moltiplicati fino a raggiungere una popolazione di<strong> 25 miliardi in Europa</strong>, e non il mezzo miliardo effettivo.</span></p>
<p><span style="font-weight: 400;">Su scala mondiale, considerando che si stima che arriveremo ad plateau demografico di 20 miliardi di individui, se il consumo di energia pro capite in tutto il mondo sarà vicino a quello europeo,<strong> peseremo sul pianeta come mille miliardi di individui.</strong></span></p>
<h3>Homo sapiens: abbiamo davvero avuto successo?</h3>
<p><span style="font-weight: 400;">Negli ultimi centomila anni, l'</span><i><span style="font-weight: 400;">Homo sapiens</span></i><span style="font-weight: 400;"> ha modificato il pianeta tanto da far proporre alla presente era geologica il nome di </span><i><span style="font-weight: 400;">antropocene.</span></i><span style="font-weight: 400;"> In pratica, l'uomo dice che è tanto importante da poter intitolare una sua creazione a se stesso... </span></p>
<p><span style="font-weight: 400;">Forse abbiamo ragione.  Ma </span><span style="font-weight: 400;">dal punto di vista della quantità di biomassa presente sulla terra l'</span><i><span style="font-weight: 400;">Homo sapiens</span></i><span style="font-weight: 400;"> non è poi così speciale: esseri umani e formiche nella loro totalità pesano più lo stesso. </span></p>
<p><span style="font-weight: 400;">Anche il punto di vista del "<strong>gene egoista</strong>" lascia un po' a desiderare. In termini numerici, il nostro DNA rappresenta un infinitesimo di tutte le catene genetiche presenti, e come se non bastasse siamo forse noi più dipendenti dai batteri che ospitiamo (dieci per ogni cellula con DNA "puro") che non viceversa.</span></p>
<p><a href="http://www.visualab.org/wp-content/uploads/F1.large_.jpg"><img class="wp-image-743" src="http://www.visualab.org/wp-content/uploads/F1.large_-300x117.jpg" alt="I mammiferi rappresentano una infima parte della biomassa terrestre." width="620" height="241" srcset="http://www.visualab.org/wp-content/uploads/F1.large_-300x117.jpg 300w, http://www.visualab.org/wp-content/uploads/F1.large_-768x300.jpg 768w, http://www.visualab.org/wp-content/uploads/F1.large_-1024x400.jpg 1024w, http://www.visualab.org/wp-content/uploads/F1.large_.jpg 1280w" sizes="(max-width: 620px) 100vw, 620px" /></a> Quantità di biomassa per diverse forme di vita. (Bar-On, 2018).</p>
<p><span style="font-weight: 400;">Quello che al momento ci rende unici è, appunto, l'impatto che abbiamo sul pianeta grazie alla quantità di energia che manipoliamo.</span></p>
<p>(Bar-On, 2018) Bar-On, Y. M., Phillips, R., &amp; Milo, R. (2018). The biomass distribution on Earth. Proceedings of the National Academy of Sciences, 115(25), 6506–6511.</p>
<p>(Christian, 2011) Christian, D. (2011). Maps of time: An introduction to big history. University of California Press.</p>
<p>(Macom, 1995) Macom, T. E., &amp; Porter, S. D. (1995). Food and energy requirements of laboratory fire ant colonies (Hymenoptera: Formicidae). Environmental Entomology, 24(2), 387-391.</p>
<p>The post <a rel="nofollow" href="http://www.visualab.org/index.php/mille-miliardi-di-persona-sul-pianeta">Mille miliardi di persone</a> appeared first on <a rel="nofollow" href="http://www.visualab.org">Visualab</a>.</p>
]]></content:encoded>
			<wfw:commentRss>http://www.visualab.org/index.php/mille-miliardi-di-persona-sul-pianeta/feed</wfw:commentRss>
		<slash:comments>0</slash:comments>
		</item>
		<item>
		<title>What&#039;s the memory capacity of human brains in bytes?</title>
		<link>http://www.visualab.org/index.php/memory-capacity-of-human-brains-in-bytes</link>
		<comments>http://www.visualab.org/index.php/memory-capacity-of-human-brains-in-bytes#respond</comments>
		<pubDate>Wed, 30 Aug 2017 18:49:26 +0000</pubDate>
		<dc:creator><![CDATA[Mario Alemi]]></dc:creator>
				<category><![CDATA[Articles]]></category>

		<guid isPermaLink="false">http://www.visualab.org/?p=347</guid>
		<description><![CDATA[<p>Some people think that our brain information storage capacity comes from  merely switching on and off neurons or synapses. It's not like that. Our brain is a network, and networks store information through different configurations of the relationships between nodes. Although the entropy (and therefore the amount of information stored) of a network can be [&#8230;]</p>
<p>The post <a rel="nofollow" href="http://www.visualab.org/index.php/memory-capacity-of-human-brains-in-bytes">What&#039;s the memory capacity of human brains in bytes?</a> appeared first on <a rel="nofollow" href="http://www.visualab.org">Visualab</a>.</p>
]]></description>
				<content:encoded><![CDATA[<p>Some people think that our brain information storage capacity comes from  merely switching on and off neurons or synapses. It's not like that. Our brain is a network, and networks store information through different configurations of the relationships between nodes.</p>
<p>Although the entropy (and therefore the amount of information stored) of a network can be computed mathematically (see my attempt here: <a href="http://www.visualab.org/index.php/what-is-an-entropy-of-graph-is-it-related-to-concept-of-entropy-in-information-theory">Graph entropy: a definition and its relation to information</a>), it's much more sensible, in my opinion, to derive the amount of information from the amount of energy the brain is able to extract from the environment.</p>
<p>Information measures, in the end, how much you decrease uncertainty. And that is not easy to define. How much uncertainty our brain decreases? Let's say enough to exploit systems in an unstable state, where a small quantity of energy releases a big amount of energy, so-called metastates (e.g. a match, which with just a scratch gives you fire).</p>
<h2><span style="color: #000000;"><b>Deduction through Physical principle</b></span></h2>
<p>In physics, information and use of energy are related to each other, and if we know the latter, we know the former. Therefore, if we know how much energy we use during our whole life we can now how much information we store.</p>
<p>This principle is used by Leó Szilárd in his "On the decrease of entropy in a thermodynamic system by the intervention of intelligent beings", where he quantifies the equivalence between information and the "ability to extract energy": he concluded that one needs about 40 exabytes to extract one calorie from a system at room temperature.  As we burn about 2,000 calories a day, and live for about 80 years, the amount of calories burnt in a lifetime is:</p>
<p style="text-align: center;">a life's energy = 2,000*365*80 kilocalories ~ 60M kilocalories</p>
<p>That's the minimum our body –from proteins, to cells and organs and up– must be able to get from the environment. That means that it must store <em>at least </em> <span class='MathJax_Preview'><img src='http://www.visualab.org/wp-content/plugins/latex/cache/tex_5364e7a984e346b5699009b0f8dd82f1.gif' style='vertical-align: middle; border: none; ' class='tex' alt="40 exabytes \cdot 60M = 2.4 \cdot 10^{30} bytes" /></span><script type='math/tex'>40 exabytes \cdot 60M = 2.4 \cdot 10^{30} bytes</script>, or:</p>
<p style="text-align: center;"><strong>capacity of brain (physics) = 2,5 million of yottabytes</strong></p>
<p style="text-align: left;">As said, this is the information stored in <em>the whole body</em>, not just the brain. Each of the <span class='MathJax_Preview'><img src='http://www.visualab.org/wp-content/plugins/latex/cache/tex_e1decaefb3bda61d2c11984708b73c19.gif' style='vertical-align: middle; border: none; ' class='tex' alt="10^12" /></span><script type='math/tex'>10^12</script> cells of our body actually store about 1Gb of information, from the same principle above.</p>
<h3>Books</h3>
<p>Here book you can read if you are interested in the subject. <strong>Minds behind the brain</strong> is the history of neuroscience through all the people, from ancient Greek to today, who studied the brain. Enjoyable and rich of information.</p>
<p><strong>Information Theory, Evolution, and the Origin of Life, by Hubert P. Yockey </strong>is a must for anyone wanting to apply Information Theory to biology –I just quote a paragraph from the epilogue:</p>
<p style="padding-left: 30px;">Galileo believed that the language of Nature is inherently mathematical and is essential to describing natural phenomena. Although there are many fields of biology that are essentially descriptive, with the application of information theory, theoretical biology can now take its place with theoretical physics without apology.</p>
<p>At the end a <strong>Biography of Claude Shannon</strong> which (shame on me!) I haven't read. Yet. If you do, please comment a review:)</p>
<ol>
<li><a href="http://jonlieffmd.com/blog/neuronal-connections-and-the-mind-the-connectome" target="_blank" rel="noopener">Neuronal Connections and the Mind, The Connectome</a></li>
<li>erg/bit : http://link.springer.com/article/10.1007%2FBF02477767#page-1</li>
<li>consumption in c. elegans: http://www.ncbi.nlm.nih.gov/pubmed/15809072</li>
<li>weight and lifespan in c. elegans: http://bmcecol.biomedcentral.com/articles/10.1186/1472-6785-9-14</li>
<li>energy consumption in chimps: http://www.ncbi.nlm.nih.gov/books/NBK53561/</li>
</ol>
<p>The post <a rel="nofollow" href="http://www.visualab.org/index.php/memory-capacity-of-human-brains-in-bytes">What&#039;s the memory capacity of human brains in bytes?</a> appeared first on <a rel="nofollow" href="http://www.visualab.org">Visualab</a>.</p>
]]></content:encoded>
			<wfw:commentRss>http://www.visualab.org/index.php/memory-capacity-of-human-brains-in-bytes/feed</wfw:commentRss>
		<slash:comments>0</slash:comments>
		</item>
		<item>
		<title>Kullback-Leibler Divergence and Cross-entropy Loss</title>
		<link>http://www.visualab.org/index.php/kullback-leibler-divergence-and-cross-entropy-loss</link>
		<comments>http://www.visualab.org/index.php/kullback-leibler-divergence-and-cross-entropy-loss#comments</comments>
		<pubDate>Wed, 28 Jun 2017 11:02:17 +0000</pubDate>
		<dc:creator><![CDATA[Mario Alemi]]></dc:creator>
				<category><![CDATA[Entropy]]></category>
		<category><![CDATA[math]]></category>

		<guid isPermaLink="false">http://www.visualab.org/?p=704</guid>
		<description><![CDATA[<p>Science is all about data and theories explaining those data. The theory behind coin tossing says that the probability of tail and head is the same, and that given N tosses we expect k heads with a probability . In Bayesian statistics, probability has a nice meaning –it means how strongly you believe a certain outcome will [&#8230;]</p>
<p>The post <a rel="nofollow" href="http://www.visualab.org/index.php/kullback-leibler-divergence-and-cross-entropy-loss">Kullback-Leibler Divergence and Cross-entropy Loss</a> appeared first on <a rel="nofollow" href="http://www.visualab.org">Visualab</a>.</p>
]]></description>
				<content:encoded><![CDATA[<p>Science is all about data and theories explaining those data. The theory behind coin tossing says that the probability of tail and head is the same, and that given <em>N</em> tosses we expect <em>k</em> heads with a probability <span class='MathJax_Preview'><img src='http://www.visualab.org/wp-content/plugins/latex/cache/tex_1936f06182801ed0814e4f281d8a28f6.gif' style='vertical-align: middle; border: none; ' class='tex' alt="binomial(trials=N, successes=k)" /></span><script type='math/tex'>binomial(trials=N, successes=k)</script>.</p>
<p>In Bayesian statistics, probability has a nice meaning –it means how strongly you believe a certain outcome will happen. If this probability is normalized (<span class='MathJax_Preview'><img src='http://www.visualab.org/wp-content/plugins/latex/cache/tex_015323d6ff5d7f79a4d06f3df8c646a0.gif' style='vertical-align: middle; border: none; ' class='tex' alt="p_i > 0" /></span><script type='math/tex'>p_i > 0</script> and <span class='MathJax_Preview'><img src='http://www.visualab.org/wp-content/plugins/latex/cache/tex_a0cf901dcd86dba03e24e0d68963640e.gif' style='vertical-align: middle; border: none; ' class='tex' alt="\sum_i p_i = 1" /></span><script type='math/tex'>\sum_i p_i = 1</script>) we can also define a function which measures our surprise to when a measurement is "<span class='MathJax_Preview'><img src='http://www.visualab.org/wp-content/plugins/latex/cache/tex_865c0c0b4ab0e063e5caa3387c1a8741.gif' style='vertical-align: middle; border: none; padding-bottom:1px;' class='tex' alt="i" /></span><script type='math/tex'>i</script>": <span class='MathJax_Preview'><img src='http://www.visualab.org/wp-content/plugins/latex/cache/tex_5457accd788e37821c062f8da5e1da98.gif' style='vertical-align: middle; border: none; ' class='tex' alt="Surprise(i) = -log(p_i)" /></span><script type='math/tex'>Surprise(i) = -log(p_i)</script>. The more we thought the event was rare, the more we are surprised by the outcome.</p>
<p>The entropy can be defined as the average surprise:</p>
<p><span class='MathJax_Preview'><img src='http://www.visualab.org/wp-content/plugins/latex/cache/tex_d61d1be1c53e250791134667e61abc6e.gif' style='vertical-align: middle; border: none; ' class='tex' alt="<surprise> = \sum_i q_i \cdot (-log(p_i)) " /></span><script type='math/tex'><surprise> = \sum_i q_i \cdot (-log(p_i)) </script></p>
<p>where <span class='MathJax_Preview'><img src='http://www.visualab.org/wp-content/plugins/latex/cache/tex_da326f7200e158a864695985b2e2f095.gif' style='vertical-align: middle; border: none; ' class='tex' alt="q_i" /></span><script type='math/tex'>q_i</script> is how often the measurements actually gave <span class='MathJax_Preview'><img src='http://www.visualab.org/wp-content/plugins/latex/cache/tex_865c0c0b4ab0e063e5caa3387c1a8741.gif' style='vertical-align: middle; border: none; padding-bottom:1px;' class='tex' alt="i" /></span><script type='math/tex'>i</script>, and <span class='MathJax_Preview'><img src='http://www.visualab.org/wp-content/plugins/latex/cache/tex_eca91c83a74a2373ca5f796700e99fd3.gif' style='vertical-align: middle; border: none; ' class='tex' alt="p_i" /></span><script type='math/tex'>p_i</script> how strongly we believed (<em>prior</em> to running the experiment) that the measurement could be <span class='MathJax_Preview'><img src='http://www.visualab.org/wp-content/plugins/latex/cache/tex_865c0c0b4ab0e063e5caa3387c1a8741.gif' style='vertical-align: middle; border: none; padding-bottom:1px;' class='tex' alt="i" /></span><script type='math/tex'>i</script>. It's easy to prove the Gibb's inequality:</p>
<p><span class='MathJax_Preview'><img src='http://www.visualab.org/wp-content/plugins/latex/cache/tex_458a7d8c8b86572c43aca11b0e80a75d.gif' style='vertical-align: middle; border: none; ' class='tex' alt="\sum_i q_i \cdot (-log(p_i)) >\sum_i p_i \cdot (-log(p_i))" /></span><script type='math/tex'>\sum_i q_i \cdot (-log(p_i)) >\sum_i p_i \cdot (-log(p_i))</script> if there is at least one <span class='MathJax_Preview'><img src='http://www.visualab.org/wp-content/plugins/latex/cache/tex_45dd22df845bfc954ec1bff43f9e9487.gif' style='vertical-align: middle; border: none; ' class='tex' alt="p_i \neq q_i" /></span><script type='math/tex'>p_i \neq q_i</script></p>
<p>which says: your average surprise is smaller if your model –your prior distribution– is closer to the "reality". If you are using a biased coin, your average surprise to the results is bigger than the surprise from someone who knew the coin was biased and used the appropriate distribution. The opposite is true of course –someone thought the coin was bias but it was not.</p>
<p>The Kullback-Leibler Divergence measures exactly that difference:</p>
<p><span class='MathJax_Preview'><img src='http://www.visualab.org/wp-content/plugins/latex/cache/tex_e394c7ca69974fb18cf99666252097ca.gif' style='vertical-align: middle; border: none; ' class='tex' alt="D_{KL} =\sum_i q_i \cdot (-log(p_i)) - p_i \cdot (-log(p_i)) = " /></span><script type='math/tex'>D_{KL} =\sum_i q_i \cdot (-log(p_i)) - p_i \cdot (-log(p_i)) = </script></p>
<p><span class='MathJax_Preview'><img src='http://www.visualab.org/wp-content/plugins/latex/cache/tex_b834f94bd9bb9450343e39e5da3a94a1.gif' style='vertical-align: middle; border: none; ' class='tex' alt="D_{KL} =\sum_i q_i \cdot log(q_i/p_i) " /></span><script type='math/tex'>D_{KL} =\sum_i q_i \cdot log(q_i/p_i) </script></p>
<p>The <span class='MathJax_Preview'><img src='http://www.visualab.org/wp-content/plugins/latex/cache/tex_0fb705a79eb6847138f7287706421b76.gif' style='vertical-align: middle; border: none; ' class='tex' alt="D_{KL}" /></span><script type='math/tex'>D_{KL}</script> can be big for two reasons: we are using the wrong distribution (e.g. Poisson instead of binomial) or the "right" distribution but with wrong parameters (e.g. the binomial but with the wrong probability of success).</p>
<p>Given that <span class='MathJax_Preview'><img src='http://www.visualab.org/wp-content/plugins/latex/cache/tex_0fb705a79eb6847138f7287706421b76.gif' style='vertical-align: middle; border: none; ' class='tex' alt="D_{KL}" /></span><script type='math/tex'>D_{KL}</script>  measures how "more" our measurement surprise us, it's a good way of measuring how much we are wrong with our model (usually we think we have the right distribution and want to find the best values of the parameters).</p>
<p>Usually, we simply take the cross-entropy  <span class='MathJax_Preview'><img src='http://www.visualab.org/wp-content/plugins/latex/cache/tex_decccc707e53d8e9e44c1922f4553faf.gif' style='vertical-align: middle; border: none; ' class='tex' alt="\sum_i q_i \cdot (-log(p_i))" /></span><script type='math/tex'>\sum_i q_i \cdot (-log(p_i))</script>, i.e. our actual average surprise given the frequency <span class='MathJax_Preview'><img src='http://www.visualab.org/wp-content/plugins/latex/cache/tex_eca91c83a74a2373ca5f796700e99fd3.gif' style='vertical-align: middle; border: none; ' class='tex' alt="p_i" /></span><script type='math/tex'>p_i</script> of our data and the expected frequency <span class='MathJax_Preview'><img src='http://www.visualab.org/wp-content/plugins/latex/cache/tex_da326f7200e158a864695985b2e2f095.gif' style='vertical-align: middle; border: none; ' class='tex' alt="q_i" /></span><script type='math/tex'>q_i</script> given our model:</p>
<p><span class='MathJax_Preview'><img src='http://www.visualab.org/wp-content/plugins/latex/cache/tex_0e151fa466455b69bcbcb89ef8a1ab9a.gif' style='vertical-align: middle; border: none; ' class='tex' alt="H(q, p) =\sum_i q_i \cdot (-log(p_i))" /></span><script type='math/tex'>H(q, p) =\sum_i q_i \cdot (-log(p_i))</script></p>
<p>Below some books on the subject, plus the autobiography of Edward Thorp –a must if you are interested in entropy and information!</p>
<p>[amazon_link asins='1441919406,1118632168,1400067960' template='ProductCarousel' store='visualab-20' marketplace='US' link_id='f05420d1-8cd4-11e7-8533-2badbd55ed2d']</p>
<p>The post <a rel="nofollow" href="http://www.visualab.org/index.php/kullback-leibler-divergence-and-cross-entropy-loss">Kullback-Leibler Divergence and Cross-entropy Loss</a> appeared first on <a rel="nofollow" href="http://www.visualab.org">Visualab</a>.</p>
]]></content:encoded>
			<wfw:commentRss>http://www.visualab.org/index.php/kullback-leibler-divergence-and-cross-entropy-loss/feed</wfw:commentRss>
		<slash:comments>2</slash:comments>
		</item>
		<item>
		<title>Cyberchondria: Why Bayes is a must when looking for web-based diagnoses</title>
		<link>http://www.visualab.org/index.php/cyberchondria-microsoft-bayes-ny-times-pancreas-cancer</link>
		<comments>http://www.visualab.org/index.php/cyberchondria-microsoft-bayes-ny-times-pancreas-cancer#respond</comments>
		<pubDate>Thu, 09 Jun 2016 10:37:01 +0000</pubDate>
		<dc:creator><![CDATA[Mario Alemi]]></dc:creator>
				<category><![CDATA[Articles]]></category>
		<category><![CDATA[math]]></category>
		<category><![CDATA[bayes]]></category>

		<guid isPermaLink="false">http://www.visualab.org/?p=356</guid>
		<description><![CDATA[<p>The NY Times (and few others) wrote a story entitled Microsoft Finds Cancer Clues in Search Queries: Microsoft scientists have demonstrated that by analyzing large samples of search engine queries they may in some cases be able to identify internet users who are suffering from pancreatic cancer, even before they have received a diagnosis of the disease. [&#8230;]</p>
<p>The post <a rel="nofollow" href="http://www.visualab.org/index.php/cyberchondria-microsoft-bayes-ny-times-pancreas-cancer">Cyberchondria: Why Bayes is a must when looking for web-based diagnoses</a> appeared first on <a rel="nofollow" href="http://www.visualab.org">Visualab</a>.</p>
]]></description>
				<content:encoded><![CDATA[<p>The NY Times (and few others) wrote a story entitled <a href="http://www.nytimes.com/2016/06/08/technology/online-searches-can-identify-cancer-victims-study-finds.html" target="_blank" rel="noopener">Microsoft Finds Cancer Clues in Search Queries</a>:</p>
<blockquote>
<p class="story-body-text story-content" data-para-count="254" data-total-count="254"><a class="meta-org" title="More information about Microsoft Corporation" href="http://www.nytimes.com/topic/company/microsoft-corporation?inline=nyt-org&amp;version=meter+at+1&amp;module=meter-Links&amp;pgtype=article&amp;contentId=&amp;mediaId=&amp;referrer=&amp;priority=true&amp;action=click&amp;contentCollection=meter-links-click">Microsoft</a> scientists have demonstrated that by analyzing large samples of search engine queries they may in some cases be able to identify internet users who are suffering from <a class="meta-classifier" title="In-depth reference and news articles about Pancreatic carcinoma." href="http://health.nytimes.com/health/guides/disease/pancreatic-carcinoma/overview.html?inline=nyt-classifier&amp;version=meter+at+1&amp;module=meter-Links&amp;pgtype=article&amp;contentId=&amp;mediaId=&amp;referrer=&amp;priority=true&amp;action=click&amp;contentCollection=meter-links-click">pancreatic cancer</a>, even before they have received a diagnosis of the disease.</p>
<p class="story-body-text story-content" data-para-count="283" data-total-count="537">The scientists said they hoped their work could lead to early detection of <a class="meta-classifier" title="In-depth reference and news articles about Cancer." href="http://health.nytimes.com/health/guides/disease/cancer/overview.html?inline=nyt-classifier&amp;version=meter+at+1&amp;module=meter-Links&amp;pgtype=article&amp;contentId=&amp;mediaId=&amp;referrer=&amp;priority=true&amp;action=click&amp;contentCollection=meter-links-click">cancer</a>.</p>
</blockquote>
<p>Little below you read:</p>
<blockquote><p>The researchers reported that they could identify from 5 to 15 percent of pancreatic cases with false positive rates of<strong> as low as one in 100,000</strong>.</p></blockquote>
<p>Before you run to Bing with the hope of having some miraculous diagnosis, ask yourself: what's the probability that, being "positive" at the <em>bing test</em>, you actually have pancreatic cancer?</p>
<p>(Spoiler: it's 50%, and in the indented paragraphs below there is some math you can skip.)</p>
<p style="padding-left: 30px;">There is a simple formula for that, called the Bayes formula (or theorem):</p>
<p style="padding-left: 30px;"><span class='MathJax_Preview'><img src='http://www.visualab.org/wp-content/plugins/latex/cache/tex_cd395a05c5ee66bc4d9a56f1451cb886.gif' style='vertical-align: middle; border: none; ' class='tex' alt="P(Cancer given Positive) = \frac{P(Positive given Cancer)\cdot P(Cancer)}{P(Positive)}" /></span><script type='math/tex'>P(Cancer given Positive) = \frac{P(Positive given Cancer)\cdot P(Cancer)}{P(Positive)}</script></p>
<p style="padding-left: 30px;"><span class='MathJax_Preview'><img src='http://www.visualab.org/wp-content/plugins/latex/cache/tex_d47d5b84feb27bf65a585baf9faeca65.gif' style='vertical-align: middle; border: none; ' class='tex' alt=" P(Positive) " /></span><script type='math/tex'> P(Positive) </script> is the probability that you score positive at the <em>bing test</em>, regardless if you have or not the cancer. This the probability that you score positive and have the cancer ("true positive" probability times probability of having the cancer) plus the probability that you score positive without the cancer ("false positive" probability times 1 - probability of having the cancer).</p>
<p style="padding-left: 30px;">The article states that the "false positive rates [are] of as low as one in 100,000". The "true positive" is reported as 5-15%, which I will approximate to 10%.</p>
<p style="padding-left: 30px;">The probability that a random person will be diagnosed with pancreatic cancer is about 10 out of 100,000 (see <a href="http://www.cancer.org/cancer/pancreaticcancer/detailedguide/pancreatic-cancer-key-statistics" target="_blank" rel="noopener">cancer.org</a>).</p>
<p style="padding-left: 30px;">We now have all the numbers to compute the probability that, having microsoft diagnosing the cancer, a user actually has it:</p>
<p style="padding-left: 30px;"><span class='MathJax_Preview'><img src='http://www.visualab.org/wp-content/plugins/latex/cache/tex_84196b5edd70f0b6b6c4a2cc7f37de80.gif' style='vertical-align: middle; border: none; ' class='tex' alt=" P(Cancer given Positive) = \frac{0.10 \cdot 0.0001 }{0.0001*0.10+0.00001} = 50\%" /></span><script type='math/tex'> P(Cancer given Positive) = \frac{0.10 \cdot 0.0001 }{0.0001*0.10+0.00001} = 50\%</script></p>
<p>This is not difficult to understand. It's common sense. The probability of being rightfully diagnosed by bing is 1 out of 100,000 (10 out of 100,000 people have the cancer, and of these 10 only one receives the diagnosis). Of the remaining healthy ones (practically 100,000), 1 person is diagnosed by mistake. Therefore, bing, out of 100,000 people, will diagnosed 2 people: one is the "true positive", the other the "false positive". The probability of being a true positive is 50% then.</p>
<p>Now, there is some difference between the <a href="http://jop.ascopubs.org/content/early/2016/06/02/JOP.2015.010504.full" target="_blank" rel="noopener">original article by the two Microsoft researchers </a>(Ryen White and Eric Horvitz) and the NY Times' one. White and Horvitz are not sensationalist in their publication. For a reason –in 2008, they <a href="http://research.microsoft.com/apps/pubs/?id=76529" target="_blank" rel="noopener">wrote an article on "cyberchondria"</a>, or "unfounded escalation of concerns about common symptomatology, based on the review of search results and literature on the Web". Their belief, I believe, is that the Web is danger place for diagnosing yourself.</p>
<p>Nonetheless, the tone of the Time's article is slightly sensationalist.  I do believe that 50% is better than nothing. But I do believe that writing about a "false positive rates of <em>as low</em> as one in 100,000" is misleading. Particularly when the article does not report that the final confidence of the diagnosis is 50%.</p>
<p>Articles like this, IMHO, are prone to lead to cyberchondria, and it would be a pity for White and Horvitz to achieve exactly the opposite result they (supposedly) had in mind when writing their original piece.</p>
<p>Below, a few books I read on the topics. From the most technical  (a great tutorial on Bayesian statistics) to medicine ("The patient will see you now", on how health is being disrupted by data analysis), and the always enjoyable "Numbers Behind Numb3rs".</p>
<p>[amazon_link asins='0198568320,B011T7FTBM,0452288576' template='ProductGrid' store='visualab-20' marketplace='US' link_id='f808fa99-8cd5-11e7-8480-efc9573ab251']</p>
<p>The post <a rel="nofollow" href="http://www.visualab.org/index.php/cyberchondria-microsoft-bayes-ny-times-pancreas-cancer">Cyberchondria: Why Bayes is a must when looking for web-based diagnoses</a> appeared first on <a rel="nofollow" href="http://www.visualab.org">Visualab</a>.</p>
]]></content:encoded>
			<wfw:commentRss>http://www.visualab.org/index.php/cyberchondria-microsoft-bayes-ny-times-pancreas-cancer/feed</wfw:commentRss>
		<slash:comments>0</slash:comments>
		</item>
		<item>
		<title>How big can an error be when we estimate something?</title>
		<link>http://www.visualab.org/index.php/errors-in-estimates</link>
		<comments>http://www.visualab.org/index.php/errors-in-estimates#respond</comments>
		<pubDate>Sun, 18 Oct 2015 15:26:08 +0000</pubDate>
		<dc:creator><![CDATA[Mario Alemi]]></dc:creator>
				<category><![CDATA[Articles]]></category>
		<category><![CDATA[Scienza]]></category>
		<category><![CDATA[math]]></category>
		<category><![CDATA[statistics]]></category>

		<guid isPermaLink="false">http://www.visualab.org/?p=305</guid>
		<description><![CDATA[<p>Often, when you make an estimation based on many assumptions, people say "There might be errors in all your assumptions, and the error on the result, being the sum of all these errors, is going to be huge". In reality, errors compensate each others.  You might overestimate one variable, but will underestimate the next one. [&#8230;]</p>
<p>The post <a rel="nofollow" href="http://www.visualab.org/index.php/errors-in-estimates">How big can an error be when we estimate something?</a> appeared first on <a rel="nofollow" href="http://www.visualab.org">Visualab</a>.</p>
]]></description>
				<content:encoded><![CDATA[<p style="text-align: left;">Often, when you make an estimation based on many assumptions, people say "There might be errors in all your assumptions, and the error on the result, being the sum of all these errors, is going to be huge".</p>
<p>In reality, errors compensate each others.  You might overestimate one variable, but will underestimate the next one. Unless you are biased, the error will grow like a drunken wanderer.</p>
<p>Say we want to estimate the number <span class='MathJax_Preview'><img src='http://www.visualab.org/wp-content/plugins/latex/cache/tex_8d9c307cb7f3c4a32822a51922d1ceaa.gif' style='vertical-align: middle; border: none; padding-bottom:1px;' class='tex' alt="N" /></span><script type='math/tex'>N</script> of something. Number of candies eaten by children in the world. Or piano tuners in Chicago. Or whatever.</p>
<p>To estimate <span class='MathJax_Preview'><img src='http://www.visualab.org/wp-content/plugins/latex/cache/tex_8d9c307cb7f3c4a32822a51922d1ceaa.gif' style='vertical-align: middle; border: none; padding-bottom:1px;' class='tex' alt="N" /></span><script type='math/tex'>N</script>, we multiply estimated values <span class='MathJax_Preview'><img src='http://www.visualab.org/wp-content/plugins/latex/cache/tex_8dec559e201a7b6a0f99baeaa1731051.gif' style='vertical-align: middle; border: none; ' class='tex' alt="e_i" /></span><script type='math/tex'>e_i</script> of the factors which contribute to <span class='MathJax_Preview'><img src='http://www.visualab.org/wp-content/plugins/latex/cache/tex_8d9c307cb7f3c4a32822a51922d1ceaa.gif' style='vertical-align: middle; border: none; padding-bottom:1px;' class='tex' alt="N" /></span><script type='math/tex'>N</script>, whose real (unknown) values is <span class='MathJax_Preview'><img src='http://www.visualab.org/wp-content/plugins/latex/cache/tex_2aecb1dc57e87620a373d19b0a889efb.gif' style='vertical-align: middle; border: none; ' class='tex' alt="a_i" /></span><script type='math/tex'>a_i</script>. For estimating the candies, we might have the number of people in the world, fraction of children, sugar-producing crops and so on.</p>
<p style="text-align: center;"><span class='MathJax_Preview'><img src='http://www.visualab.org/wp-content/plugins/latex/cache/tex_aaeb95078a3c4a502cba8488c747ad24.gif' style='vertical-align: middle; border: none; ' class='tex' alt="N = a_1 \cdot a_2 \cdot ... \approx e_1 \cdot e_2 ... " /></span><script type='math/tex'>N = a_1 \cdot a_2 \cdot ... \approx e_1 \cdot e_2 ... </script></p>
<p>In the end, will compute our estimate by multiplying all <span class='MathJax_Preview'><img src='http://www.visualab.org/wp-content/plugins/latex/cache/tex_8dec559e201a7b6a0f99baeaa1731051.gif' style='vertical-align: middle; border: none; ' class='tex' alt="e_i" /></span><script type='math/tex'>e_i</script>.</p>
<p>Now, let's say that you are really bad in estimating, and you never get the right value. All <span class='MathJax_Preview'><img src='http://www.visualab.org/wp-content/plugins/latex/cache/tex_8dec559e201a7b6a0f99baeaa1731051.gif' style='vertical-align: middle; border: none; ' class='tex' alt="e_i" /></span><script type='math/tex'>e_i</script> are wrong by a factor 2 –sometimes your estimate <span class='MathJax_Preview'><img src='http://www.visualab.org/wp-content/plugins/latex/cache/tex_8dec559e201a7b6a0f99baeaa1731051.gif' style='vertical-align: middle; border: none; ' class='tex' alt="e_i" /></span><script type='math/tex'>e_i</script> is the double, sometimes is one half of the actual value <span class='MathJax_Preview'><img src='http://www.visualab.org/wp-content/plugins/latex/cache/tex_2aecb1dc57e87620a373d19b0a889efb.gif' style='vertical-align: middle; border: none; ' class='tex' alt="a_i" /></span><script type='math/tex'>a_i</script>.</p>
<p>Now you do what any good engineer would have done before the advent of pocket calculator when had to multiply numbers –you sum logarithms:</p>
<p style="text-align: center;"><span class='MathJax_Preview'><img src='http://www.visualab.org/wp-content/plugins/latex/cache/tex_0ac6eec0bc27288e111f527727a20922.gif' style='vertical-align: middle; border: none; ' class='tex' alt="log(N) = \sum_i log(a_i) \approx \sum_i log(e_i)" /></span><script type='math/tex'>log(N) = \sum_i log(a_i) \approx \sum_i log(e_i)</script></p>
<p>(<span class='MathJax_Preview'><img src='http://www.visualab.org/wp-content/plugins/latex/cache/tex_7231fa806691800f095133f6fb720d82.gif' style='vertical-align: middle; border: none; ' class='tex' alt="\sum" /></span><script type='math/tex'>\sum</script> means "sum".) But we said your estimates are</p>
<p style="text-align: center;"><span class='MathJax_Preview'><img src='http://www.visualab.org/wp-content/plugins/latex/cache/tex_7057623a153bb6aa9d336621e0b19bd0.gif' style='vertical-align: middle; border: none; ' class='tex' alt="e_i = a_i \cdot random(2, 0.5)" /></span><script type='math/tex'>e_i = a_i \cdot random(2, 0.5)</script></p>
<p>Or</p>
<p style="text-align: center;"><span class='MathJax_Preview'><img src='http://www.visualab.org/wp-content/plugins/latex/cache/tex_5a860ece8626e636e523fdcdbafe3824.gif' style='vertical-align: middle; border: none; ' class='tex' alt="log(e_i) = log(a_i) + random(+1, -1)" /></span><script type='math/tex'>log(e_i) = log(a_i) + random(+1, -1)</script></p>
<p>Approximating <span class='MathJax_Preview'><img src='http://www.visualab.org/wp-content/plugins/latex/cache/tex_cfbb373a5f4aa811994adb5a26f02fa4.gif' style='vertical-align: middle; border: none; ' class='tex' alt="log(2)" /></span><script type='math/tex'>log(2)</script> to <span class='MathJax_Preview'><img src='http://www.visualab.org/wp-content/plugins/latex/cache/tex_c4ca4238a0b923820dcc509a6f75849b.gif' style='vertical-align: middle; border: none; padding-bottom:1px;' class='tex' alt="1" /></span><script type='math/tex'>1</script>.</p>
<p>This allows us to separate the errors from the estimates and write</p>
<p style="text-align: center;"><span class='MathJax_Preview'><img src='http://www.visualab.org/wp-content/plugins/latex/cache/tex_f122d56011554dbf2f6c1e1fc40966c0.gif' style='vertical-align: middle; border: none; ' class='tex' alt="log(N) \approx \sum log(a_i) + \sum random(+1, -1)" /></span><script type='math/tex'>log(N) \approx \sum log(a_i) + \sum random(+1, -1)</script></p>
<p style="text-align: center;"><span class='MathJax_Preview'><img src='http://www.visualab.org/wp-content/plugins/latex/cache/tex_d85799d4c6cff25b3ae368cdd96703d5.gif' style='vertical-align: middle; border: none; ' class='tex' alt="log(N) \approx log(N) + log(\sigma_{final})" /></span><script type='math/tex'>log(N) \approx log(N) + log(\sigma_{final})</script></p>
<p>where <span class='MathJax_Preview'><img src='http://www.visualab.org/wp-content/plugins/latex/cache/tex_f41635183b6531deea4967ee664ec7aa.gif' style='vertical-align: middle; border: none; ' class='tex' alt="\sigma_{final}" /></span><script type='math/tex'>\sigma_{final}</script> is the error you'll get at the end of the estimate.</p>
<p>The logarithm of the final error, <span class='MathJax_Preview'><img src='http://www.visualab.org/wp-content/plugins/latex/cache/tex_f41635183b6531deea4967ee664ec7aa.gif' style='vertical-align: middle; border: none; ' class='tex' alt="\sigma_{final}" /></span><script type='math/tex'>\sigma_{final}</script> , actually diffuses quite slowly. Like drunken wanderers who can only walk on a line, will make one step in one direction, than two steps in the opposite direction, and so on. After <span class='MathJax_Preview'><img src='http://www.visualab.org/wp-content/plugins/latex/cache/tex_5dbc98dcc983a70728bd082d1a47546e.gif' style='vertical-align: middle; border: none; ' class='tex' alt="S" /></span><script type='math/tex'>S</script> steps, 70% of those drunken wanderers are on average no more than <span class='MathJax_Preview'><img src='http://www.visualab.org/wp-content/plugins/latex/cache/tex_56a6a06750c25225bd057fd47c9f998b.gif' style='vertical-align: middle; border: none; ' class='tex' alt="\sqrt{S}" /></span><script type='math/tex'>\sqrt{S}</script> steps away from their starting point.</p>
<p>This means that 70% of the times the log of your estimation error is not bigger than <span class='MathJax_Preview'><img src='http://www.visualab.org/wp-content/plugins/latex/cache/tex_436d1308811a879150795d8af4368c55.gif' style='vertical-align: middle; border: none; ' class='tex' alt="\sqrt{S}*log(\sigma)" /></span><script type='math/tex'>\sqrt{S}*log(\sigma)</script>, where <span class='MathJax_Preview'><img src='http://www.visualab.org/wp-content/plugins/latex/cache/tex_a2ab7d71a0f07f388ff823293c147d21.gif' style='vertical-align: middle; border: none; padding-bottom:2px;' class='tex' alt="\sigma" /></span><script type='math/tex'>\sigma</script> is the average (estimated) error factor, which we initially assumed to be 2. Or</p>
<p style="text-align: center;"><span class='MathJax_Preview'><img src='http://www.visualab.org/wp-content/plugins/latex/cache/tex_93af98ae2809f9b7fde953ad33a26a43.gif' style='vertical-align: middle; border: none; ' class='tex' alt="\sigma_{final} = \sigma^{\sqrt{S}}" /></span><script type='math/tex'>\sigma_{final} = \sigma^{\sqrt{S}}</script></p>
<p>With <span class='MathJax_Preview'><img src='http://www.visualab.org/wp-content/plugins/latex/cache/tex_5dbc98dcc983a70728bd082d1a47546e.gif' style='vertical-align: middle; border: none; ' class='tex' alt="S" /></span><script type='math/tex'>S</script> number of assumptions you made, <span class='MathJax_Preview'><img src='http://www.visualab.org/wp-content/plugins/latex/cache/tex_a2ab7d71a0f07f388ff823293c147d21.gif' style='vertical-align: middle; border: none; padding-bottom:2px;' class='tex' alt="\sigma" /></span><script type='math/tex'>\sigma</script> the average error for each factor, <span class='MathJax_Preview'><img src='http://www.visualab.org/wp-content/plugins/latex/cache/tex_f41635183b6531deea4967ee664ec7aa.gif' style='vertical-align: middle; border: none; ' class='tex' alt="\sigma_{final}" /></span><script type='math/tex'>\sigma_{final}</script> the final estimation error.</p>
<p>The post <a rel="nofollow" href="http://www.visualab.org/index.php/errors-in-estimates">How big can an error be when we estimate something?</a> appeared first on <a rel="nofollow" href="http://www.visualab.org">Visualab</a>.</p>
]]></content:encoded>
			<wfw:commentRss>http://www.visualab.org/index.php/errors-in-estimates/feed</wfw:commentRss>
		<slash:comments>0</slash:comments>
		</item>
		<item>
		<title>Floating Points –Rounding Errors in Algebraic Processes</title>
		<link>http://www.visualab.org/index.php/rounding-error-algebraic-processes</link>
		<comments>http://www.visualab.org/index.php/rounding-error-algebraic-processes#respond</comments>
		<pubDate>Thu, 01 Oct 2015 19:00:01 +0000</pubDate>
		<dc:creator><![CDATA[Mario Alemi]]></dc:creator>
				<category><![CDATA[Articles]]></category>
		<category><![CDATA[Free Software]]></category>
		<category><![CDATA[Informatics]]></category>
		<category><![CDATA[computer science]]></category>
		<category><![CDATA[math]]></category>
		<category><![CDATA[python]]></category>

		<guid isPermaLink="false">http://www.visualab.org/?p=291</guid>
		<description><![CDATA[<p>The floating point representation of numbers is dangerous. With floating points, the computer stores the digits and the position of the point. Imagine a "6-digit decimal computer". This is a computer that uses base 10 numbers, like we human, but can only store 6 digits, the position of the dot, and the power of 10 [&#8230;]</p>
<p>The post <a rel="nofollow" href="http://www.visualab.org/index.php/rounding-error-algebraic-processes">Floating Points –Rounding Errors in Algebraic Processes</a> appeared first on <a rel="nofollow" href="http://www.visualab.org">Visualab</a>.</p>
]]></description>
				<content:encoded><![CDATA[<p>The floating point representation of numbers is dangerous. With floating points, the computer stores the digits and the position of the point. Imagine a "6-digit decimal computer". This is a computer that uses base 10 numbers, like we human, but can only store 6 digits, the position of the dot, and the power of 10 used in scientific notation.</p>
<p>Such computer would represent the number <span class='MathJax_Preview'><img src='http://www.visualab.org/wp-content/plugins/latex/cache/tex_ba0965330d709297a9d8b07f305169cd.gif' style='vertical-align: middle; border: none; ' class='tex' alt="1/3" /></span><script type='math/tex'>1/3</script> as:</p>
<p><span class='MathJax_Preview'><img src='http://www.visualab.org/wp-content/plugins/latex/cache/tex_832dfc219a642ca13191c7d91a79f43a.gif' style='vertical-align: middle; border: none; ' class='tex' alt="1/3 = 0.333333" /></span><script type='math/tex'>1/3 = 0.333333</script></p>
<p>That means the number is rounded down by about one millionth. But it might get much worse. Have a look at the following operation:</p>
<p><span class='MathJax_Preview'><img src='http://www.visualab.org/wp-content/plugins/latex/cache/tex_e153a083511b27c23db4155c8bf5794c.gif' style='vertical-align: middle; border: none; ' class='tex' alt="a = 1 + 1/30,000 = 1.00003[3333...] " /></span><script type='math/tex'>a = 1 + 1/30,000 = 1.00003[3333...] </script><br />
<span class='MathJax_Preview'><img src='http://www.visualab.org/wp-content/plugins/latex/cache/tex_16690bfcf439511b8a828e0be3f8d955.gif' style='vertical-align: middle; border: none; padding-bottom:1px;' class='tex' alt="b = a - 1" /></span><script type='math/tex'>b = a - 1</script></p>
<p>It leads to <span class='MathJax_Preview'><img src='http://www.visualab.org/wp-content/plugins/latex/cache/tex_81418681dfb9ea7c38df54a70644ad20.gif' style='vertical-align: middle; border: none; ' class='tex' alt="b = 3\cdot 10^{-5}" /></span><script type='math/tex'>b = 3\cdot 10^{-5}</script>, which means the computer produced a rounding error of about 10%! Now you should feel sorry you did not write:</p>
<p><span class='MathJax_Preview'><img src='http://www.visualab.org/wp-content/plugins/latex/cache/tex_bb84885c29794f797126ae1b9b0206ca.gif' style='vertical-align: middle; border: none; padding-bottom:1px;' class='tex' alt="a = 1 - 1" /></span><script type='math/tex'>a = 1 - 1</script><br />
<span class='MathJax_Preview'><img src='http://www.visualab.org/wp-content/plugins/latex/cache/tex_93089d6f80270e654679ed198bff62ed.gif' style='vertical-align: middle; border: none; ' class='tex' alt="b = a + 1/30,000" /></span><script type='math/tex'>b = a + 1/30,000</script></p>
<p>which would have given <span class='MathJax_Preview'><img src='http://www.visualab.org/wp-content/plugins/latex/cache/tex_409812717209e5231603ef542ce2dff3.gif' style='vertical-align: middle; border: none; ' class='tex' alt=" b = 3.33333\cdot 10^{-5}" /></span><script type='math/tex'> b = 3.33333\cdot 10^{-5}</script>.</p>
<p>Normally, this is not a big deal. But in probability computation it is. Take the way the disjunction (union) of probabilities is computed. Given <span class='MathJax_Preview'><img src='http://www.visualab.org/wp-content/plugins/latex/cache/tex_8d9c307cb7f3c4a32822a51922d1ceaa.gif' style='vertical-align: middle; border: none; padding-bottom:1px;' class='tex' alt="N" /></span><script type='math/tex'>N</script> events whose probability is <span class='MathJax_Preview'><img src='http://www.visualab.org/wp-content/plugins/latex/cache/tex_eca91c83a74a2373ca5f796700e99fd3.gif' style='vertical-align: middle; border: none; ' class='tex' alt="p_i" /></span><script type='math/tex'>p_i</script>. The probability that at least one of these events happens is:</p>
<p>[1] <span class='MathJax_Preview'><img src='http://www.visualab.org/wp-content/plugins/latex/cache/tex_df08b9f5776a3f4420739cba9d5ece48.gif' style='vertical-align: middle; border: none; ' class='tex' alt="P(p_1 \lor p_2 \lor ...\lor p_N) = 1 - (1 - p_1)\cdot(1 - p_2)...\cdot(1 -p_N)" /></span><script type='math/tex'>P(p_1 \lor p_2 \lor ...\lor p_N) = 1 - (1 - p_1)\cdot(1 - p_2)...\cdot(1 -p_N)</script></p>
<p>(the symbols <span class='MathJax_Preview'><img src='http://www.visualab.org/wp-content/plugins/latex/cache/tex_03be9467930b93beab62934967c7f4ab.gif' style='vertical-align: middle; border: none; ' class='tex' alt="A \lor B" /></span><script type='math/tex'>A \lor B</script> means <span class='MathJax_Preview'><img src='http://www.visualab.org/wp-content/plugins/latex/cache/tex_7fc56270e7a70fa81a5935b72eacbe29.gif' style='vertical-align: middle; border: none; ' class='tex' alt="A" /></span><script type='math/tex'>A</script> or <span class='MathJax_Preview'><img src='http://www.visualab.org/wp-content/plugins/latex/cache/tex_9d5ed678fe57bcca610140957afab571.gif' style='vertical-align: middle; border: none; padding-bottom:1px;' class='tex' alt="B" /></span><script type='math/tex'>B</script> is true, or both). It is immediately clear that if all <span class='MathJax_Preview'><img src='http://www.visualab.org/wp-content/plugins/latex/cache/tex_eca91c83a74a2373ca5f796700e99fd3.gif' style='vertical-align: middle; border: none; ' class='tex' alt="p_i" /></span><script type='math/tex'>p_i</script> are very small, and will be rounded like the 1/3 above, the error can become soon big enough to spoil your computation.</p>
<p>And this is actually a pitty! Because:</p>
<p>[2] <span class='MathJax_Preview'><img src='http://www.visualab.org/wp-content/plugins/latex/cache/tex_57d35cfa214c47fca296720f6704bf8e.gif' style='vertical-align: middle; border: none; ' class='tex' alt="(1 - p_1)\cdot(1 - p_2)...\cdot(1 -p_N) = 1 - \sum_i p_i + \sum_{i\neq j} p_i\cdot p_j - \sum_{i\neq j \neq k} p_i\cdot p_j\cdot p_k ..." /></span><script type='math/tex'>(1 - p_1)\cdot(1 - p_2)...\cdot(1 -p_N) = 1 - \sum_i p_i + \sum_{i\neq j} p_i\cdot p_j - \sum_{i\neq j \neq k} p_i\cdot p_j\cdot p_k ...</script></p>
<p>where <span class='MathJax_Preview'><img src='http://www.visualab.org/wp-content/plugins/latex/cache/tex_bf39fad9b345154b4c34dff898ddf84c.gif' style='vertical-align: middle; border: none; ' class='tex' alt="\sum_i" /></span><script type='math/tex'>\sum_i</script> means "sum" for all values of <span class='MathJax_Preview'><img src='http://www.visualab.org/wp-content/plugins/latex/cache/tex_865c0c0b4ab0e063e5caa3387c1a8741.gif' style='vertical-align: middle; border: none; padding-bottom:1px;' class='tex' alt="i" /></span><script type='math/tex'>i</script>, in this case 1 to N, <span class='MathJax_Preview'><img src='http://www.visualab.org/wp-content/plugins/latex/cache/tex_d990a0a9026e687e556acc1a01994d61.gif' style='vertical-align: middle; border: none; ' class='tex' alt="\sum_{i\neq j}" /></span><script type='math/tex'>\sum_{i\neq j}</script> all values of <span class='MathJax_Preview'><img src='http://www.visualab.org/wp-content/plugins/latex/cache/tex_865c0c0b4ab0e063e5caa3387c1a8741.gif' style='vertical-align: middle; border: none; padding-bottom:1px;' class='tex' alt="i" /></span><script type='math/tex'>i</script> and <span class='MathJax_Preview'><img src='http://www.visualab.org/wp-content/plugins/latex/cache/tex_363b122c528f54df4a0446b6bab05515.gif' style='vertical-align: middle; border: none; ' class='tex' alt="j" /></span><script type='math/tex'>j</script> not equal between themselves, etc.</p>
<p>Equation [2] tells us that if we solve [1] algebraically, subtract 1 and only after substitute the values in the various <span class='MathJax_Preview'><img src='http://www.visualab.org/wp-content/plugins/latex/cache/tex_eca91c83a74a2373ca5f796700e99fd3.gif' style='vertical-align: middle; border: none; ' class='tex' alt="p_i" /></span><script type='math/tex'>p_i</script>, the error would be smaller.</p>
<p>Let's make an extreme example. If we had two events with <span class='MathJax_Preview'><img src='http://www.visualab.org/wp-content/plugins/latex/cache/tex_11c6a6eb9edb1315ac2cf6d621c07aa5.gif' style='vertical-align: middle; border: none; ' class='tex' alt="p_1 = p_2 = 10^{-6}" /></span><script type='math/tex'>p_1 = p_2 = 10^{-6}</script>:</p>
<p>[3] <span class='MathJax_Preview'><img src='http://www.visualab.org/wp-content/plugins/latex/cache/tex_faf662aded44e6765af852e1f7e6d675.gif' style='vertical-align: middle; border: none; ' class='tex' alt="P(p_1 \lor p_2) = 1 - (1-10^-6)^2 = 2\cdot 10^{-6}-10^{-12} = 1.99999\cdot 10^{-6}" /></span><script type='math/tex'>P(p_1 \lor p_2) = 1 - (1-10^-6)^2 = 2\cdot 10^{-6}-10^{-12} = 1.99999\cdot 10^{-6}</script></p>
<p>Imagine you have a "3-digit decimal computer" (3 digits plus the position of the point and the power of 10). If you solve equation [3] using the formula in [2], even with such lousy computer the result would be a decent <span class='MathJax_Preview'><img src='http://www.visualab.org/wp-content/plugins/latex/cache/tex_d57bfe1bf4345e2dddca65801fb18734.gif' style='vertical-align: middle; border: none; ' class='tex' alt="1.99\cdot 10^{-6}" /></span><script type='math/tex'>1.99\cdot 10^{-6}</script>. This because both <span class='MathJax_Preview'><img src='http://www.visualab.org/wp-content/plugins/latex/cache/tex_f00970a7f6f68a512459492bafb993b0.gif' style='vertical-align: middle; border: none; ' class='tex' alt="2\cdot 10^{-6}" /></span><script type='math/tex'>2\cdot 10^{-6}</script> and <span class='MathJax_Preview'><img src='http://www.visualab.org/wp-content/plugins/latex/cache/tex_012763afcb19637d2ec85a93fc8ebcc1.gif' style='vertical-align: middle; border: none; ' class='tex' alt="10^{-12}" /></span><script type='math/tex'>10^{-12}</script> do not need more than 3 digits. On the contrary, a naive computation, where the products are computed through equation [1] substituting the value of the variables, would give:</p>
<p>[1'] <span class='MathJax_Preview'><img src='http://www.visualab.org/wp-content/plugins/latex/cache/tex_b876e52fa91c1c0be72a8aff651003fe.gif' style='vertical-align: middle; border: none; ' class='tex' alt="1 - 0.999\cdot 0.999 = 1.99\cdot 10^{-3}" /></span><script type='math/tex'>1 - 0.999\cdot 0.999 = 1.99\cdot 10^{-3}</script></p>
<p>A terribly wrong result. The short script below, in Python, solve the equation algebraically:</p>
<pre><span class="k">def</span> <span class="nf">probabilities_disjunction</span><span class="p">(</span><span class="n">probabilities</span><span class="p">:</span> <span class="nb">list</span><span class="p">):</span>
    <span class="n">n</span> <span class="o">=</span> <span class="nb">len</span><span class="p">(</span><span class="n">probabilities</span><span class="p">)</span>
    <span class="c"># tree is a list of strings whose length is len(probabilities) with all possible 0/1 without the 0s.</span>
    <span class="c"># e.g. for three probabilities: 001, 010, 011, 100, 101, 110, 111 </span>
    <span class="n">tree</span> <span class="o">=</span> <span class="p">[]</span>
    <span class="k">for</span> <span class="n">i</span> <span class="ow">in</span> <span class="nb">range</span><span class="p">(</span><span class="mi">1</span><span class="p">,</span> <span class="mi">2</span><span class="o">**</span><span class="n">n</span><span class="p">):</span>
        <span class="n">tree</span><span class="o">.</span><span class="n">append</span><span class="p">(</span><span class="nb">str</span><span class="p">(</span><span class="nb">bin</span><span class="p">(</span><span class="n">i</span><span class="p">))[</span><span class="mi">2</span><span class="p">:]</span><span class="o">.</span><span class="n">zfill</span><span class="p">(</span><span class="n">n</span><span class="p">))</span>
    <span class="n">v</span> <span class="o">=</span> <span class="p">[]</span>
    <span class="k">for</span> <span class="n">p</span> <span class="ow">in</span> <span class="n">probabilities</span><span class="p">:</span>
        <span class="n">v</span><span class="o">.</span><span class="n">append</span><span class="p">([</span><span class="mf">1.</span><span class="p">,</span> <span class="o">-</span><span class="n">p</span><span class="p">])</span>
    <span class="n">prod</span> <span class="o">=</span> <span class="mi">0</span>
    <span class="c"># multiply all probabilities*(-1) according to tree</span>
    <span class="k">for</span> <span class="n">branch</span> <span class="ow">in</span> <span class="n">tree</span><span class="p">:</span>
        <span class="n">inter_prod</span> <span class="o">=</span> <span class="mf">1.</span>
        <span class="k">for</span> <span class="n">i</span><span class="p">,</span> <span class="n">leaf</span> <span class="ow">in</span> <span class="nb">enumerate</span><span class="p">(</span><span class="n">branch</span><span class="p">):</span>
            <span class="n">inter_prod</span> <span class="o">*=</span> <span class="n">v</span><span class="p">[</span><span class="n">i</span><span class="p">][</span><span class="nb">int</span><span class="p">(</span><span class="n">leaf</span><span class="p">)]</span>
        <span class="n">prod</span> <span class="o">+=</span> <span class="n">inter_prod</span>
    <span class="k">return</span> <span class="o">-</span><span class="n">prod</span></pre>
<p>It is clearly non optimised, and the number of computations grows exponentially with the number of probabilities.</p>
<p style="text-align: left;">Interested in the topic? Below two books on Python (I read the High Performance Python, which IMO should be read by anyone writing scientific code) plus two on the subject (which I admit I haven't read).</p>
<p>[amazon_link asins='1449361595,0486679993,B0000CM0MD,0471778648' template='ProductGrid' store='visualab-20' marketplace='US' link_id='cb3d5c13-8d9c-11e7-8525-fb3bd5b60163']</p>
<p>The post <a rel="nofollow" href="http://www.visualab.org/index.php/rounding-error-algebraic-processes">Floating Points –Rounding Errors in Algebraic Processes</a> appeared first on <a rel="nofollow" href="http://www.visualab.org">Visualab</a>.</p>
]]></content:encoded>
			<wfw:commentRss>http://www.visualab.org/index.php/rounding-error-algebraic-processes/feed</wfw:commentRss>
		<slash:comments>0</slash:comments>
		</item>
		<item>
		<title>If heat is released from a system, will entropy increase?</title>
		<link>http://www.visualab.org/index.php/if-heat-is-released-from-a-system-will-entropy-increase</link>
		<comments>http://www.visualab.org/index.php/if-heat-is-released-from-a-system-will-entropy-increase#respond</comments>
		<pubDate>Sat, 20 Sep 2014 07:34:49 +0000</pubDate>
		<dc:creator><![CDATA[Mario Alemi]]></dc:creator>
				<category><![CDATA[Articles]]></category>
		<category><![CDATA[Scienza]]></category>
		<category><![CDATA[entropy]]></category>
		<category><![CDATA[physics]]></category>
		<category><![CDATA[thermodynamics]]></category>

		<guid isPermaLink="false">http://www.visualab.org/?p=253</guid>
		<description><![CDATA[<p>Let's ask ourselves this question –will our knowledge about a system increase or decrease when the system cools down? When it's hot, there is high uncertainty about position and speed of the molecules composing the system. The more temperature goes down, the more precise your knowledge about position and speed will be. Because von Neumann says [&#8230;]</p>
<p>The post <a rel="nofollow" href="http://www.visualab.org/index.php/if-heat-is-released-from-a-system-will-entropy-increase">If heat is released from a system, will entropy increase?</a> appeared first on <a rel="nofollow" href="http://www.visualab.org">Visualab</a>.</p>
]]></description>
				<content:encoded><![CDATA[<p>Let's ask ourselves this question –will our knowledge about a system increase or decrease when the system cools down?</p>
<p>When it's hot, there is high uncertainty about position and speed of the molecules composing the system. The more temperature goes down, the more precise your knowledge about position and speed will be.</p>
<p>Because von Neumann says that entropy is the missing information between a macroscopic description and a microscopic one, you have the answer –entropy goes down when temperature goes down. At 0 kelvin, the macroscopic description gives you exactly the same information than the microscopic one, therefore the entropy is zero....</p>
<p><span class="qlink_container"><a href="http://www.quora.com/If-heat-is-released-from-a-system-will-entropy-increase/answer/Mario-Alemi">If heat is released from a system, will entropy increase?</a></span></p>
<p>The post <a rel="nofollow" href="http://www.visualab.org/index.php/if-heat-is-released-from-a-system-will-entropy-increase">If heat is released from a system, will entropy increase?</a> appeared first on <a rel="nofollow" href="http://www.visualab.org">Visualab</a>.</p>
]]></content:encoded>
			<wfw:commentRss>http://www.visualab.org/index.php/if-heat-is-released-from-a-system-will-entropy-increase/feed</wfw:commentRss>
		<slash:comments>0</slash:comments>
		</item>
		<item>
		<title>Taming Complexity –The Magnum Ice Cream</title>
		<link>http://www.visualab.org/index.php/complexity-theory-and-organizations</link>
		<comments>http://www.visualab.org/index.php/complexity-theory-and-organizations#respond</comments>
		<pubDate>Thu, 24 Oct 2013 10:49:13 +0000</pubDate>
		<dc:creator><![CDATA[Mario Alemi]]></dc:creator>
				<category><![CDATA[Entropy]]></category>
		<category><![CDATA[complexity theory]]></category>
		<category><![CDATA[entropy]]></category>
		<category><![CDATA[graph theory]]></category>
		<category><![CDATA[information]]></category>
		<category><![CDATA[marketing]]></category>

		<guid isPermaLink="false">http://www.visualab.org/?p=231</guid>
		<description><![CDATA[<p>&#160; The Magnum: As Simple as Possible Giacomo, in his "Cremeria Castiglione", explains to me how he is able to make one of the best gelatos in Bologna, and possibly in Italy. This means, for Italians at least, one of the best ice creams in the world. "Making gelato is like baking pizza," he says. [&#8230;]</p>
<p>The post <a rel="nofollow" href="http://www.visualab.org/index.php/complexity-theory-and-organizations">Taming Complexity –The Magnum Ice Cream</a> appeared first on <a rel="nofollow" href="http://www.visualab.org">Visualab</a>.</p>
]]></description>
				<content:encoded><![CDATA[<p>&nbsp;</p>
<h2>The Magnum: As Simple as Possible</h2>
<p><span style="font-weight: 400;">Giacomo, in his "Cremeria Castiglione", explains to me how he is able to make one of the best gelatos in Bologna, and possibly in Italy. This means, for Italians at least, one of the best ice creams in the world. "Making gelato is like baking pizza," he says. "You wouldn't try to sell a pizza hours after it's baked. The same goes for the gelato –it must be eaten fresh. Only when I realize I’m running out of a flavour do I take all the necessary ingredients, pasteurize them at high temperature, blend them at low temperature and sell it immediately after".</span></p>
<p><span style="font-weight: 400;">Italians love gelato. On hot summer afternoons, cities fill up with families strolling around, each member with a gelato in hand. I have always been part of this collective passion: when I was a teenager, my friends and I preferred to meet outside gelaterias and indulge in huge ice cream cones, rather than get drunk in bars</span></p>
<p><span style="font-weight: 400;">In a country where the gelato is sold soon after preparation, and where teenagers prefer it to alcoholic beverages, you may wonder how packaged ice creams can possibly sell at all. But they do, and account for 30 percent of the Italian ice cream market thanks to heavy marketing and widespread distribution. Of the 30 percent, half is in the hands of Anglo-Dutch multinational Unilever, under the brand Algida. </span></p>
<p><span style="font-weight: 400;">For decades, Algida's strongest seller was the Cornetto, an imitation of the artisanal ice cream cone, which was launched in 1959, the same year Fellini produced La Dolce Vita. Thirty years later, the country was miles away from the economic boom described by Fellini, but the Cornetto hung around and was joined by a considerable number of competitors.</span></p>
<p><span style="font-weight: 400;">The 1980s  were a time of consumerist excess, with brands offering cherry, amaretto, chocolate and biscuit all in the same ice cream. It was in this environment that Unilever, in 1989, launched Magnum, the simplest ice cream bar ever –vanilla with a chocolate coating.</span></p>
<p><span style="font-weight: 400;">As an apocryphal quotation of Albert Einstein goes, "things should be as simple as possible, but not simpler</span><span style="font-weight: 400;">"[1]. The Magnum was simple, but not straightforward. Most ice creams had vanilla filling, but only few of them had good quality vanilla, and not one that was covered by thick, good, real chocolate.  To produce good quality coating, Unilever asked Belgian Callebaut to develop a chocolate that could go down to -40 degrees without breaking, something did not exist before.</span></p>
<p><span style="font-weight: 400;">The Magnum stood out from the crowd because it was simple, yet sophisticated. According to Unilever, it was already in 1992 "Europe’s most popular chocolate ice cream bar"[2]</span></p>
<p><span style="font-weight: 400;">Simplicity, though, did not last for long with the Magnum. With time, the Magnum evolved from the original ice cream to an ecosystem of elaborated ice creams: Almond, Mint, Caramel and Nuts, Yogurt; bigger and smaller Magnums; even Magnums without sticks. The original Magnum, in this new fauna of Magnum Ice Creams, was renamed Magnum Classic.</span></p>
<p>&nbsp;</p>
<h2><strong>The Magnum Syndrome</strong><img class="qtext_image zoomable_in zoomable_in_feed" src="http://qph.is.quoracdn.net/main-qimg-9cf4457ad39db210677c38a81ef0f802" alt="" /><a href="http://www.visualab.org/wp-content/uploads/magnum_ice_cream_classic.jpg"><img class="alignleft size-medium wp-image-729" src="http://www.visualab.org/wp-content/uploads/magnum_ice_cream_classic-300x300.jpg" alt="" width="300" height="300" srcset="http://www.visualab.org/wp-content/uploads/magnum_ice_cream_classic-300x300.jpg 300w, http://www.visualab.org/wp-content/uploads/magnum_ice_cream_classic-150x150.jpg 150w, http://www.visualab.org/wp-content/uploads/magnum_ice_cream_classic.jpg 500w" sizes="(max-width: 300px) 100vw, 300px" /></a></h2>
<p>&nbsp;</p>
<p><span style="font-weight: 400;">When this process of differentiation started, and the promise of simplicity was broken, I got upset. When Unilever came out with Moments, small ice creams stuffed with caramel and hazelnut, I decided the company had reached the limit, and prophesied Magnum's fall from greatness to dust. In conversations, whenever dealing with something unnecessarily complex, I would refer to what I called the Magnum Syndrome: "Things start nice and simple, but with time they accumulate complexity. This is when they lose their strength, like in the Magnum's case: it is not the delicacy it used to be, there’s too much noise around."</span></p>
<p><span style="font-weight: 400;">I could find plenty that had fallen victim to the Magnum Syndrome. One of these was, in my opinion, elementary particle physics, my field of research. CERN, the European Laboratory for Nuclear Physics in Geneva where I started working in 1994, was setting up the Large Hadron Collider. For the first time, thousands of physicists, engineers, software developers were working together on a single experiment, and most scientists only had a very limited view of the experiment they were working on. Scientific articles were signed by hundreds of people, and a few names were still attributed authorship long after they had left the institution. This was a far cry from the physics of the pioneers I studied –and idealised– at university. There, a few great minds created theories and ran experiments in the isolation of their university offices and labs. Everyone involved in an experiment knew everything about it, and in case of a discovery there was never more than three people accounting for the idea –possibly because the Nobel can at most be awarded to three people for the same discovery. In those good old days, particle physics skyrocketed. During my research times in the 1990s, although we still have thousands of scientists working on huge investments, particle physics practically grounded to a halt, with no major discoveries made or in sight for the 2000s.</span></p>
<p><span style="font-weight: 400;">My explanation was that physics had lost its original "hippy", relaxed atmosphere. Its simplicity. At CERN, there were fewer people strolling around the campus, smoking, wearing shorts and sandals, and more people in suits talking loudly into mobile phones. The way CERN's management reacted to the "invention" of the World Wide Web by Tim Berners-Lee, was a clear sign of a bureaucratic hierarchy paralysing new initiatives. Not only did they not show any interest in Berners-Lee's project during the R&amp;D phase[3]</span><span style="font-weight: 400;">, but even after the Web exploded into something undeniably huge[4]</span><span style="font-weight: 400;">.</span></p>
<p><span style="font-weight: 400;">Perhaps as a result of the dire state of information technology at CERN, I became highly pessimistic about computer science in general. In the 1970s, a few programmers had been able to create huge amounts of "free software", isolated in their dormitory room. Now, software development was becoming too complex to be managed by a single developer, and in the future only big corporations would have been able to produce high quality software. According to friends working on 20-year old software used by big banks, the complexity of the code –multiple intricate layers written by generations of programmers– was so high they couldn’t understand how banks could possibly run without major problems.</span></p>
<p><span style="font-weight: 400;">My small world of particle physics and software seemed irretrievably doomed and as far as I was concerned the real world was not doing much better. A few self-appointed "developed countries" took on the task of saving the world using harsh economic policies imposed to the "developing countries". But these policies appeared, at best, useless. According to Nobel prize Joseph Stiglitz, they were actually worsening the situation. Financial crashes in Asia, Brazil and, finally, Argentina –with people starving to death because of the financial default– did not paint a happy picture for the future of the planet.</span></p>
<p><span style="font-weight: 400;">In sum, everything was a huge... complex mess.</span></p>
<p><span style="font-weight: 400;">When Cherry Guevara was launched, together with other terrible Magnum flavours like the John Lemon, the Wood Choc, and the Jami Hendrix, I considered them the four Horsemen of the Apocalypse. The Magnum ecosystem will collapse soon, I was thinking while biting into my Classic. And global capitalism will surely follow.</span></p>
<h2>Taming Complexity</h2>
<div>
<p><span style="font-weight: 400;">I might have thought that particle physics had become too complex, but I did still believe it to be a good candidate to understand the continuous increase of complexity in the real world. Even today I continue to be convinced that physics is an extremely successful tool with which to tame complexity.</span></p>
<p><span style="font-weight: 400;">Examples of physics successfully taming complexity abound. Take statistical mechanics. During 19</span><span style="font-weight: 400;">th</span><span style="font-weight: 400;"> century, physicists studied the statistical properties of the motion of molecules in a gas and discovered that despite their seeming randomness, properties like temperature, pressure, and even the obscure concept of entropy were all explainable in terms of probability: the behaviour of billions of molecules could be described by just a few variables linked to each other. Then there is chaos theory, whose formulas, the strange attractors, could reproduce the formation of complex structures like snowflakes, or the elegance behind a fern's branch.</span></p>
<p><span style="font-weight: 400;">How did physics reach these successes in the past? When dealing with complexity, physics creates ideal worlds, stripping away as many variables as possible from the system to be studied. In statistical mechanics for instance, this meant pretending that particles in a gas have no volume, and bounce between each other in a perfectly elastic way. Focusing on this artificial system –the perfect gas– physics was able to come up with models that could explain with good approximation the behaviour of real gases. With time, particles in the perfect gas became less ideal. They got volume, different mass and shape, and physics created new, more complex models to account for this increased complexity.</span></p>
<p><span style="font-weight: 400;">A similar thing had happened for chaos theory. It was born to model the motion of three point-like bodies interacting through gravity, and, growing in complexity, it ended up being used in meteorology and finance.</span></p>
<p><span style="font-weight: 400;">This idealisation method is key to physics. But how can one possibly find an ideal system with which to describe the behaviour of the stock market, human societies or the marketing strategy of Unilever? </span></p>
</div>
<h2>The Network Revolution</h2>
<div>
<p><span style="font-weight: 400;">With perfect timing, a new branch of physics was officially born together with the fauna of Magnum ice creams: network theory. Network theory was the illegitimate child of the World Wide Web. With the Web, it finally became possible to obtain data with which to study how networks evolve. Physicists and mathematicians threw themselves into data analysis and modelling, and with new results on social topics too: networks of people exchanging email messages, web sites referring to each other, blog feeds, all produced an abundance of digital data. Results were so original that stern journals like the Physical Review begun to publish articles on social networks –a social topic, for the first time ever.</span></p>
<p><span style="font-weight: 400;">What is great about network theory, is that thanks to it physicists abandoned the ivory tower in which they had isolated themselves. For a century, after the arrival of quantum mechanics and relativity, physicists focused on questions very few people were asking. The experiment I worked on at CERN still today studies how the "beauty quark" breaks cp-symmetry, which is like asking: "How different is the world of elementary particles when looked at in the mirror?" It is a fascinating topic in physics. However, it is perhaps a little bit preposterous to invest huge amounts of money, not to mention the work of thousands of scientists, to try to define a few more digits of a parameter that describes the behaviour of a quark observed through a mirror. To say the least, it is extremely loosely connected with the “real world”. </span></p>
<p><span style="font-weight: 400;">Finally at last, though, with network theory, physicists were entering the arena, and facing the complexity of the "real world" – just like biologist, economists, sociologists, and anthropologists had been doing for a while.</span></p>
<p><span style="font-weight: 400;">The power of networks is that everything can be reduced to a network and studied, even the Magnum ecosystem. As soon as we can connect two ice creams because they have in common a particular ingredient, like caramel or dark chocolate, or are part of the same offer, like the "Seven Deadly Sins", we have a network.</span></p>
<p><span style="font-weight: 400;">As will be dutifully explained in an upcoming chapter, we can even build a "Magnum directed network", similar to the Web network. Just as in the Web, one page leads to other pages; here, one ice cream leads to others. For instance, the first Magnum Classic leads to the first four Magnum variations (Double Caramel, Dark, Double Chocolate, and Almond) that followed it a few years later while the Double Caramel leads to Taste (in the Five Senses) and Sloth (in the Seven Sins), which are similar ice creams that were subsequently launched.  With the Magnum network, we can use the same formula Google uses to compute the influence that each web page has in the Web to arrive at the influence that each ice cream has on the Magnum ecosystem.</span></p>
</div>
<div><a href="http://www.visualab.org/wp-content/uploads/magnum_graph.png"><img class="size-medium wp-image-728 alignleft" src="http://www.visualab.org/wp-content/uploads/magnum_graph-300x188.png" alt="" width="300" height="188" srcset="http://www.visualab.org/wp-content/uploads/magnum_graph-300x188.png 300w, http://www.visualab.org/wp-content/uploads/magnum_graph-768x482.png 768w, http://www.visualab.org/wp-content/uploads/magnum_graph.png 858w" sizes="(max-width: 300px) 100vw, 300px" /></a><img class="qtext_image zoomable_in zoomable_in_feed" src="http://qph.is.quoracdn.net/main-qimg-f3b409fd9122b68cf4647b8d6a1dde79" alt="" />In this way, we can draw a graphical representation of the increase in complexity of the Magnum system over time. From the simple "star" at the beginning of the 1990s with one central ice cream and four peripheral ones, to the intricate network arrived at post 2000.</div>
<div>
<p><span style="font-weight: 400;">If we traced the evolution of the Web over the same period, we would get similar figures. We would see complexity emerge from the first 30 webpages published by Berners-Lee in 1990 to the billion pages in 2000.</span></p>
<p><span style="font-weight: 400;">The very concept of network is very pervasive. Once you start thinking in terms of network, you see networks everywhere because... well, because everything can be connected with everything. Like Tim Berners-Lee, the creator of the World Wide Web, says: "In an extreme view, the world can be seen as only connections, nothing else</span><span style="font-weight: 400;">". And Lazlo Barabasi, one of the founding fathers of network theory, adds: "Even language ... is a network, made up of words connected by syntactic relationships."</span></p>
<h2>Life and The Magnum Strategy</h2>
<p><span style="font-weight: 400;">One of the first scientists to analyse the emergence of complexity in networks was polymath Herbert Simon, in 1962 –although he refers to networks as "systems". In his enlightening essay "The Architecture of Complexity", Simon writes: "We find cells organized into tissues, tissues into organs, organs into [physiological] system." We are part of bigger networks (life on earth, the solar system, the Milky Way galaxy, the universe) and are made of smaller networks like organs and cells.</span></p>
<p><span style="font-weight: 400;">Crucially, in this essay, Simon shows that living systems necessarily evolve towards greater complexity, because through complexity life increases its chance of survival. Be life a cell, an organism, or a corporation, any system will grow increasingly complex in order to survive.</span></p>
<p><span style="font-weight: 400;">In complex, organised, networks, "the whole is more than the sum of its parts", writes Simon. This "more", this emergent property of the system, is what makes different elements get together in a network and cooperate. The cells in our body, for instance, get together because, when organised in a human organism, they can outlive cells that exist in isolation. One neuron, isolated, would die in a matter of days. Ninety billion of them, connected, can survive for a century.</span></p>
<p><span style="font-weight: 400;">When Simon wrote the article, the idea that there could be self-organisation processes in complex systems was taking ground –and not just in science either. Politically, after the disaster of World War Two, most European countries finally decided to allow every citizen to participate in political life rather than limiting decision making to a few "aristocratic" male individuals. Financially, companies like Intel in California –and many more around the world– were showing that a large degree of hierarchical organisation was not necessary, and with just a minimal amount, success was possible.</span></p>
<p><span style="font-weight: 400;">Simon was right. I, on the other hand, had been completely missing the big picture when criticising complexity.</span></p>
<p><span style="font-weight: 400;">What if we thought of the Magnum Ice Creams as an organism? Being sold under the same brand, Magnums form a collaborating community: each Magnum tell us something about the other Magnums –something good – with all Magnums starting with the most excellent of reputations, based on the original Classic's. A customer will expect, and find, good quality ingredients in any Magnum because she knows that the original Magnum's strength was good quality vanilla, and thick Belgian chocolate. In this sense the Classic has a link with all other Magnums collaborating with them in a ‘virtuous circle’: the Classic's reputation gets stronger as it "recommends" other high quality ice creams, which in turn, being actually decent, "recommend" the original Classic. This potential circle can exist for Magnums other than the classic. Now under the area of influence of the Caramel are the "Caramel and Nuts" and "Sloth" Magnums, which Unilever introduced after its success.</span></p>
<p><span style="font-weight: 400;">With its fast growing reputation, Unilever would continue to introduce new Magnums at a fast pace, making the Magnum "empire" more complex, but also… bigger. Thanks to this strategy –complexity with high quality and strong connections– the Magnum became in 2000 the largest single ice cream brand in Europe</span><span style="font-weight: 400;">[5].</span></p>
<p><span style="font-weight: 400;">This success was not possible if all twenty-plus Magnums were sold by different companies, with different brands. We would see a situation similar to the one before the Magnum arrived: many over-complicated ice creams, where it is difficult to make a choice. The stronger the connection between the elements of a system, the bigger the possible success. No connections between the elements, no success.</span></p>
<p><span style="font-weight: 400;">Simon shows that Magnum's evolution towards complexity was not just a potential syndrome, but a powerful strategy –the Magnum Strategy.</span></p>
<p><span style="font-weight: 400;">A strategy which can be summarised as:</span></p>
<ol>
<li style="font-weight: 400;"><span style="font-weight: 400;">Start simple. Like Einstein said, "Avoid complexity whenever possible, but only then". Complexity should increase if, and only if, there are opportunities.</span></li>
<li style="font-weight: 400;"><span style="font-weight: 400;">Maximise collaboration. The creation of an organised structure is possible only when the members of the network collaborate: if one member discovers a new opportunity, other members should be able to learn from it.</span></li>
</ol>
<p><span style="font-weight: 400;">The Magnum system, in reality, is no different from any other system fighting for survival –i.e. any living system. And indeed, life itself has used the Magnum strategy over the past four billion years, from the creation of amino acids to successful human societies. </span></p>
<p><span style="font-weight: 400;">Biological cells are "vanilla" life</span><span style="font-weight: 400;">. They are the Magnum Classic of life. They are the first, simplest and most successful form of life ever: single-cell organisms comprise more than half of the total biomass on earth</span><span style="font-weight: 400;">.</span></p>
<p><span style="font-weight: 400;">With time, these single-cell organisms differentiated themselves –just as the Classic metamorphosed into Double Caramel, Dark etc, there are now thousands of different types of single-cell organisms, each one specialised on a certain task.</span></p>
<p><span style="font-weight: 400;">Importantly, just as Magnum introduced new ice creams as part of the same "offers" –the Seven Sins, the Five Senses and so on, a few cells joined forces to create the first multicellular organisms. These first organisms, compared to today's organisms were very simple: a kind of "vanilla organism", where all cells have the same task.</span></p>
<p><span style="font-weight: 400;">And then the same strategy was applied all over again to obtain a very familiar landscape: the first vanilla organisms became increasingly complex until, 400 million years ago, a few organisms joined forces and created social animals.</span></p>
<p><span style="font-weight: 400;">There is no end to the story. The first colonies of social animals were very simple until the late arrival  of the </span><i><span style="font-weight: 400;">homo</span></i><span style="font-weight: 400;">, whose skills in cooperation were boosted by an amazing ability in communicating. Three million years ago, </span><i><span style="font-weight: 400;">homo </span></i><span style="font-weight: 400;">existed in small, simple communities of less than 100 individuals. Now the </span><i><span style="font-weight: 400;">homo </span></i><span style="font-weight: 400;">lives in huge communities of millions of individuals, continuously increasing its communication and cooperation ability.</span></p>
<p><span style="font-weight: 400;">All forms of life, biological cells, human societies, and even ice cream brands, share numerous characteristics. But first and foremost, they are smart networks –they learn and over time increase their chances of survival through collaboration and communication.</span></p>
</div>
<ul>
<li>[1] Like most Einstein's quotations, the quotation is indeed apocryphal. The original one is: "It can scarcely be denied that the supreme goal of all theories is to make the irreducible basic elements as simple and as few as possible without having to surrender the adequate representation of a single datum of experience". Given that Einstein's writing style rarely follows the precepts of the apocryphal one, I believe the use of the latter is justified.</li>
<li>[2] <span style="font-weight: 400;">Floris A. Maljers, "Inside Unilever: The Evolving Transnational Company", Harvard Business Review, September 1992</span></li>
<li>[3] Berners-Lee, T., Fischetti, M., &amp; Foreword By-Dertouzos, M. L. (2000). Weaving the Web: The original design and ultimate destiny of the World Wide Web by its inventor. Harper Information.</li>
<li>[4] <span style="font-weight: 400;">The funniest proposal I heard was that CERN should have charged a tiny amount of money –say one millionth of dollar– whenever a Web page (any page, not just CERN's pages) was visited by someone surfing the web. Interestingly, the University of Minnesota applied this business model to Gopher, an hypertext protocol which challenged the Web at its birth. Soon after the announcement, "industry dropped Gopher like a hot potato",  as Tim Berners-Lee said.</span></li>
<li>[5] Clarke, C. (2012). "The science of ice cream". Royal Society of Chemistry.</li>
</ul>
<p>The post <a rel="nofollow" href="http://www.visualab.org/index.php/complexity-theory-and-organizations">Taming Complexity –The Magnum Ice Cream</a> appeared first on <a rel="nofollow" href="http://www.visualab.org">Visualab</a>.</p>
]]></content:encoded>
			<wfw:commentRss>http://www.visualab.org/index.php/complexity-theory-and-organizations/feed</wfw:commentRss>
		<slash:comments>0</slash:comments>
		</item>
		<item>
		<title>Can a lion jump 36 feet?</title>
		<link>http://www.visualab.org/index.php/can-a-lion-jump-36-feet</link>
		<comments>http://www.visualab.org/index.php/can-a-lion-jump-36-feet#respond</comments>
		<pubDate>Wed, 07 Aug 2013 15:33:41 +0000</pubDate>
		<dc:creator><![CDATA[Mario Alemi]]></dc:creator>
				<category><![CDATA[Articles]]></category>

		<guid isPermaLink="false">http://www.visualab.org/?p=226</guid>
		<description><![CDATA[<p>Using data from Rory Young's quora answer: yes, a lion definitely can jump 10+ meters. The horizontal distance D of a projectile with speed V, launched at an angle is: Which gives, for a lion running at 54km/sec, i.e. V=15 m/s, jumping at an angle of 45 degrees, and assuming : Considering that running at [&#8230;]</p>
<p>The post <a rel="nofollow" href="http://www.visualab.org/index.php/can-a-lion-jump-36-feet">Can a lion jump 36 feet?</a> appeared first on <a rel="nofollow" href="http://www.visualab.org">Visualab</a>.</p>
]]></description>
				<content:encoded><![CDATA[<p>Using data from <a href="http://www.quora.com/Physics/Can-a-lion-jump-36-feet">Rory Young's quora answer</a>: yes, a lion definitely can jump 10+ meters.</p>
<p>The horizontal distance <i>D</i> of a projectile with speed <i>V</i>, launched at an angle <span class='MathJax_Preview'><img src='http://www.visualab.org/wp-content/plugins/latex/cache/tex_2554a2bb846cffd697389e5dc8912759.gif' style='vertical-align: middle; border: none; ' class='tex' alt="\theta" /></span><script type='math/tex'>\theta</script> is:</p>
<p><span class='MathJax_Preview'><img src='http://www.visualab.org/wp-content/plugins/latex/cache/tex_0dda34fc270fc768a6bd085e69897495.gif' style='vertical-align: middle; border: none; ' class='tex' alt="D = V^2 \cdot sin(2\theta) / g" /></span><script type='math/tex'>D = V^2 \cdot sin(2\theta) / g</script></p>
<p>Which gives, for a lion running at 54km/sec, i.e. V=15 m/s, jumping at an angle of 45 degrees, and assuming <span class='MathJax_Preview'><img src='http://www.visualab.org/wp-content/plugins/latex/cache/tex_a21f1ecd2be793f62277019ce3614437.gif' style='vertical-align: middle; border: none; ' class='tex' alt="g \approx 10m/s^2" /></span><script type='math/tex'>g \approx 10m/s^2</script>:</p>
<p><span class='MathJax_Preview'><img src='http://www.visualab.org/wp-content/plugins/latex/cache/tex_1e017e3798354087eebb15d013b3c250.gif' style='vertical-align: middle; border: none; ' class='tex' alt="D = 22.5 m" /></span><script type='math/tex'>D = 22.5 m</script></p>
<p>Considering that running at maximum speed and jumping at 45 degrees is very hard, even for a lion, this is an over-estimation. But jumping at 15 degrees would allow the lion to fly over a distance D:</p>
<p><span class='MathJax_Preview'><img src='http://www.visualab.org/wp-content/plugins/latex/cache/tex_af30419eb60b40de332757207e6bf2f5.gif' style='vertical-align: middle; border: none; ' class='tex' alt="D \approx 11 m = 36ft" /></span><script type='math/tex'>D \approx 11 m = 36ft</script></p>
<p>Below some books on the subject. I only read a few pages from each of them:</p>
<p>Guggisberg, in his "Simba: The life of a lion" reports a speed of 48-59kph, confirmed by Schaller in his "The Serengeti Lion: A Study of Predator-Prey Relations" –the reference book on the African Lion since its publication in 1972.</p>
<p>Previous estimates are given by Howell, in his "Speed in animals, their specialization for running and leaping" (1944): he reports lions' speed at 80kph, which was considered too high by Schaller.</p>
<p>[amazon_link asins='B01BX7ZQZM,B010WF47HE,B0007EGJZE' template='ProductGrid' store='visualab-20' marketplace='US' link_id='7e593d48-8da4-11e7-ad6b-4521d8151fd9']</p>
<p>The post <a rel="nofollow" href="http://www.visualab.org/index.php/can-a-lion-jump-36-feet">Can a lion jump 36 feet?</a> appeared first on <a rel="nofollow" href="http://www.visualab.org">Visualab</a>.</p>
]]></content:encoded>
			<wfw:commentRss>http://www.visualab.org/index.php/can-a-lion-jump-36-feet/feed</wfw:commentRss>
		<slash:comments>0</slash:comments>
		</item>
	</channel>
</rss>
