<?xml version="1.0" encoding="UTF-8"?>
<?xml-stylesheet href="http://feeds.feedburner.com/~d/styles/rss2full.xsl" type="text/xsl" media="screen"?><?xml-stylesheet href="http://feeds.feedburner.com/~d/styles/itemcontent.css" type="text/css" media="screen"?><rss xmlns:content="http://purl.org/rss/1.0/modules/content/" xmlns:wfw="http://wellformedweb.org/CommentAPI/" xmlns:dc="http://purl.org/dc/elements/1.1/" xmlns:atom="http://www.w3.org/2005/Atom" xmlns:creativeCommons="http://backend.userland.com/creativeCommonsRssModule" xmlns:feedburner="http://rssnamespace.org/feedburner/ext/1.0" version="2.0">

<channel>
	<title>dspLog</title>
	
	<link>http://www.dsplog.com</link>
	<description>Learning digital signal processing for digital communication</description>
	<pubDate>Sat, 19 Jul 2008 02:22:24 +0000</pubDate>
	<generator>http://wordpress.org/?v=2.5.1</generator>
	<language>en</language>
			<creativeCommons:license>http://creativecommons.org/licenses/by-nc/2.0/</creativeCommons:license><image><link>http://creativecommons.org/licenses/by-nc/2.0/</link><url>http://creativecommons.org/images/public/somerights20.gif</url><title>Some Rights Reserved</title></image><atom10:link xmlns:atom10="http://www.w3.org/2005/Atom" rel="self" href="http://feeds.feedburner.com/dsplogdotcom" type="application/rss+xml" /><feedburner:emailServiceId>1348583</feedburner:emailServiceId><feedburner:feedburnerHostname>http://www.feedburner.com</feedburner:feedburnerHostname><item>
		<title>ICCBN 2008, July 17-20  2008, IISc, Bangalore</title>
		<link>http://feeds.feedburner.com/~r/dsplogdotcom/~3/338531130/</link>
		<comments>http://www.dsplog.com/2008/07/18/iccbn-2008-july-2008-iisc-bangalore/#comments</comments>
		<pubDate>Fri, 18 Jul 2008 00:38:59 +0000</pubDate>
		<dc:creator>Krishna Pillai</dc:creator>
		
		<category><![CDATA[News]]></category>

		<category><![CDATA[conference]]></category>

		<category><![CDATA[IISc]]></category>

		<guid isPermaLink="false">http://www.dsplog.com/?p=203</guid>
		<description>Advanced Computing and Communication Society (ACS) of India is organizing ICCBN 2008 conference (International Conference on Communication, Convergence, and Broadband Networking) from July 17th to 20th 2008 at National Science Seminar Complex at Indian Institute of Science (IISc), Bangalore.
ICCBN Conference aims to provide             [...]</description>
			<content:encoded><![CDATA[<p><strong>Advanced Computing and Communication Society (ACS)</strong> of India is organizing <strong>ICCBN</strong> <strong>2008</strong> conference (International Conference on Communication, Convergence, and Broadband Networking) from July 17th to 20th 2008 at <strong>National Science Seminar Complex</strong> at Indian Institute of Science (<strong>IISc</strong>), Bangalore.</p>
<blockquote><p>ICCBN Conference aims to provide                        a premier forum for researchers, industry practitioners and                        educators to present and discuss the most recent ideas, innovations,                        trends, experiences, and concerns in the emerging areas of                        <strong>Communication</strong>, <strong>Convergence,</strong> and <strong>Broadband Networking</strong>.</p></blockquote>
<p><span id="more-203"></span></p>
<h2>Important links</h2>
<p>1. <a title="Program Schedule for ICCBN 2008" href="http://www.iccbn.net/progschedule.html">Program Schedule<br />
</a></p>
<p>As I see there are three major components for <strong>ICCBN 2008</strong> : <strong>Technical paper presentations</strong>, <strong>Industry watch</strong> and the <strong>Tutorial sessions</strong>.</p>
<p>2. <a title="Industry watch program @ ICCBN 2008" href="http://www.iccbn.net/indusry_watch.html">Industry watch</a></p>
<blockquote><p>Industry leaders present their perspective and share their views on design, development, deployment, direction and regulation of existing and emerging communications and networking technologies that facilitate access, move and storage of network information and content.</p></blockquote>
<p>3. <a title="Tutorials in ICCBN 2008" href="http://www.iccbn.net/tutorials_workshops.html">Tutorials</a></p>
<p>Around 6 tutorials (some happening in parallel)  spread over July19th and 20th are planned. The sessions are on Embedded Linux, Mobile phone OS, Nano technology, WiMax, Intellectual Property management, and Programming.</p>
<p>4. <a title="Registration page for ICCBN 2008" href="http://www.iccbn.net/registration.html">Registration</a></p>
<p>5. <a title="Accommodation at ICCBN 2008" href="http://www.iccbn.net/accomodation.html">Accommodation</a></p>
<p>I plan to attend the only the full day tutorial session on <strong>Insights Into IEEE 802.16e (WiMAX) PHY and MAC layers Design Concepts and Road Ahead</strong>, by Prasad VTSV, <a title="Samsung" href="http://www.samsung.com">Samsung.</a></p>
<p>Date: Sunday, 20th July 2008</p>
<p>Time: 9:00am to 5:00pm</p>
<p>If you plan to be around, for sure we can meet up.</p>
<address> </address>
<address> </address>
<address>Thanks,<br />
Krishna</address>

<p><a href="http://feeds.feedburner.com/~a/dsplogdotcom?a=mBm4cY"><img src="http://feeds.feedburner.com/~a/dsplogdotcom?i=mBm4cY" border="0"></img></a></p><div class="feedflare">
<a href="http://feeds.feedburner.com/~f/dsplogdotcom?a=UqQWGJ"><img src="http://feeds.feedburner.com/~f/dsplogdotcom?i=UqQWGJ" border="0"></img></a> <a href="http://feeds.feedburner.com/~f/dsplogdotcom?a=9WI6UJ"><img src="http://feeds.feedburner.com/~f/dsplogdotcom?i=9WI6UJ" border="0"></img></a> <a href="http://feeds.feedburner.com/~f/dsplogdotcom?a=CsuImj"><img src="http://feeds.feedburner.com/~f/dsplogdotcom?i=CsuImj" border="0"></img></a> <a href="http://feeds.feedburner.com/~f/dsplogdotcom?a=V4yOKj"><img src="http://feeds.feedburner.com/~f/dsplogdotcom?i=V4yOKj" border="0"></img></a> <a href="http://feeds.feedburner.com/~f/dsplogdotcom?a=Hv5q3j"><img src="http://feeds.feedburner.com/~f/dsplogdotcom?i=Hv5q3j" border="0"></img></a>
</div><img src="http://feeds.feedburner.com/~r/dsplogdotcom/~4/338531130" height="1" width="1"/>]]></content:encoded>
			<wfw:commentRss>http://www.dsplog.com/2008/07/18/iccbn-2008-july-2008-iisc-bangalore/feed/</wfw:commentRss>
		<feedburner:origLink>http://www.dsplog.com/2008/07/18/iccbn-2008-july-2008-iisc-bangalore/</feedburner:origLink></item>
		<item>
		<title>Deriving PDF of Rayleigh random variable</title>
		<link>http://feeds.feedburner.com/~r/dsplogdotcom/~3/337576720/</link>
		<comments>http://www.dsplog.com/2008/07/17/derive-pdf-rayleigh-random-variable/#comments</comments>
		<pubDate>Thu, 17 Jul 2008 00:51:24 +0000</pubDate>
		<dc:creator>Krishna Pillai</dc:creator>
		
		<category><![CDATA[random variables]]></category>

		<category><![CDATA[pdf]]></category>

		<category><![CDATA[Rayleigh]]></category>

		<guid isPermaLink="false">http://www.dsplog.com/?p=197</guid>
		<description>In the post on Rayleigh channel model, we stated that a circularly symmetric random variable is of the form , where real and imaginary parts are zero mean independent and identically distributed (iid) Gaussian random variables. The magnitude  which has the probability density,
 is called a Rayleigh random variable. Further, the phase  is [...]</description>
			<content:encoded><![CDATA[<p>In the post on <strong><a title="Rayleigh channel model" href="http://www.dsplog.com/2008/07/14/rayleigh-multipath-channel/">Rayleigh channel model</a></strong>, we stated that a circularly symmetric random variable is of the form <img src="http://www.dsplog.com/cgi-bin/mimetex.cgi?Z = X + jY" border="0" alt="" align="middle" />, where real and imaginary parts are zero mean independent and identically distributed (iid) Gaussian random variables. The magnitude <img src="http://www.dsplog.com/cgi-bin/mimetex.cgi?|Z|" border="0" alt="" width="32" height="15" align="middle" /> which has the <strong>probability density</strong>,</p>
<p><strong><img src="http://www.dsplog.com/cgi-bin/mimetex.cgi?p(z) = \frac{z}{\sigma^2}e^{\frac{-z^2}{2 \sigma^2}},\ \ \      z\ge 0" border="0" alt="" align="middle" /> </strong>is called a<strong> Rayleigh random variable</strong>. Further, the phase <img src="http://www.dsplog.com/cgi-bin/mimetex.cgi?\theta" border="0" alt="" align="middle" /> is uniformly distributed from <img src="http://www.dsplog.com/cgi-bin/mimetex.cgi?[0,\ 2\pi]" border="0" alt="" align="middle" />. In this post we will try to derive the expression for <strong>probability density</strong> <strong>function (PDF)</strong> for <img src="http://www.dsplog.com/cgi-bin/mimetex.cgi?|Z|" border="0" alt="" width="32" height="15" align="middle" /> and <img src="http://www.dsplog.com/cgi-bin/mimetex.cgi?\theta" border="0" alt="" align="middle" />.</p>
<p><span id="more-197"></span></p>
<p>The text provided in Section 5.4.5 of <a title="Principles of Electronic Communications Analog - Digital, by Pradip Kumar Ghosh" href="http://www.universitiespress.com/display.asp?categoryID=26&amp;isbn=978-81-7371-601-0&amp;detail=1">[ELECTRONIC-COMMUNICATION:PRADIP]</a> is used as reference.</p>
<h2>Joint probability</h2>
<p>The probability density function of <img src="http://www.dsplog.com/cgi-bin/mimetex.cgi?x" border="0" alt="" align="middle" /> is</p>
<p><img src="http://www.dsplog.com/cgi-bin/mimetex.cgi?p(x) = \frac{1}{\sqrt{2\pi\sigma^2}}e^{\frac{-x^2}{2\sigma^2}}" border="0" alt="" align="middle" />.</p>
<p>Similarly probability density function of <img src="http://www.dsplog.com/cgi-bin/mimetex.cgi?y" border="0" alt="" align="middle" /> is</p>
<p><img src="http://www.dsplog.com/cgi-bin/mimetex.cgi?p(y) = \frac{1}{\sqrt{2\pi\sigma^2}}e^{\frac{-y^2}{2\sigma^2}}" border="0" alt="" align="middle" />.</p>
<p>As <img src="http://www.dsplog.com/cgi-bin/mimetex.cgi?X" border="0" alt="" align="middle" /> and <img src="http://www.dsplog.com/cgi-bin/mimetex.cgi?Y" border="0" alt="" align="middle" /> are independent random variables, the <a title="Joint Probability on Wiki" href="http://en.wikipedia.org/wiki/Joint_probability_distribution">joint probability</a> is the product of the individual probability, i.e,</p>
<p><img src="http://www.dsplog.com/cgi-bin/mimetex.cgi?p(x,y) = \frac{1}{{2\pi\sigma^2}}e^{\frac{-(x^2+y^2)}{2\sigma^2}}" border="0" alt="" align="middle" />.</p>
<p>The joint probability that the random variable <img src="http://www.dsplog.com/cgi-bin/mimetex.cgi?X" border="0" alt="" align="middle" /> lies between <img src="http://www.dsplog.com/cgi-bin/mimetex.cgi?x" border="0" alt="" align="middle" /> and <img src="http://www.dsplog.com/cgi-bin/mimetex.cgi?x+dx" border="0" alt="" align="middle" /> and the random variable <img src="http://www.dsplog.com/cgi-bin/mimetex.cgi?Y" border="0" alt="" align="middle" />lies between <img src="http://www.dsplog.com/cgi-bin/mimetex.cgi?y" border="0" alt="" align="middle" /> and <img src="http://www.dsplog.com/cgi-bin/mimetex.cgi?y+dy" border="0" alt="" align="middle" />is,</p>
<p><img src="http://www.dsplog.com/cgi-bin/mimetex.cgi?P(x\le X+dx,y\le Y+dy)=\frac{1}{{2\pi\sigma^2}}e^{\frac{-(x^2+y^2)}{2\sigma^2}}dxdy" border="0" alt="" align="middle" />.</p>
<h2>Conversion to polar co-ordinate</h2>
<p>Given that <img src="http://www.dsplog.com/cgi-bin/mimetex.cgi?(x,y)" border="0" alt="" align="middle" /> is in the <a title="Cartesian co-ordinate on Wiki" href="http://en.wikipedia.org/wiki/Cartesian_coordinates">Cartesian co-ordinate form</a>, we can convert that into the <a title="Polar co-ordinate on Wiki" href="http://en.wikipedia.org/wiki/Polar_coordinates">polar co-ordinate</a> <img src="http://www.dsplog.com/cgi-bin/mimetex.cgi?(z,\theta)" border="0" alt="" align="middle" /> where,<br />
<img src="http://www.dsplog.com/cgi-bin/mimetex.cgi?Z=\sqrt{X^2+Y^2}" border="0" alt="" align="middle" /> and<br />
<img src="http://www.dsplog.com/cgi-bin/mimetex.cgi?\Theta = \tan^{-1}\left(\frac{Y}{X}\right)" border="0" alt="" align="middle" />.</p>
<p><img class="alignnone size-full wp-image-199" title="Cartesian coordinate to Polar coordinate" src="http://www.dsplog.com/db-install/wp-content/uploads/2008/07/cartesian_coordinate_to_polar_coordinate.png" alt="Cartesian coordinate to Polar coordinate" width="300" height="255" /></p>
<p><strong>Figure: Cartesian co-ordinate to polar co-ordinate</strong></p>
<p>The area <img src="http://www.dsplog.com/cgi-bin/mimetex.cgi?dxdy" border="0" alt="" align="middle" /> is Cartesian co-ordinate form is equal to the area <img src="http://www.dsplog.com/cgi-bin/mimetex.cgi?zdzd\theta" border="0" alt="" align="middle" /> in the polar co-ordinate form.</p>
<p><img src="http://www.dsplog.com/cgi-bin/mimetex.cgi?P(x\le X+dx,y\le Y+dy)=P(z\le Z+dz,\theta\le \Theta+d\theta)" border="0" alt="" align="middle" />.</p>
<p>Simplifying,<br />
<img src="http://www.dsplog.com/cgi-bin/mimetex.cgi?\begin{eqnarray}P(z\le Z+dz,\theta\le \Theta+d\theta)&amp;=&amp;\frac{1}{{2\pi\sigma^2}}e^{\frac{-(x^2+y^2)}{2\sigma^2}}zdzd\theta\\&amp;=&amp;{\frac{z}{{\sigma^2}}e^{\frac{-z^2}{2\sigma^2}}}dz{\frac{1}{2\pi}}d\theta\end{eqnarray}" border="0" alt="" align="middle" />.</p>
<p>Summarizing the joint probability density function,</p>
<p><img src="http://www.dsplog.com/cgi-bin/mimetex.cgi?p(z,\theta) = \frac{z}{{2\pi\sigma^2}}e^{\frac{-z^2}{2\sigma^2}}" border="0" alt="" align="middle" />.</p>
<p>Since <img src="http://www.dsplog.com/cgi-bin/mimetex.cgi?z" border="0" alt="" align="middle" /> and <img src="http://www.dsplog.com/cgi-bin/mimetex.cgi?\theta" border="0" alt="" align="middle" /> are independent, the individual <strong>probability density functions</strong> are,<br />
<img src="http://www.dsplog.com/cgi-bin/mimetex.cgi?p(z) = \frac{z}{{\sigma^2}}e^{\frac{-z^2}{2\sigma^2}},\ z\ge 0" border="0" alt="" align="middle" />,</p>
<p><img src="http://www.dsplog.com/cgi-bin/mimetex.cgi?p(\theta) = \frac{1}{2\pi},\ -\pi \le \theta \le \pi" border="0" alt="" align="middle" />.</p>
<h2>Simulation Model</h2>
<p>Simple Matlab/Octave simulation model is provided for plotting the probability density of <img src="http://www.dsplog.com/cgi-bin/mimetex.cgi?z" border="0" alt="" align="middle" /> and <img src="http://www.dsplog.com/cgi-bin/mimetex.cgi?\theta" border="0" alt="" align="middle" />. The script performs the following:</p>
<p>(a) Generate two independent zero mean, unit variance Gaussian random variables</p>
<p>(b) Using the hist() function compute the simulated probability density for both <img src="http://www.dsplog.com/cgi-bin/mimetex.cgi?z" border="0" alt="" align="middle" /> and<br />
<img src="http://www.dsplog.com/cgi-bin/mimetex.cgi?\theta" border="0" alt="" align="middle" /></p>
<p>(c) Using the knowledge of the equation (which we just derived), compute the theoretical probability<br />
density function (PDF)</p>
<p>(d) Plot the simulated and theoretical probability density functions (PDF) and show that they are in good agreement.</p>
<p>Click here to download <a title="Matlab/Octave script for simuating the pdf of Rayleigh random variable" href="http://www.dsplog.com/db-install/wp-content/uploads/2008/07/pdf_rayleigh_random_variable.m">Matlab/Octave script for simulating the <strong>probability density function</strong> (PDF) of <strong>Rayleigh random</strong> variable</a></p>
<p><img class="alignnone size-full wp-image-201" title="Plot of simulated/theoretical PDF of Rayleigh random variable" src="http://www.dsplog.com/db-install/wp-content/uploads/2008/07/pdf_rayleigh_random_variable.png" alt="" width="448" height="336" /></p>
<p><strong>Figure: Simulated/theoretical PDF of Rayleigh random variable</strong></p>
<p><img class="alignnone size-full wp-image-202" title="PDF of uniformly distributed theta random variable" src="http://www.dsplog.com/db-install/wp-content/uploads/2008/07/pdf_theta_random_variable.png" alt="PDF of uniformly distributed theta random variable" width="448" height="336" /></p>
<p><strong>Figure: Simulated/theoretical PDF of uniformly distributed theta random variable</strong></p>
<h2>Reference</h2>
<p class="editors"><a title="Principles of Electronic Communications Analog - Digital, by Pradip Kumar Ghosh" href="http://www.universitiespress.com/display.asp?categoryID=26&amp;isbn=978-81-7371-601-0&amp;detail=1">[ELECTRONIC-COMMUNICATION:PRADIP]</a> <a title="Principles of Electronic Communications Analog - Digital, by Pradip Kumar Ghosh" href="http://www.universitiespress.com/display.asp?categoryID=26&amp;isbn=978-81-7371-601-0&amp;detail=1">Principles of Electronic Communications Analog - Digital, by Pradip Kumar  Ghosh</a></p>

<p><a href="http://feeds.feedburner.com/~a/dsplogdotcom?a=5cEOA3"><img src="http://feeds.feedburner.com/~a/dsplogdotcom?i=5cEOA3" border="0"></img></a></p><div class="feedflare">
<a href="http://feeds.feedburner.com/~f/dsplogdotcom?a=IzIxtJ"><img src="http://feeds.feedburner.com/~f/dsplogdotcom?i=IzIxtJ" border="0"></img></a> <a href="http://feeds.feedburner.com/~f/dsplogdotcom?a=w3YlOJ"><img src="http://feeds.feedburner.com/~f/dsplogdotcom?i=w3YlOJ" border="0"></img></a> <a href="http://feeds.feedburner.com/~f/dsplogdotcom?a=588L4j"><img src="http://feeds.feedburner.com/~f/dsplogdotcom?i=588L4j" border="0"></img></a> <a href="http://feeds.feedburner.com/~f/dsplogdotcom?a=TiP5hj"><img src="http://feeds.feedburner.com/~f/dsplogdotcom?i=TiP5hj" border="0"></img></a> <a href="http://feeds.feedburner.com/~f/dsplogdotcom?a=NDDbRj"><img src="http://feeds.feedburner.com/~f/dsplogdotcom?i=NDDbRj" border="0"></img></a>
</div><img src="http://feeds.feedburner.com/~r/dsplogdotcom/~4/337576720" height="1" width="1"/>]]></content:encoded>
			<wfw:commentRss>http://www.dsplog.com/2008/07/17/derive-pdf-rayleigh-random-variable/feed/</wfw:commentRss>
		<feedburner:origLink>http://www.dsplog.com/2008/07/17/derive-pdf-rayleigh-random-variable/</feedburner:origLink></item>
		<item>
		<title>Rayleigh multipath channel model</title>
		<link>http://feeds.feedburner.com/~r/dsplogdotcom/~3/334640407/</link>
		<comments>http://www.dsplog.com/2008/07/14/rayleigh-multipath-channel/#comments</comments>
		<pubDate>Mon, 14 Jul 2008 00:42:53 +0000</pubDate>
		<dc:creator>Krishna Pillai</dc:creator>
		
		<category><![CDATA[channel]]></category>

		<category><![CDATA[Rayleigh]]></category>

		<guid isPermaLink="false">http://www.dsplog.com/?p=194</guid>
		<description>The article gives a quick overview of a simple statistical multipath channel model called Rayleigh fading channel model.
Multipath environment
In a multipath environment, it is reasonably intuitive to visualize that an impulse transmitted from transmitter will reach the receiver as a train of impulses.

Figure: Impulse response of a multipath channel 
Let the transmit bandpass signal be,
, [...]</description>
			<content:encoded><![CDATA[<p>The article gives a quick overview of a simple statistical multipath channel model called Rayleigh fading channel model.</p>
<h2>Multipath environment</h2>
<p>In a multipath environment, it is reasonably intuitive to visualize that an impulse transmitted from transmitter will reach the receiver as a train of impulses.<span id="more-194"></span></p>
<p><a title="Impulse response of a multipath channel"><img class="alignnone size-full wp-image-196" title="Multipath channel" src="http://www.dsplog.com/db-install/wp-content/uploads/2008/07/multipath_channel.png" alt="" width="430" height="141" /></a></p>
<p><strong>Figure: Impulse response of a multipath channel </strong></p>
<p>Let the transmit bandpass signal be,<br />
<img src="http://www.dsplog.com/cgi-bin/mimetex.cgi?x(t) = \Re\left\{x_b(t)e^{j2\pi f_ct}\right\}" border="0" alt="" align="middle" />, where</p>
<p><img src="http://www.dsplog.com/cgi-bin/mimetex.cgi?x_b(t)" border="0" alt="" align="middle" /> is the baseband signal,<br />
<img src="http://www.dsplog.com/cgi-bin/mimetex.cgi?f_c" border="0" alt="" align="middle" /> is the carrier frequency and<br />
<img src="http://www.dsplog.com/cgi-bin/mimetex.cgi?t" border="0" alt="" align="middle" /> is the time.</p>
<p>As shown above, the transmit signal reaches the receiver through multiple paths where the <img src="http://www.dsplog.com/cgi-bin/mimetex.cgi?n^{th}" border="0" alt="" align="middle" /> path has an attenuation <img src="http://www.dsplog.com/cgi-bin/mimetex.cgi?\alpha_n(t)" border="0" alt="" align="middle" /> and delay <img src="http://www.dsplog.com/cgi-bin/mimetex.cgi?\tau_n(t)" border="0" alt="" align="middle" />. The received signal is,</p>
<p><img src="http://www.dsplog.com/cgi-bin/mimetex.cgi?r(t) = \sum_n\alpha_n(t)x\[ t-\tau_n(t)\]" border="0" alt="" align="middle" />.</p>
<p>Plugging in the equation for transmit baseband signal from the above equation,</p>
<p><img src="http://www.dsplog.com/cgi-bin/mimetex.cgi?r(t) = \Re\left\{\sum_n\alpha_n(t)x_b[t-\tau_n(t)]e^{j2\pi f_c[t-\tau_n(t)]}\right\}" border="0" alt="" align="middle" />.</p>
<p>The baseband equivalent of the received signal is,</p>
<p><img src="http://www.dsplog.com/cgi-bin/mimetex.cgi?\begin{eqnarray}r_b(t)&amp; = &amp;\sum_n\alpha_n(t)e^{-j2\pi f_c\tau_n(t)}x_b[t-\tau_n(t)]\\&amp; = &amp;\sum_n\alpha_n(t)e^{-j\theta_n(t)}x_b[t-\tau_n(t)] \end{eqnarray}" border="0" alt="" align="middle" />,</p>
<p>where <img src="http://www.dsplog.com/cgi-bin/mimetex.cgi?\theta_n(t)=2\pi f_c \tau_n(t)" border="0" alt="" align="middle" /> is the phase of the <img src="http://www.dsplog.com/cgi-bin/mimetex.cgi?n^{th}" border="0" alt="" align="middle" />path.</p>
<p>The impulse response is,</p>
<p><img src="http://www.dsplog.com/cgi-bin/mimetex.cgi?\begin{eqnarray}h_b(t)&amp; = &amp;\sum_n\alpha_n(t)e^{-j\theta_n(t)} \end{eqnarray}" border="0" alt="" align="middle" />.</p>
<h2>Rayleigh fading model</h2>
<p>The phase of each path can change by <img src="http://www.dsplog.com/cgi-bin/mimetex.cgi?2\pi" border="0" alt="" align="middle" />radian when the delay  <img src="http://www.dsplog.com/cgi-bin/mimetex.cgi?\tau_n(t)" border="0" alt="" align="middle" /> changes by <img src="http://www.dsplog.com/cgi-bin/mimetex.cgi?\frac{1}{f_c}" border="0" alt="" align="middle" />. If <img src="http://www.dsplog.com/cgi-bin/mimetex.cgi?f_c" border="0" alt="" align="middle" />is large, relative small motions in the medium can cause change of <img src="http://www.dsplog.com/cgi-bin/mimetex.cgi?2\pi" border="0" alt="" align="middle" />radians. Since the distance between the devices are much larger than the wavelength of the carrier frequency, <em>it is reasonable to assume that the phase is uniformly distributed between 0 and <img src="http://www.dsplog.com/cgi-bin/mimetex.cgi?2\pi" border="0" alt="" align="middle" /> radians and the phases of each path are independent </em>(Sec 2.4.2 <a title="Fundamentals of Wireless Communication, David Tse, Pramod Viswanath" href="http://www.amazon.com/gp/redirect.html?ie=UTF8&amp;location=http%3A%2F%2Fwww.amazon.com%2FFundamentals-Wireless-Communication-David-Tse%2Fdp%2F0521845270&amp;tag=dl04-20&amp;linkCode=ur2&amp;camp=1789&amp;creative=9325">[WIRELESS-COMMUNICATION: TSE, VISWANATH]</a><img style="border: medium none  ! important; margin: 0px ! important;" src="http://www.assoc-amazon.com/e/ir?t=dl04-20&amp;l=ur2&amp;o=1" border="0" alt="" width="1" height="1" />).</p>
<p>When there are large number of paths, applying <a title="Central Limit Theorem from wiki" href="http://en.wikipedia.org/wiki/Central_limit_theorem">Central Limit Theorem</a>, each path can be modelled as <strong>circularly symmetric complex Gaussian random variable</strong> with time as the variable. This model is called <strong>Rayleigh fading channel model</strong>.</p>
<p>A circularly symmetric complex Gaussian random variable is of the form,</p>
<p><img src="http://www.dsplog.com/cgi-bin/mimetex.cgi?Z = X + jY" border="0" alt="" align="middle" />,</p>
<p>where real and imaginary parts are zero mean independent and identically distributed (iid) Gaussian random variables. For a <strong>circularly symmetric complex random variable</strong> <img src="http://www.dsplog.com/cgi-bin/mimetex.cgi?Z" border="0" alt="" align="middle" />,</p>
<p><img src="http://www.dsplog.com/cgi-bin/mimetex.cgi?E[Z] = E[e^{j\theta}Z]=e^{j\theta}E[Z]" border="0" alt="" align="middle" />.</p>
<p>The statistics of a circularly symmetric complex Gaussian random variable is completely specified by the variance,</p>
<p><img src="http://www.dsplog.com/cgi-bin/mimetex.cgi?\sigma^2=E[Z^2]" border="0" alt="" align="middle" />.</p>
<p>The magnitude <img src="http://www.dsplog.com/cgi-bin/mimetex.cgi?|Z|" border="0" alt="" width="32" height="15" align="middle" /> which has a probability density,</p>
<p><strong><img src="http://www.dsplog.com/cgi-bin/mimetex.cgi?p(z) = \frac{z}{\sigma^2}e^{\frac{-z^2}{2 \sigma^2}},\ \ \      z\ge 0" border="0" alt="" align="middle" /></strong></p>
<p>is called a<strong> Rayleigh random variable.</strong></p>
<p>This model, called <strong>Rayleigh fading channel model</strong>, is reasonable for an environment where there are large number of reflectors.</p>
<h2>Reference</h2>
<address><a title="Fundamentals of Wireless Communication, David Tse, Pramod Viswanath" href="http://www.amazon.com/gp/redirect.html?ie=UTF8&amp;location=http%3A%2F%2Fwww.amazon.com%2FFundamentals-Wireless-Communication-David-Tse%2Fdp%2F0521845270&amp;tag=dl04-20&amp;linkCode=ur2&amp;camp=1789&amp;creative=9325">[WIRELESS-COMMUNICATION: TSE, VISWANATH] </a><img style="border: medium none  ! important; margin: 0px ! important;" src="http://www.assoc-amazon.com/e/ir?t=dl04-20&amp;l=ur2&amp;o=1" border="0" alt="" width="1" height="1" /><a title="Fundamentals of Wireless Communication, David Tse, Pramod Viswanath" href="http://www.amazon.com/gp/redirect.html?ie=UTF8&amp;location=http%3A%2F%2Fwww.amazon.com%2FFundamentals-Wireless-Communication-David-Tse%2Fdp%2F0521845270&amp;tag=dl04-20&amp;linkCode=ur2&amp;camp=1789&amp;creative=9325">Fundamentals of Wireless Communication, David Tse, Pramod Viswanath</a><img style="border: medium none  ! important; margin: 0px ! important;" src="http://www.assoc-amazon.com/e/ir?t=dl04-20&amp;l=ur2&amp;o=1" border="0" alt="" width="1" height="1" /></address>
<address>
</address>
<address> </address>
<address>Note: </address>
<address>In a future post, we will try and derive the probability density function of sum of squares of independent Gaussian random variables</address>
<address> </address>

<p><a href="http://feeds.feedburner.com/~a/dsplogdotcom?a=fublNf"><img src="http://feeds.feedburner.com/~a/dsplogdotcom?i=fublNf" border="0"></img></a></p><div class="feedflare">
<a href="http://feeds.feedburner.com/~f/dsplogdotcom?a=wlzeUJ"><img src="http://feeds.feedburner.com/~f/dsplogdotcom?i=wlzeUJ" border="0"></img></a> <a href="http://feeds.feedburner.com/~f/dsplogdotcom?a=7GZTeJ"><img src="http://feeds.feedburner.com/~f/dsplogdotcom?i=7GZTeJ" border="0"></img></a> <a href="http://feeds.feedburner.com/~f/dsplogdotcom?a=waEurj"><img src="http://feeds.feedburner.com/~f/dsplogdotcom?i=waEurj" border="0"></img></a> <a href="http://feeds.feedburner.com/~f/dsplogdotcom?a=0xR2oj"><img src="http://feeds.feedburner.com/~f/dsplogdotcom?i=0xR2oj" border="0"></img></a> <a href="http://feeds.feedburner.com/~f/dsplogdotcom?a=vB4AHj"><img src="http://feeds.feedburner.com/~f/dsplogdotcom?i=vB4AHj" border="0"></img></a>
</div><img src="http://feeds.feedburner.com/~r/dsplogdotcom/~4/334640407" height="1" width="1"/>]]></content:encoded>
			<wfw:commentRss>http://www.dsplog.com/2008/07/14/rayleigh-multipath-channel/feed/</wfw:commentRss>
		<feedburner:origLink>http://www.dsplog.com/2008/07/14/rayleigh-multipath-channel/</feedburner:origLink></item>
		<item>
		<title>Comparing BPSK, QPSK, 4PAM, 16QAM, 16PSK, 64QAM and 32PSK</title>
		<link>http://feeds.feedburner.com/~r/dsplogdotcom/~3/329347615/</link>
		<comments>http://www.dsplog.com/2008/07/08/compare-bpsk-qpsk-4pam-16qam-16psk-64qam-32psk/#comments</comments>
		<pubDate>Tue, 08 Jul 2008 00:47:25 +0000</pubDate>
		<dc:creator>Krishna Pillai</dc:creator>
		
		<category><![CDATA[Capacity]]></category>

		<category><![CDATA[Error Rate]]></category>

		<category><![CDATA[AWGN]]></category>

		<category><![CDATA[PSK]]></category>

		<category><![CDATA[QAM]]></category>

		<guid isPermaLink="false">http://www.dsplog.com/?p=195</guid>
		<description>I have written another article in DSPDesginLine.com. This article can be treated as the third post in the series aimed at understanding Shannon&amp;#8217;s capacity equation.
For the first two posts in the series are:
1. Understanding Shannon&amp;#8217;s capacity equation
2. Bounds on Communication based on Shannon’s capacity
The article summarizes the symbol error rate derivations in AWGN for modulation [...]</description>
			<content:encoded><![CDATA[<p>I have written another article in <a title="Modulation roundup: error rates, noise, and capacity" href="http://www.dspdesignline.com/howto/208801783;jsessionid=KQBZX4ZJRFCX0QSNDLRSKHSCJUNN2JVN" target="_self">DSPDesginLine.com</a>. This article can be treated as the third post in the series aimed at understanding Shannon&#8217;s capacity equation.</p>
<p>For the first two posts in the series are:</p>
<p>1. <a title="Understanding Shannon's capacity equation" href="http://www.dsplog.com/2008/06/15/shannon-gaussian-channel-capacity-equation/">Understanding Shannon&#8217;s capacity equation</a></p>
<p>2. <a title="Bounds on Communication based on Shannon’s capacity" rel="bookmark" href="../../2008/06/18/bounds-on-communication-shannon-capacity/">Bounds on Communication based on Shannon’s capacity</a></p>
<p>The article summarizes the <strong>symbol error rate derivations</strong> in <strong>AWGN</strong> for modulation schemes like <strong>BPSK</strong>, <strong>QPSK</strong>, <strong>4PAM</strong>, <strong>16QAM</strong>, <strong>16PSK</strong>, <strong>64QAM</strong> and <strong>32PSK</strong>.</p>
<p><span id="more-195"></span></p>
<p>Based on the knowledge of <strong>bandwidth requirements</strong> for each type of modulation scheme, the <strong>capacity</strong> in bits/seconds/Hz is listed. Further, using the knowledge that the symbol to noise ratio <img src="../../cgi-bin/mimetex.cgi?%5Cfrac%7BE_s%7D%7BN_0%7D" border="0" alt="" width="24" height="33" align="absmiddle" /> is <img src="../../cgi-bin/mimetex.cgi?k=%5Clog_2%28M%29" border="0" alt="" align="absmiddle" /> times the bit to noise ratio <img src="../../cgi-bin/mimetex.cgi?%5Cfrac%7BE_b%7D%7BN_0%7D" border="0" alt="" align="absmiddle" />, the symbol error rate vs Eb/No curves are plotted. Using symbol error rate versus Eb/No plots, the Eb/No required for achieving symbol error rate of <img src="http://www.dsplog.com/cgi-bin/mimetex.cgi?10^{-5}" border="0" alt="" align="absmiddle" />is identified. Upon having the capacity and Eb/No requirement, the requirements for <strong>BPSK</strong>, <strong>QPSK</strong>, <strong>4PAM</strong>, <strong>16QAM</strong>, <strong>16PSK</strong>, <strong>64QAM</strong> and <strong>32PSK</strong> are <a href="http://www.dspdesignline.com/howto/208801783;jsessionid=KQBZX4ZJRFCX0QSNDLRSKHSCJUNN2JVN?pgno=3">mapped on to the Shannon&#8217;s capacity vs Eb/No curve</a>.</p>
<p>Further, assuming <strong>Gray coded modulation mapping</strong>,  each symbol error causes one bit out of <img src="http://www.dsplog.com/cgi-bin/mimetex.cgi?k=%5Clog_2%28M%29" border="0" alt="" align="absmiddle" /> bits to be in error. So, the relation between symbol error and bit error is,</p>
<p><img src="http://www.dsplog.com/cgi-bin/mimetex.cgi?P_b%20%5Capprox%20%5Cfrac%7BPs%7D%7Bk%7D" border="0" alt="" align="absmiddle" />.</p>
<p>Using this assumption, the <strong>Bit Error Rate (BER)</strong> for <strong>BPSK</strong>, <strong>QPSK</strong>, <strong>4PAM</strong>, <strong>16QAM, 16PSK</strong>, <strong>64QAM</strong> and <strong>32PSK</strong> are listed and the <strong>BER vs Eb/No curve</strong> plotted.</p>
<p>Hope this article serves as a nice overview of the various digital modulation schemes. Click here to read the <a title="Modulation roundup: error rates, noise, and capacity" href="http://www.dspdesignline.com/howto/208801783;jsessionid=KQBZX4ZJRFCX0QSNDLRSKHSCJUNN2JVN?pgno=1">full article in DSPDesignline.com</a></p>

<p><a href="http://feeds.feedburner.com/~a/dsplogdotcom?a=be6BMw"><img src="http://feeds.feedburner.com/~a/dsplogdotcom?i=be6BMw" border="0"></img></a></p><div class="feedflare">
<a href="http://feeds.feedburner.com/~f/dsplogdotcom?a=UJfpkJ"><img src="http://feeds.feedburner.com/~f/dsplogdotcom?i=UJfpkJ" border="0"></img></a> <a href="http://feeds.feedburner.com/~f/dsplogdotcom?a=JGE7oJ"><img src="http://feeds.feedburner.com/~f/dsplogdotcom?i=JGE7oJ" border="0"></img></a> <a href="http://feeds.feedburner.com/~f/dsplogdotcom?a=6dFnrj"><img src="http://feeds.feedburner.com/~f/dsplogdotcom?i=6dFnrj" border="0"></img></a> <a href="http://feeds.feedburner.com/~f/dsplogdotcom?a=xzlVEj"><img src="http://feeds.feedburner.com/~f/dsplogdotcom?i=xzlVEj" border="0"></img></a> <a href="http://feeds.feedburner.com/~f/dsplogdotcom?a=lO3Eyj"><img src="http://feeds.feedburner.com/~f/dsplogdotcom?i=lO3Eyj" border="0"></img></a>
</div><img src="http://feeds.feedburner.com/~r/dsplogdotcom/~4/329347615" height="1" width="1"/>]]></content:encoded>
			<wfw:commentRss>http://www.dsplog.com/2008/07/08/compare-bpsk-qpsk-4pam-16qam-16psk-64qam-32psk/feed/</wfw:commentRss>
		<feedburner:origLink>http://www.dsplog.com/2008/07/08/compare-bpsk-qpsk-4pam-16qam-16psk-64qam-32psk/</feedburner:origLink></item>
		<item>
		<title>Trying out PAPR reduction for OFDM by multiplication with j</title>
		<link>http://feeds.feedburner.com/~r/dsplogdotcom/~3/324480246/</link>
		<comments>http://www.dsplog.com/2008/07/02/ofdm-papr-reduction-multiplication-by-j/#comments</comments>
		<pubDate>Wed, 02 Jul 2008 01:08:41 +0000</pubDate>
		<dc:creator>Krishna Pillai</dc:creator>
		
		<category><![CDATA[Transmit signal]]></category>

		<category><![CDATA[CDF]]></category>

		<category><![CDATA[OFDM]]></category>

		<category><![CDATA[PAPR]]></category>

		<guid isPermaLink="false">http://www.dsplog.com/?p=190</guid>
		<description>In this post, we will explore a probable way of reducing PAPR (peak to average power ratio) in OFDM by changing the phase of some of the subcarriers. This is in response to the comment to post on Peak to Average power ratio for OFDM, where Mr. Elibom suggested to reduce the PAPR by cyclically [...]</description>
			<content:encoded><![CDATA[<p>In this post, we will explore a probable way of <strong>reducing PAPR (peak to average power ratio) in OFDM</strong> by changing the phase of some of the subcarriers. This is in response to the <a title="Comment on PAPR for OFDM" href="http://www.dsplog.com/2008/02/24/peak-to-average-power-ratio-for-ofdm/#comment-591" target="_self">comment to post on Peak to Average power ratio for OFDM</a>, where Mr. Elibom suggested to reduce the PAPR by cyclically rotate some of the subcarriers<span style="text-decoration: line-through;"> and using</span>.</p>
<p>Further, the presentation in the IEEE TGN,   <a title="IEEE TGN article on PAPR in HT-LTF" href="https://mentor.ieee.org/802.11/file/06/11-06-1595-01-000n-papr-in-ht-ltf.ppt">PAPR in HT-LTF (11-06/1595r1)</a>, mentions that in 40MHz mode where a 128pt FFT is used, PAPR of HT-LTF (High Throughput Long Training Field) can be reduced by  multiplying the upper 20MHz subcarriers by j. Using <span style="text-decoration: line-through;">quick</span> Matlab simulations, we will try to validate that claim for HT-LTF and further check the PAPR for a general random BPSK and QPSK modulation.</p>
<p><span id="more-190"></span></p>
<h2>PAPR in HT-LTF</h2>
<address>The HT-LTF sequence for the TG-N draft specification is described in page 35 of the <a title="IEEE TGN Joint Proposal PHY specification" href="https://mentor.ieee.org/802.11/file/05/11-05-1102-04-000n-joint-proposal-phy-specification.doc">Joint Proposal PHY specification document (11-05/1102r4)</a>. Note: The specification has evolved considerably over the past 2.5 years (and is not yet publically available), but for discussion on HT-LTF this document should suffice. </address>
<p>The peak to average power ratio for a signal <img src="http://www.dsplog.com/cgi-bin/mimetex.cgi?x%28t%29" border="0" alt="" align="middle" /> is defined as<br />
<img src="http://www.dsplog.com/cgi-bin/mimetex.cgi?papr%20=%20%5Cfrac%7B%5Cmax%5Cleft%5Bx%28t%29x%5E*%28t%29%5Cright%5D%7D%7BE%5Cleft%5Bx%28t%29x%5E*%28t%29%5Cright%5D%7D" border="0" alt="" align="middle" />, where<br />
<img src="http://www.dsplog.com/cgi-bin/mimetex.cgi?%28%29%5E*" border="0" alt="" align="middle" /> corresponds to the conjugate operator.</p>
<p>Expressing in deciBels,<br />
<img src="http://www.dsplog.com/cgi-bin/mimetex.cgi?papr_%7BdB%7D%20=%2010%5Clog_%7B10%7D%28papr%29" border="0" alt="" align="middle" />.</p>
<p><code><strong>Matlab/Octave script for computing PAPR in HT-LTF</strong><br />
close all; clear all;<br />
nFFT = 128; nDSC = 114;<br />
% The 128pt HT-LTF sequence for 40MHz as defined in 11-06/1595r4<br />
htLTF = [ zeros(1,6) 1 1 -1 -1 1 1 -1 1 -1 1 1 1 1 1 1 -1 -1 1 1 -1 1 -1 1 1 1 1 1 ...<br />
1 -1 -1 1 1 -1 1 -1 1 -1 -1 -1 -1 -1 1 1 -1 -1 1 -1 1 -1 1 1 1 1 -1 -1 -1 1 0 ...<br />
0 0 -1 1 1 -1 1 1 -1 -1 1 1 -1 1 -1 1 1 1 1 1 1 -1 -1 1 1 -1 1 -1 1 1 1 1 1 ...<br />
1 -1 -1 1 1 -1 1 -1 1 -1 -1 -1 -1 -1 1 1 -1 -1 1 -1 1 -1 1 1 1 1 zeros(1,5)];<br />
</code></p>
<p><code><br />
x1F = htLTF; % no rotation<br />
x2F = [htLTF(1:64) j*htLTF(65:128)]; % with 90degree rotation<br />
</code></p>
<p><code><br />
% Taking iFFT, time domain<br />
x1t = (nFFT/sqrt(nDSC))*ifft(fftshift(x1F.')).'; % no rotation<br />
x2t = (nFFT/sqrt(nDSC))*ifft(fftshift(x2F.')).'; % with rotation<br />
</code></p>
<p><code><br />
% computing the peak to average power ratio for symbol without rotation<br />
meanSquareValue1 = sum(x1t.*conj(x1t),2)/nFFT;<br />
peakValue1 = max(x1t.*conj(x1t),[],2);<br />
paprSymbol1 = peakValue1./meanSquareValue1;<br />
paprSymbol1dB = 10*log10(paprSymbol1)<br />
% computing the peak to average power ratio for symbol with 90 degree rotation<br />
meanSquareValue2 = sum(x2t.*conj(x2t),2)/nFFT;<br />
peakValue2 = max(x2t.*conj(x2t),[],2);<br />
paprSymbol2 = peakValue2./meanSquareValue2;<br />
paprSymbol2dB = 10*log10(paprSymbol2)</code></p>
<p>As claimed in slide7 of power point presentation <a title="IEEE TGN article on PAPR in HTLTF" href="https://mentor.ieee.org/802.11/file/06/11-06-1595-01-000n-papr-in-ht-ltf.ppt">PAPR In HT-LTF (11-06/1595r1)</a>, the PAPR with</p>
<p>(a) No rotation is 5.6317dB and</p>
<p>(b) With 90 degree rotation is 3.4066dB.</p>
<p>So, around <strong>2.2dB reduction in PAPR </strong>is achieved. <img src='http://www.dsplog.com/db-install/wp-includes/images/smilies/icon_smile.gif' alt=':)' class='wp-smiley' /> </p>
<h2>PAPR for random BPSK and QPSK</h2>
<p>Armed with the above result, I tried to simulate the PAPR for with random BPSK (and QPSK) modulation on a 128pt FFT with and without rotating the upper 20MHz subcarriers by j.</p>
<p>Click here to download the <a href="http://www.dsplog.com/db-install/wp-content/uploads/2008/07/script_papr_ofdm_tgn_j_rotation.m">Matlab/Octave script for simulating PAPR for BPSK/QPSK modulation OFDM with j rotation</a></p>
<p>The results from the simulations is shown below.</p>
<p><a href="http://www.dsplog.com/db-install/wp-content/uploads/2008/07/papr_ofdm_tgn_j_rotation_bpsk_qpsk.png"><img class="alignnone size-full wp-image-192" title="OFDM PAPR for BPSK/QPSK with j rotation" src="http://www.dsplog.com/db-install/wp-content/uploads/2008/07/papr_ofdm_tgn_j_rotation_bpsk_qpsk.png" alt="OFDM PAPR for BPSK/QPSK with j rotation" width="448" height="336" /></a></p>
<p><strong>Figure: OFDM PAPR for BPSK/QPSK with j rotation</strong></p>
<p><strong>Observations</strong></p>
<p>1. For random BPSK sequence, the multiplication by j resulted in increase of PAPR by around 0.5dB.</p>
<p>2. For random QPSK sequence, the PAPR with and without multiplication by j is almost the same.</p>
<p>Based on the above simulation results, may I conclude that there is <strong>no noticable reduction in PAPR by multiplying upper 20MHz subcarriers by j</strong>. There might be some special cases (like HT-LTF sequence), where the multiplication by j reduces PAPR. However for <strong>random BPSK/QPSK sequence</strong>, there is <strong>no improvement</strong>. <img src='http://www.dsplog.com/db-install/wp-includes/images/smilies/icon_sad.gif' alt=':(' class='wp-smiley' /></p>

<p><a href="http://feeds.feedburner.com/~a/dsplogdotcom?a=31AMYf"><img src="http://feeds.feedburner.com/~a/dsplogdotcom?i=31AMYf" border="0"></img></a></p><div class="feedflare">
<a href="http://feeds.feedburner.com/~f/dsplogdotcom?a=A9Q9cJ"><img src="http://feeds.feedburner.com/~f/dsplogdotcom?i=A9Q9cJ" border="0"></img></a> <a href="http://feeds.feedburner.com/~f/dsplogdotcom?a=92VRFJ"><img src="http://feeds.feedburner.com/~f/dsplogdotcom?i=92VRFJ" border="0"></img></a> <a href="http://feeds.feedburner.com/~f/dsplogdotcom?a=XCc30j"><img src="http://feeds.feedburner.com/~f/dsplogdotcom?i=XCc30j" border="0"></img></a> <a href="http://feeds.feedburner.com/~f/dsplogdotcom?a=04Pc9j"><img src="http://feeds.feedburner.com/~f/dsplogdotcom?i=04Pc9j" border="0"></img></a> <a href="http://feeds.feedburner.com/~f/dsplogdotcom?a=zRlwhj"><img src="http://feeds.feedburner.com/~f/dsplogdotcom?i=zRlwhj" border="0"></img></a>
</div><img src="http://feeds.feedburner.com/~r/dsplogdotcom/~4/324480246" height="1" width="1"/>]]></content:encoded>
			<wfw:commentRss>http://www.dsplog.com/2008/07/02/ofdm-papr-reduction-multiplication-by-j/feed/</wfw:commentRss>
		<feedburner:origLink>http://www.dsplog.com/2008/07/02/ofdm-papr-reduction-multiplication-by-j/</feedburner:origLink></item>
		<item>
		<title>Bounds on Communication based on Shannon’s capacity</title>
		<link>http://feeds.feedburner.com/~r/dsplogdotcom/~3/314274312/</link>
		<comments>http://www.dsplog.com/2008/06/18/bounds-on-communication-shannon-capacity/#comments</comments>
		<pubDate>Wed, 18 Jun 2008 02:45:00 +0000</pubDate>
		<dc:creator>Krishna Pillai</dc:creator>
		
		<category><![CDATA[Capacity]]></category>

		<category><![CDATA[AWGN]]></category>

		<guid isPermaLink="false">http://www.dsplog.com/?p=171</guid>
		<description>This is the second post in the series aimed at developing a better understanding of Shannon&amp;#8217;s capacity equation. In this post let us discuss the bounds on communication given the signal power and bandwidth constraint. Further, the following writeup is based on Section 12.6 from Fundamentals of Communication Systems by John G. Proakis, Masoud Salehi
In [...]</description>
			<content:encoded><![CDATA[<p>This is the second post in the series aimed at developing a better understanding of <strong>Shannon&#8217;s capacity equation.</strong> In this post let us discuss the <strong>bounds on communication</strong> given the <strong>signal power</strong> and <strong>bandwidth</strong> constraint. Further, the following writeup is based on Section 12.6 from <a href="http://www.amazon.com/gp/redirect.html?ie=UTF8&amp;location=http%3A%2F%2Fwww.amazon.com%2FFundamentals-Communication-Systems-John-Proakis%2Fdp%2F013147135X&amp;tag=dl04-20&amp;linkCode=ur2&amp;camp=1789&amp;creative=9325">Fundamentals of Communication Systems by John G. Proakis, Masoud Salehi</a><img style="border:none !important; margin:0px !important;" src="http://www.assoc-amazon.com/e/ir?t=dl04-20&amp;l=ur2&amp;o=1" border="0" alt="" width="1" height="1" /></p>
<p><span id="more-171"></span>In the first post in this series, we have discussed <a title="Shannon's capacity equation in AWGN with an average transmit power constraint" href="&lt;img src=" target=" mce_src=">Shannon&#8217;s equation for <strong>capacity of band limited</strong> <strong>additive white Gaussian noise</strong> channel with an <strong>average transmit power</strong> constraint</a>. The capacity is,</p>
<p><img src="http://www.dsplog.com/cgi-bin/mimetex.cgi?\Huge\begin{eqnarray}C&amp;=&amp;B\log_2\left(1+\frac{P_s}{N_oB}\right)\end{eqnarray}" border="0" alt="" align="absmiddle" /> bits/second</p>
<p>where</p>
<p><img src="http://www.dsplog.com/cgi-bin/mimetex.cgi?C" border="0" alt="" align="absmiddle" /> is the capacity in bits per second, <img src="http://www.dsplog.com/cgi-bin/mimetex.cgi?B" border="0" alt="" align="absmiddle" /> is the bandwidth in Hertz, <img src="http://www.dsplog.com/cgi-bin/mimetex.cgi?P_s" border="0" alt="" align="absmiddle" /> is the signal power and <img src="http://www.dsplog.com/cgi-bin/mimetex.cgi?N_0" border="0" alt="" align="absmiddle" />is the noise spectral density.</p>
<h2>Capacity with increasing signal power</h2>
<p>Increasing the signal power will mean that we can split the signal level into more number of levels even while ensuring low probability of error. Hence increasing signal power will lead to more capacity. However, as the increase in capacity is a logarithmic function of power, the returns are diminishing.</p>
<p><code><br />
Matlab/Octave script for plotting capacity vs power<br />
B=1;<br />
N0=1;<br />
P= [0:10^4];<br />
C = B.*log2(1+P./(N0*B));<br />
plot(P,C); xlabel(&#8217;power, P&#8217;); ylabel(&#8217;bandwidth,B&#8217;); ylabel(&#8217;capacity, C bit/sec&#8217;); title(&#8217;Capacity vs Power&#8217;)</code></p>
<p><img class="alignnone size-full wp-image-172" title="Capacity vs power (from Shannon\'s equation)" src="http://www.dsplog.com/db-install/wp-content/uploads/2008/06/capacity_vs_power.png" alt="Capacity vs power (from Shannon\'s equation)" width="448" height="336" /></p>
<p><strong>Figure: Capacity vs Power, keeping Noise and Bandwidth to unity</strong></p>
<p>Can observe that increase in capacity is diminishing as we keep increase the value of power.</p>
<h2>Capacity with increasing bandwidth</h2>
<p>The second variable to play with is the bandwidth. Increasing the bandwidth has two effects:</p>
<p>1. More bandwidth means we can have more transmissions per second, hence higher the capacity.</p>
<p>2. However, more bandwidth also means that there is more noise power at the receiver.</p>
<p>The latter reduces the performance.</p>
<p>Let us try to evaluate the capacity equation when bandwidth <img src="http://www.dsplog.com/cgi-bin/mimetex.cgi?B" border="0" alt="" align="absmiddle" /> tends to infinity i.e<br />
<img src="http://www.dsplog.com/cgi-bin/mimetex.cgi?\begin{eqnarray}C&amp;=\lim_{B \rightarrow \infty}&amp;B\log_2\left(1+\frac{P_s}{N_oB}\right)\end{eqnarray}" border="0" alt="" align="absmiddle" />.</p>
<p>From the <a title="Wikipedia entry on Taylor series" href="http://en.wikipedia.org/wiki/Taylor_series#Calculation_of_Taylor_series" target="_self">Taylor series</a> expansion, we know that</p>
<p><img src="http://www.dsplog.com/cgi-bin/mimetex.cgi?\log_e(1+x)=x-\frac{x^2}{2}+\frac{x^3}{3}+\ldots" border="0" alt="" align="absmiddle" />.</p>
<p>Applying this to the above equation,</p>
<p><img src="http://www.dsplog.com/cgi-bin/mimetex.cgi?\begin{eqnarray}C&amp;=&amp;\frac{1}{\log_e2}\lim_{B \rightarrow \infty}&amp;B\left[\frac{P_s}{N_0B}-\frac{1}{2}({\frac{P_s}{N_0B})^2}+\frac{1}{3}({\frac{P_s}{N_0B})^3+\ldots}\right]\\&amp;=&amp;\frac{1}{log_e2}\frac{P_s}{N_0}\end{eqnarray}" border="0" alt="" align="absmiddle" />.</p>
<p>This means that increasing bandwidth alone will not lead to increase of the capacity.<br />
<code><br />
Matlab/Octave script for plotting capacity vs bandwidth<br />
P = 1;<br />
N0 = 1;<br />
B = [1:10^3];<br />
C = B.*log2(1+P./(N0*B));<br />
plot(B,C)<br />
xlabel(&#8217;bandwidth, B Hz&#8217;); ylabel(&#8217;capacity, C bit/sec&#8217;); title(&#8217;Capacity vs Bandwidth&#8217;)</code></p>
<p><img class="alignnone size-full wp-image-173" title="Capcity vs Bandwidth (Based on Shannon\'s capacity equation)" src="http://www.dsplog.com/db-install/wp-content/uploads/2008/06/capacity_vs_bandwidth.png" alt="" width="448" height="336" /></p>
<p><strong>Figure: Capacity vs Bandwidth, keeping signal power and noise power to unity</strong></p>
<p>Can observe that the maximum achievable capacity by increasing bandwidth is 1.44 times the <img src="http://www.dsplog.com/cgi-bin/mimetex.cgi?\frac{P_s}{N_0}" border="0" alt="" align="absmiddle" /> value.<br />
<a name="Shannon Capacity Bound"></a></p>
<h2>Capacity (in bit/sec/Hz) vs Bit to noise ratio (Eb/No)</h2>
<p>From our discussion till now, we have understood that a practical communication should have a rate <img src="http://www.dsplog.com/cgi-bin/mimetex.cgi?R" border="0" alt="" align="absmiddle" /> which is lower than capacity <img src="http://www.dsplog.com/cgi-bin/mimetex.cgi?C" border="0" alt="" align="absmiddle" />, i.e.</p>
<p><img src="http://www.dsplog.com/cgi-bin/mimetex.cgi?\begin{eqnarray}R&amp;&lt;&amp;B\log_2\left(1+\frac{P_s}{N_oB}\right)\end{eqnarray}" border="1" alt="" align="absmiddle" /> bits/second.</p>
<p>Dividing both sides of the equation by bandwidth <img src="http://www.dsplog.com/cgi-bin/mimetex.cgi?B" border="0" alt="" align="absmiddle" />,</p>
<p><img src="http://www.dsplog.com/cgi-bin/mimetex.cgi?\begin{eqnarray}\frac{R}{B}&amp;&lt;&amp;\log_2\left(1+\frac{P_s}{N_oB}\right)\end{eqnarray}" border="0" alt="" align="absmiddle" /> bits/second/Hz.</p>
<p>Further, from our discussion on <a title="Bit error rate for 16PSK modulation using Gray mapping" href="http://www.dsplog.com/2008/05/18/bit-error-rate-for-16psk-modulation-using-gray-mapping/">Bit error rate for 16PSK modulation using Gray mapping</a>, we know that symbol to noise ratio is <img src="http://www.dsplog.com/cgi-bin/mimetex.cgi?R" border="0" alt="" align="absmiddle" /> times the bit to noise ratio, i.e.<br />
<img src="http://www.dsplog.com/cgi-bin/mimetex.cgi?\frac{P_s}{N_0}=R\frac{E_b}{N_0}" border="0" alt="" align="absmiddle" />.</p>
<p>Substituting this into the capacity equation,<br />
<img src="http://www.dsplog.com/cgi-bin/mimetex.cgi?\begin{eqnarray}\frac{R}{B}&amp;&lt;&amp;\log_2\left(1+\frac{R}{B}\frac{E_b}{N_o}\right)\end{eqnarray}" border="0" alt="" align="absmiddle" /> bits/second/Hz.</p>
<p>For notational convenience, let us define <img src="http://www.dsplog.com/cgi-bin/mimetex.cgi?r" border="0" alt="" align="absmiddle" /> as the spectral efficiency in bits/second/Hertz.</p>
<p>The above equation can be equivalently represented as,</p>
<p><img src="http://www.dsplog.com/cgi-bin/mimetex.cgi?\begin{eqnarray}\frac{E_b}{N_0}\ &gt;\ \frac{2^{r}-1}{r}\end{eqnarray}" border="0" alt="" align="absmiddle" />.</p>
<p>In the above equation, when <img src="http://www.dsplog.com/cgi-bin/mimetex.cgi?r" border="0" alt="" align="absmiddle" /> tends to zero, the bit to noise ratio should be,</p>
<p><img src="http://www.dsplog.com/cgi-bin/mimetex.cgi?\begin{eqnarray}\frac{E_b}{N_0}&amp;\ &gt;&amp;\lim_{r\rightarrow 0}\frac{2^{r}-1}{r}\\&amp;&gt;&amp;\log_e2\end{eqnarray}" border="0" alt="" align="absmiddle" />.</p>
<p>(Thanks to <a title="L'Hopital's rule from Wikipedia" href="http://en.wikipedia.org/wiki/L'H%C3%B4pital's_rule">L&#8217;Hospital&#8217;s rule</a>).</p>
<p>This means that for reliable communication, we need to have <img src="http://www.dsplog.com/cgi-bin/mimetex.cgi?\frac{E_b}{N_0}&gt;0.693" border="0" alt="" align="absmiddle" /> or equivalently expressing in decibels, <img src="http://www.dsplog.com/cgi-bin/mimetex.cgi?\frac{E_b}{N_0}&gt;-1.59dB" border="0" alt="" align="absmiddle" />.</p>
<p><code><br />
Matlab/Octave script for plotting the capacity in Bits/sec/Hz vs Bit to noise ratio<br />
r = [0:.001:10];<br />
Eb_No_lin = (2.^r -1)./r;<br />
Eb_No_dB = 10*log10(Eb_No_lin);<br />
semilogy(Eb_No_dB,r)<br />
axis([-2 20 0.1 10]); grid on<br />
xlabel(&#8217;Bit to noise ratio, Eb/No dB&#8217;); ylabel(&#8217;Spectral efficiency, R/W bit/sec/Hz&#8217;)<br />
title(&#8217;Spectral efficiency vs Bit to Noise ratio&#8217;)<br />
</code><br />
<img class="alignnone size-full wp-image-174" title="Spectral efficiency vs Bit to noise ratio" src="http://www.dsplog.com/db-install/wp-content/uploads/2008/06/spectral_efficiency_vs_bit_to_noise_ratio.png" alt="" width="448" height="336" /></p>
<p><strong>Figure: Spectral efficiency vs bit to noise ratio</strong></p>
<p>The above plot captures the equation,</p>
<p><img src="http://www.dsplog.com/cgi-bin/mimetex.cgi?\begin{eqnarray}r&amp;=&amp;\log_2\left(1+r\frac{E_b}{N_o}\right)\end{eqnarray}" border="0" alt="" align="absmiddle" />.</p>
<p>It divides the area into two regions:</p>
<p>(a) In the region below the curve, reliable communication is possible and</p>
<p>(b) in the region above the curve, reliable communication is not possible.</p>
<p><strong>Closer the performance of a communication system is to the curve, more optimal is the system</strong>.</p>
<p>In the next post in this series, we will discuss the performance of various modulation schemes like BPSK, QPSK, QAM etc by mapping them into various points in the above plot.</p>
<h2>Reference</h2>
<p><a href="http://www.amazon.com/gp/redirect.html?ie=UTF8&amp;location=http%3A%2F%2Fwww.amazon.com%2FFundamentals-Communication-Systems-John-Proakis%2Fdp%2F013147135X&amp;tag=dl04-20&amp;linkCode=ur2&amp;camp=1789&amp;creative=9325">[COMM-SYS-PROAKIS-SALEHI] </a><a href="http://www.amazon.com/gp/redirect.html?ie=UTF8&amp;location=http%3A%2F%2Fwww.amazon.com%2FFundamentals-Communication-Systems-John-Proakis%2Fdp%2F013147135X&amp;tag=dl04-20&amp;linkCode=ur2&amp;camp=1789&amp;creative=9325">Fundamentals of Communication Systems by John G. Proakis, Masoud Salehi</a><img style="border:none !important; margin:0px !important;" src="http://www.assoc-amazon.com/e/ir?t=dl04-20&amp;l=ur2&amp;o=1" border="0" alt="" width="1" height="1" /></p>

<p><a href="http://feeds.feedburner.com/~a/dsplogdotcom?a=qOMH47"><img src="http://feeds.feedburner.com/~a/dsplogdotcom?i=qOMH47" border="0"></img></a></p><div class="feedflare">
<a href="http://feeds.feedburner.com/~f/dsplogdotcom?a=EclQ0I"><img src="http://feeds.feedburner.com/~f/dsplogdotcom?i=EclQ0I" border="0"></img></a> <a href="http://feeds.feedburner.com/~f/dsplogdotcom?a=HotoBI"><img src="http://feeds.feedburner.com/~f/dsplogdotcom?i=HotoBI" border="0"></img></a> <a href="http://feeds.feedburner.com/~f/dsplogdotcom?a=ahx39i"><img src="http://feeds.feedburner.com/~f/dsplogdotcom?i=ahx39i" border="0"></img></a> <a href="http://feeds.feedburner.com/~f/dsplogdotcom?a=99uv9i"><img src="http://feeds.feedburner.com/~f/dsplogdotcom?i=99uv9i" border="0"></img></a> <a href="http://feeds.feedburner.com/~f/dsplogdotcom?a=EK0zci"><img src="http://feeds.feedburner.com/~f/dsplogdotcom?i=EK0zci" border="0"></img></a>
</div><img src="http://feeds.feedburner.com/~r/dsplogdotcom/~4/314274312" height="1" width="1"/>]]></content:encoded>
			<wfw:commentRss>http://www.dsplog.com/2008/06/18/bounds-on-communication-shannon-capacity/feed/</wfw:commentRss>
		<feedburner:origLink>http://www.dsplog.com/2008/06/18/bounds-on-communication-shannon-capacity/</feedburner:origLink></item>
		<item>
		<title>Understanding Shannon’s capacity equation</title>
		<link>http://feeds.feedburner.com/~r/dsplogdotcom/~3/312416039/</link>
		<comments>http://www.dsplog.com/2008/06/15/shannon-gaussian-channel-capacity-equation/#comments</comments>
		<pubDate>Sun, 15 Jun 2008 14:25:20 +0000</pubDate>
		<dc:creator>Krishna Pillai</dc:creator>
		
		<category><![CDATA[Capacity]]></category>

		<category><![CDATA[AWGN]]></category>

		<guid isPermaLink="false">http://www.dsplog.com/?p=169</guid>
		<description>Let us try to understand the formula for Channel Capacity with an Average Power Limitation, described in Section 25 of the landmark paper A Mathematical Theory for Communication, by Mr. Claude Shannon.
Further, the following writeup is based on Section 12.5.1 from Fundamentals of Communication Systems by John G. Proakis, Masoud Salehi

Simple example with voltage levels
Let [...]</description>
			<content:encoded><![CDATA[<p>Let us try to understand the formula for <strong>Channel Capacity with an Average Power Limitation</strong>, described in Section 25 of the landmark paper <a title="Shannon's 1948 paper on A Mathematical Theory for Communication" href="http://plan9.bell-labs.com/cm/ms/what/shannonday/shannon1948.pdf"><strong>A Mathematical Theory for Communication</strong></a>, by <a title="Wikipedia entry on Mr. Claude Shannon" href="http://en.wikipedia.org/wiki/Claude_Shannon" target="_self">Mr. Claude Shannon</a>.</p>
<p>Further, the following writeup is based on Section 12.5.1 from <a href="http://www.amazon.com/gp/redirect.html?ie=UTF8&amp;location=http%3A%2F%2Fwww.amazon.com%2FFundamentals-Communication-Systems-John-Proakis%2Fdp%2F013147135X&amp;tag=dl04-20&amp;linkCode=ur2&amp;camp=1789&amp;creative=9325">Fundamentals of Communication Systems by John G. Proakis, Masoud Salehi</a><img style="border:none !important; margin:0px !important;" src="http://www.assoc-amazon.com/e/ir?t=dl04-20&amp;l=ur2&amp;o=1" border="0" alt="" width="1" height="1" /></p>
<p><span id="more-169"></span></p>
<h2>Simple example with voltage levels</h2>
<p>Let us consider that we have two voltage sources:<br />
(a) Signal source which can generate voltages in the range  <img src="http://www.dsplog.com/cgi-bin/mimetex.cgi?0" border="0" alt="" align="absmiddle" /> to <img src="http://www.dsplog.com/cgi-bin/mimetex.cgi?V" border="0" alt="" align="absmiddle" /> volts<br />
(b) Noise source which can generate voltage levels <img src="http://www.dsplog.com/cgi-bin/mimetex.cgi?-\frac{V_n}{2}" border="0" alt="" align="absmiddle" /> to <img src="http://www.dsplog.com/cgi-bin/mimetex.cgi?\frac{V_n}{2}" border="0" alt="" align="absmiddle" /> volts.</p>
<p><img class="alignnone size-full wp-image-170" title="Voltage levels with noise" src="http://www.dsplog.com/db-install/wp-content/uploads/2008/06/voltage_levels_with_noise.png" alt="Voltage levels with noise" width="300" height="72" /></p>
<p><strong>Figure: Discrete voltage levels with noise<br />
</strong></p>
<p>Let us now try to send <strong>information at discrete voltage levels </strong><img src="http://www.dsplog.com/cgi-bin/mimetex.cgi?V_m" border="0" alt="" align="absmiddle" /> from the source (thick black lines as shown in the above figure). It is intuitive to guess that the receiver will be able to decode the <strong>received symbol correctly</strong> if the received signal lies within <img src="http://www.dsplog.com/cgi-bin/mimetex.cgi?V_m \pm \frac{V_n}{2}" border="0" alt="" align="absmiddle" />.</p>
<p>So, the <strong>number of different discrete voltages levels (information)</strong> which can be sent, while ensuring <strong>error free</strong> communication is the total voltage level divided by the noise voltage level i.e.<br />
<img src="http://www.dsplog.com/cgi-bin/mimetex.cgi?M=\frac{V+V_n}{V_n}" border="0" alt="" align="absmiddle" />.</p>
<h2><strong>Extending to Gaussian channel </strong></h2>
<p>Let us transmit <img src="http://www.dsplog.com/cgi-bin/mimetex.cgi?k" border="0" alt="" align="absmiddle" /> randomly chosen discrete voltage levels <img src="http://www.dsplog.com/cgi-bin/mimetex.cgi?V_m" border="0" alt="" align="absmiddle" /> meeting the average power constraint,</p>
<p><img src="http://www.dsplog.com/cgi-bin/mimetex.cgi?\frac{1}{k}\sum_{i=1}^{k}V_{m,i}^2 \le Ps" border="0" alt="" align="absmiddle" />, where <img src="http://www.dsplog.com/cgi-bin/mimetex.cgi?P_s" border="0" alt="" align="absmiddle" /> is the signal power.</p>
<p>The noise signal <img src="http://www.dsplog.com/cgi-bin/mimetex.cgi?V_n" border="0" alt="" align="absmiddle" /> follows the Gaussian probability distribution function</p>
<p><img src="http://www.dsplog.com/cgi-bin/mimetex.cgi?p%28x%29%20=%20%5Cfrac%7B1%7D%7B%5Csqrt%7B2%5Cpi%5Csigma%5E2%7D%7De%5E%7B%5Cfrac%7B-%28x-%5Cmu%29%5E2%7D%7B2%5Csigma%5E2%7D" border="0" alt="" align="absmiddle" /> with mean <img src="http://www.dsplog.com/cgi-bin/mimetex.cgi?\mu=0" border="0" alt="" align="absmiddle" /> and variance <img src="http://www.dsplog.com/cgi-bin/mimetex.cgi?%5Csigma%5E2%20=%20%5Cfrac%7BN_0%7D%7B2%7D" border="0" alt="" align="absmiddle" />.</p>
<p>The noise power <img src="http://www.dsplog.com/cgi-bin/mimetex.cgi?P_n" border="0" alt="" align="absmiddle" /> is,</p>
<p><img src="http://www.dsplog.com/cgi-bin/mimetex.cgi?\frac{1}{k}\sum_{i=1}^{k}V_{n,i}^2 = Pn" border="0" alt="" align="absmiddle" />.</p>
<p>The average total (signal plus noise) voltage over <img src="http://www.dsplog.com/cgi-bin/mimetex.cgi?k" border="0" alt="" align="absmiddle" />symbols is <img src="http://www.dsplog.com/cgi-bin/mimetex.cgi?\fs1 \sqrt{\sum_{i=1}^k(V_{m,i}+V_{n,i})^2}" border="0" alt="" align="absmiddle" />.</p>
<p>Similiarly, the average noise voltage over <img src="http://www.dsplog.com/cgi-bin/mimetex.cgi?k" border="0" alt="" align="absmiddle" />symbols is <img src="http://www.dsplog.com/cgi-bin/mimetex.cgi?\fs1 \sqrt{\sum_{i=1}^kV_{n,i}^2}" border="0" alt="" align="absmiddle" />.</p>
<p>Combining the above two equations, the number of different messages <img src="http://www.dsplog.com/cgi-bin/mimetex.cgi?M" border="0" alt="" align="absmiddle" /> which can be &#8216;<em><strong>reliably transmitted</strong></em>&#8216; is,</p>
<p><img src="http://www.dsplog.com/cgi-bin/mimetex.cgi? \begin{eqnarray}M&amp;=&amp;\sqrt{\frac{\sum_i(V_{m,i}+V_{n,i})^2}{\sum_iV_{n,i}^2}}\\&amp;=&amp;\sqrt{\frac{\sum_iV_{m,i}^2+\sum_iV_{n,i}^2+2\sum_iV_{m,i}V_{n,i}}{\sum_iV_{n,i}^2}}\\&amp;=&amp;\sqrt{\frac{\sum_iV_{m,i}^2+\sum_iV_{n,i}^2}{\sum_iV_{n,i}^2}}\\&amp;=&amp;\sqrt{\frac{Ps+P_n}{P_n}}\end{eqnarray}" border="0" alt="" align="absmiddle" />.</p>
<p><strong>Note:</strong></p>
<p>1. The product of the signal and noise accumulated over many symbols average to zero, i.e</p>
<p><img src="http://www.dsplog.com/cgi-bin/mimetex.cgi?\sum_iV_{m,i}V_{n,i}=0" border="0" alt="" align="absmiddle" />.</p>
<p>2. Since the noise is Gaussian distributed, the noise can theoretically go from <img src="http://www.dsplog.com/cgi-bin/mimetex.cgi?-\infty" border="0" alt="" align="absmiddle" /> to <img src="http://www.dsplog.com/cgi-bin/mimetex.cgi?+\infty" border="0" alt="" align="absmiddle" />. So the above result cannot ensure zero probability of error in receiver, but only arbitrarily small probability of error.</p>
<h2>Converting to bits per transmission</h2>
<p>With <img src="http://www.dsplog.com/cgi-bin/mimetex.cgi?M" border="0" alt="" align="absmiddle" /> different messages, the number of bits which can be transmitted per transmission is,</p>
<p><img src="http://www.dsplog.com/cgi-bin/mimetex.cgi?\begin{eqnarray}C&amp;=&amp;\log_2(M)\\&amp;=&amp;\frac{1}{2}\log_2\left(1+\frac{P_s}{P_n}\right)\end{eqnarray}" border="0" alt="" align="absmiddle" /> bits/transmission.</p>
<h2>Bringing bandwidth into the equation</h2>
<p>Let us assume that the available bandwidth is <img src="http://www.dsplog.com/cgi-bin/mimetex.cgi?B" border="0" alt="" align="absmiddle" />.</p>
<p>Noise is of power spectral density  <img src="http://www.dsplog.com/cgi-bin/mimetex.cgi?\frac{N_0}{2}" border="0" alt="" align="absmiddle" /> spread over the bandwidth <img src="http://www.dsplog.com/cgi-bin/mimetex.cgi?B" border="0" alt="" align="absmiddle" />. So the noise power in terms of power spectral density and bandwidth is,</p>
<p><img src="http://www.dsplog.com/cgi-bin/mimetex.cgi?P_n = \int_{-B}^{+B}\frac{N_0}{2}df=N_0B" border="0" alt="" align="absmiddle" />.</p>
<p>From our previous post on <a title="Transmit pulse shaping using sinc filter" href="http://www.dsplog.com/2008/04/14/transmit-pulse-shape-nyquist-sinc-rectangular/" target="_self">transmit pulse shaping filter</a> that minimum required bandwidth for transmitting symbols with symbol period <img src="http://www.dsplog.com/cgi-bin/mimetex.cgi?T" border="0" alt="" align="absmiddle" /> is<img src="http://www.dsplog.com/cgi-bin/mimetex.cgi?+\frac{1}{2T}" border="0" alt="" align="absmiddle" />Hz. Conversely, if the available bandwidth is <img src="http://www.dsplog.com/cgi-bin/mimetex.cgi?B" border="0" alt="" align="absmiddle" />, the maximum symbol rate (transmissions per second) is <img src="http://www.dsplog.com/cgi-bin/mimetex.cgi?2B" border="0" alt="" align="absmiddle" />.</p>
<p>Multiplying the equation for bits per transmission with transmission per second of <img src="http://www.dsplog.com/cgi-bin/mimetex.cgi?2B" border="0" alt="" align="absmiddle" /> and replacing the noise term <img src="http://www.dsplog.com/cgi-bin/mimetex.cgi?P_n" border="0" alt="" align="absmiddle" />, the capacity is</p>
<p><img src="http://www.dsplog.com/cgi-bin/mimetex.cgi?\Huge\begin{eqnarray}C&amp;=&amp;B\log_2\left(1+\frac{P_s}{N_oB}\right)\end{eqnarray}" border="0" alt="" align="absmiddle" /> bits/second.</p>
<p>Voila! This is <strong>Shannon&#8217;s equation</strong> for <strong>capacity of band limited</strong> <strong>additive white Gaussian noise</strong> channel with an <strong>average transmit power</strong> constraint. <img src='http://www.dsplog.com/db-install/wp-includes/images/smilies/icon_smile.gif' alt=':)' class='wp-smiley' /> </p>
<h2>References</h2>
<p><a title="Shannon's 1948 paper on A Mathematical Theory for Communication" href="http://plan9.bell-labs.com/cm/ms/what/shannonday/shannon1948.pdf">A Mathematical Theory for Communication</a>, by <a title="Wikipedia entry on Mr. Claude Shannon" href="http://en.wikipedia.org/wiki/Claude_Shannon" target="_self">Mr. Claude Shannon</a></p>
<p><a href="http://www.amazon.com/gp/redirect.html?ie=UTF8&amp;location=http%3A%2F%2Fwww.amazon.com%2FFundamentals-Communication-Systems-John-Proakis%2Fdp%2F013147135X&amp;tag=dl04-20&amp;linkCode=ur2&amp;camp=1789&amp;creative=9325">[COMM-SYS-PROAKIS-SALEHI] </a><a href="http://www.amazon.com/gp/redirect.html?ie=UTF8&amp;location=http%3A%2F%2Fwww.amazon.com%2FFundamentals-Communication-Systems-John-Proakis%2Fdp%2F013147135X&amp;tag=dl04-20&amp;linkCode=ur2&amp;camp=1789&amp;creative=9325">Fundamentals of Communication Systems by John G. Proakis, Masoud Salehi</a><img style="border:none !important; margin:0px !important;" src="http://www.assoc-amazon.com/e/ir?t=dl04-20&amp;l=ur2&amp;o=1" border="0" alt="" width="1" height="1" /></p>
<p><a title="Shannon's 1948 paper on A Mathematical Theory for Communication" href="http://plan9.bell-labs.com/cm/ms/what/shannonday/shannon1948.pdf"><br />
</a></p>

<p><a href="http://feeds.feedburner.com/~a/dsplogdotcom?a=a4HuVh"><img src="http://feeds.feedburner.com/~a/dsplogdotcom?i=a4HuVh" border="0"></img></a></p><div class="feedflare">
<a href="http://feeds.feedburner.com/~f/dsplogdotcom?a=DcocuI"><img src="http://feeds.feedburner.com/~f/dsplogdotcom?i=DcocuI" border="0"></img></a> <a href="http://feeds.feedburner.com/~f/dsplogdotcom?a=XktEBI"><img src="http://feeds.feedburner.com/~f/dsplogdotcom?i=XktEBI" border="0"></img></a> <a href="http://feeds.feedburner.com/~f/dsplogdotcom?a=75iURi"><img src="http://feeds.feedburner.com/~f/dsplogdotcom?i=75iURi" border="0"></img></a> <a href="http://feeds.feedburner.com/~f/dsplogdotcom?a=037Ogi"><img src="http://feeds.feedburner.com/~f/dsplogdotcom?i=037Ogi" border="0"></img></a> <a href="http://feeds.feedburner.com/~f/dsplogdotcom?a=w4deLi"><img src="http://feeds.feedburner.com/~f/dsplogdotcom?i=w4deLi" border="0"></img></a>
</div><img src="http://feeds.feedburner.com/~r/dsplogdotcom/~4/312416039" height="1" width="1"/>]]></content:encoded>
			<wfw:commentRss>http://www.dsplog.com/2008/06/15/shannon-gaussian-channel-capacity-equation/feed/</wfw:commentRss>
		<feedburner:origLink>http://www.dsplog.com/2008/06/15/shannon-gaussian-channel-capacity-equation/</feedburner:origLink></item>
	</channel>
</rss>
