<?xml version='1.0' encoding='UTF-8'?><?xml-stylesheet href="http://www.blogger.com/styles/atom.css" type="text/css"?><feed xmlns='http://www.w3.org/2005/Atom' xmlns:openSearch='http://a9.com/-/spec/opensearchrss/1.0/' xmlns:blogger='http://schemas.google.com/blogger/2008' xmlns:georss='http://www.georss.org/georss' xmlns:gd="http://schemas.google.com/g/2005" xmlns:thr='http://purl.org/syndication/thread/1.0'><id>tag:blogger.com,1999:blog-8078258480436189776</id><updated>2024-10-04T21:12:11.248-07:00</updated><category term="quibids"/><category term="statistics"/><category term="strategy"/><category term="auction"/><category term="penny auction"/><category term="python"/><category term="chart"/><category term="chart of the day"/><category term="data"/><category term="scraping"/><category term="tips"/><category term="gift card"/><category term="scrape"/><category term="script"/><category term="excel"/><category term="ajax"/><category term="bidding behavior"/><category term="output"/><category term="hazard"/><category term="predictive modelling"/><category term="scraper"/><category term="selenium"/><category term="survival analysis"/><category term="beezid"/><category term="behavior"/><category term="beta"/><category term="business proposal"/><category term="crawl"/><category term="garch"/><category term="hazard function"/><category term="hazard rate"/><category term="help"/><category term="hosting"/><category term="non proportional model"/><category term="patterns"/><category term="proportional model"/><category term="quibidsinsider"/><category term="risk"/><category term="selenium rc"/><category term="server"/><category term="strike price"/><category term="testing"/><category term="time series"/><category term="variance"/><category term="volatility"/><category term="xlhost"/><title type='text'>Penny Auctions and Applied Statistics</title><subtitle type='html'>Applying statistics to Quibids auctions</subtitle><link rel='http://schemas.google.com/g/2005#feed' type='application/atom+xml' href='http://pennystats.blogspot.com/feeds/posts/default'/><link rel='self' type='application/atom+xml' href='http://www.blogger.com/feeds/8078258480436189776/posts/default?redirect=false'/><link rel='alternate' type='text/html' href='http://pennystats.blogspot.com/'/><link rel='hub' href='http://pubsubhubbub.appspot.com/'/><link rel='next' type='application/atom+xml' href='http://www.blogger.com/feeds/8078258480436189776/posts/default?start-index=26&amp;max-results=25&amp;redirect=false'/><author><name>Unknown</name><email>noreply@blogger.com</email><gd:image rel='http://schemas.google.com/g/2005#thumbnail' width='16' height='16' src='https://img1.blogblog.com/img/b16-rounded.gif'/></author><generator version='7.00' uri='http://www.blogger.com'>Blogger</generator><openSearch:totalResults>28</openSearch:totalResults><openSearch:startIndex>1</openSearch:startIndex><openSearch:itemsPerPage>25</openSearch:itemsPerPage><entry><id>tag:blogger.com,1999:blog-8078258480436189776.post-7151509429326817063</id><published>2013-01-31T15:23:00.000-08:00</published><updated>2013-01-31T15:23:51.585-08:00</updated><category scheme="http://www.blogger.com/atom/ns#" term="garch"/><category scheme="http://www.blogger.com/atom/ns#" term="quibids"/><category scheme="http://www.blogger.com/atom/ns#" term="strike price"/><category scheme="http://www.blogger.com/atom/ns#" term="time series"/><category scheme="http://www.blogger.com/atom/ns#" term="variance"/><category scheme="http://www.blogger.com/atom/ns#" term="volatility"/><title type='text'>Disproving the idea of a constant &quot;strike price&quot;</title><content type='html'>&lt;div dir=&quot;ltr&quot; style=&quot;text-align: left;&quot; trbidi=&quot;on&quot;&gt;
I had an interesting discussion today with one of my professors about volatility and how it fits into the penny auction world.&lt;br /&gt;
&lt;div&gt;
&lt;br /&gt;
&lt;div&gt;
The preface, his background is in Risk Analytics and econometrics. One of his main topics of discussion is around volatility in the stock market. Financial theory suggests that in stock prices, higher volatility is correlated with higher risk. Likewise, lower volatility is correlated with lower risk. &lt;b&gt;&lt;u&gt;This counters the idea that &quot;strike price&quot; is a fixed value for all possible auctions.&lt;/u&gt;&lt;/b&gt;&lt;br /&gt;
&lt;br /&gt;
At a macro level view, the auctions for gift cards appear to have varying levels of clustered volatility (The reference line in both charts is the mean):&lt;br /&gt;
&lt;br /&gt;
&lt;div class=&quot;separator&quot; style=&quot;clear: both; text-align: center;&quot;&gt;
&lt;a href=&quot;https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEhd1HVoxNFtxZUyu7gT03_qpDV4BbVmofkTUxrDgqIUGIgpXcy_Jo1WTgdqtN6sQ_Vn82ZZihe0TK336GKYWwZ2QzifVb9dPI8r7tcvu06SzVUfqMBcmliUBthjnxoj0spjP842ZUuAkZ_L/s1600/Valoatility_June34.png&quot; imageanchor=&quot;1&quot; style=&quot;margin-left: 1em; margin-right: 1em; text-align: center;&quot;&gt;&lt;img border=&quot;0&quot; src=&quot;https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEhd1HVoxNFtxZUyu7gT03_qpDV4BbVmofkTUxrDgqIUGIgpXcy_Jo1WTgdqtN6sQ_Vn82ZZihe0TK336GKYWwZ2QzifVb9dPI8r7tcvu06SzVUfqMBcmliUBthjnxoj0spjP842ZUuAkZ_L/s1600/Valoatility_June34.png&quot; /&gt;&lt;/a&gt;&lt;/div&gt;
&lt;/div&gt;
&lt;div&gt;
&lt;br /&gt;
&lt;br /&gt;&lt;/div&gt;
&lt;div&gt;
&lt;div class=&quot;separator&quot; style=&quot;clear: both; text-align: center;&quot;&gt;
&lt;a href=&quot;https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEhHAyLcV0NJg2sqFpNcXsRnZVLych1tew_KOcHkdC4LGT_ud7tYNx7aoE52YGo3FL9u2mr74PsMRSvJ6lwK_VqO3mf9CGRnvCpb6vXIKIk-7e7Oymb92vfP9eaW1KUylKzN0jLHNE-Qk6i_/s1600/Volatility_June45.png&quot; imageanchor=&quot;1&quot; style=&quot;margin-left: 1em; margin-right: 1em;&quot;&gt;&lt;img border=&quot;0&quot; src=&quot;https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEhHAyLcV0NJg2sqFpNcXsRnZVLych1tew_KOcHkdC4LGT_ud7tYNx7aoE52YGo3FL9u2mr74PsMRSvJ6lwK_VqO3mf9CGRnvCpb6vXIKIk-7e7Oymb92vfP9eaW1KUylKzN0jLHNE-Qk6i_/s1600/Volatility_June45.png&quot; /&gt;&lt;/a&gt;&lt;/div&gt;
&lt;br /&gt;
&lt;div class=&quot;separator&quot; style=&quot;clear: both; text-align: center;&quot;&gt;
&lt;br /&gt;&lt;/div&gt;
With clustered volatility, a GARCH model can be useful in predicting the expected variance, or volatility, around the mean. For users looking to &quot;strike a deal&quot;, bidding in one of the bands of low volatility would likely be a better use of their money, as the volatility and expected costs are lower. Using the entire data set from June 2-5, we can use an GARCH model (1,(1 15)) with an exponential distribution to see some of the change in expected volatility:&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;div&gt;
&lt;div align=&quot;center&quot;&gt;
&lt;table bordercolor=&quot;#c1c1c1&quot; cellpadding=&quot;5&quot; cellspacing=&quot;0&quot; class=&quot;table&quot; frame=&quot;box&quot; rules=&quot;all&quot; summary=&quot;Procedure Autoreg: Fit Summary&quot;&gt;
&lt;colgroup&gt;
&lt;col&gt;&lt;/col&gt;
&lt;col&gt;&lt;/col&gt;
&lt;col&gt;&lt;/col&gt;
&lt;col&gt;&lt;/col&gt;&lt;/colgroup&gt;
&lt;thead&gt;
&lt;tr&gt;
&lt;th class=&quot;c b header&quot; colspan=&quot;4&quot; scope=&quot;colgroup&quot;&gt;Exponential GARCH 
Estimates&lt;/th&gt;&lt;/tr&gt;
&lt;/thead&gt;
&lt;tbody&gt;
&lt;tr&gt;
&lt;th class=&quot;l rowheader&quot; scope=&quot;row&quot;&gt;SSE&lt;/th&gt;
&lt;td class=&quot;r data&quot;&gt;7535.92932&lt;/td&gt;
&lt;th class=&quot;l rowheader&quot; scope=&quot;row&quot;&gt;Observations&lt;/th&gt;
&lt;td class=&quot;r data&quot;&gt;671&lt;/td&gt;&lt;/tr&gt;
&lt;tr&gt;
&lt;th class=&quot;l rowheader&quot; scope=&quot;row&quot;&gt;MSE&lt;/th&gt;
&lt;td class=&quot;r data&quot;&gt;11.23089&lt;/td&gt;
&lt;th class=&quot;l rowheader&quot; scope=&quot;row&quot;&gt;Uncond Var&lt;/th&gt;
&lt;td class=&quot;r data&quot;&gt;.&lt;/td&gt;&lt;/tr&gt;
&lt;tr&gt;
&lt;th class=&quot;l rowheader&quot; scope=&quot;row&quot;&gt;Log Likelihood&lt;/th&gt;
&lt;td class=&quot;r data&quot; nowrap=&quot;&quot;&gt;-1743.004&lt;/td&gt;
&lt;th class=&quot;l rowheader&quot; scope=&quot;row&quot;&gt;Total R-Square&lt;/th&gt;
&lt;td class=&quot;r data&quot;&gt;0.0050&lt;/td&gt;&lt;/tr&gt;
&lt;tr&gt;
&lt;th class=&quot;l rowheader&quot; scope=&quot;row&quot;&gt;SBC&lt;/th&gt;
&lt;td class=&quot;r data&quot;&gt;3544.58696&lt;/td&gt;
&lt;th class=&quot;l rowheader&quot; scope=&quot;row&quot;&gt;AIC&lt;/th&gt;
&lt;td class=&quot;r data&quot;&gt;3504.00804&lt;/td&gt;&lt;/tr&gt;
&lt;tr&gt;
&lt;th class=&quot;l rowheader&quot; scope=&quot;row&quot;&gt;MAE&lt;/th&gt;
&lt;td class=&quot;r data&quot;&gt;2.62665134&lt;/td&gt;
&lt;th class=&quot;l rowheader&quot; scope=&quot;row&quot;&gt;AICC&lt;/th&gt;
&lt;td class=&quot;r data&quot;&gt;3504.28036&lt;/td&gt;&lt;/tr&gt;
&lt;tr&gt;
&lt;th class=&quot;l rowheader&quot; scope=&quot;row&quot;&gt;MAPE&lt;/th&gt;
&lt;td class=&quot;r data&quot;&gt;3234.0269&lt;/td&gt;
&lt;th class=&quot;l rowheader&quot; scope=&quot;row&quot;&gt;HQC&lt;/th&gt;
&lt;td class=&quot;r data&quot;&gt;3519.72475&lt;/td&gt;&lt;/tr&gt;
&lt;tr&gt;
&lt;th class=&quot;l rowheader&quot; scope=&quot;row&quot;&gt; &lt;/th&gt;
&lt;td class=&quot;r data&quot;&gt; &lt;/td&gt;
&lt;th class=&quot;l rowheader&quot; scope=&quot;row&quot;&gt;Normality Test&lt;/th&gt;
&lt;td class=&quot;r data&quot;&gt;459.8457&lt;/td&gt;&lt;/tr&gt;
&lt;tr&gt;
&lt;th class=&quot;l rowheader&quot; scope=&quot;row&quot;&gt; &lt;/th&gt;
&lt;td class=&quot;r data&quot;&gt; &lt;/td&gt;
&lt;th class=&quot;l rowheader&quot; scope=&quot;row&quot;&gt;Pr &amp;gt; ChiSq&lt;/th&gt;
&lt;td class=&quot;r data&quot;&gt;&amp;lt;.0001&lt;/td&gt;&lt;/tr&gt;
&lt;/tbody&gt;&lt;/table&gt;
&lt;/div&gt;
&lt;/div&gt;
&lt;br /&gt;&lt;a href=&quot;&quot; name=&quot;IDX348&quot;&gt;&lt;/a&gt;
&lt;div&gt;
&lt;div class=&quot;separator&quot; style=&quot;clear: both; text-align: center;&quot;&gt;
&lt;br /&gt;&lt;/div&gt;
&lt;div align=&quot;center&quot;&gt;
&lt;table bordercolor=&quot;#c1c1c1&quot; cellpadding=&quot;5&quot; cellspacing=&quot;0&quot; class=&quot;table&quot; frame=&quot;box&quot; rules=&quot;all&quot; summary=&quot;Procedure Autoreg: Parameter Estimates&quot;&gt;
&lt;colgroup&gt;
&lt;col&gt;&lt;/col&gt;&lt;/colgroup&gt;
&lt;colgroup&gt;
&lt;col&gt;&lt;/col&gt;
&lt;col&gt;&lt;/col&gt;
&lt;col&gt;&lt;/col&gt;
&lt;col&gt;&lt;/col&gt;
&lt;col&gt;&lt;/col&gt;&lt;/colgroup&gt;
&lt;thead&gt;
&lt;tr&gt;
&lt;th class=&quot;c b header&quot; colspan=&quot;6&quot; scope=&quot;colgroup&quot;&gt;Parameter Estimates&lt;/th&gt;&lt;/tr&gt;
&lt;tr&gt;
&lt;th class=&quot;l b header&quot; scope=&quot;col&quot;&gt;Variable&lt;/th&gt;
&lt;th class=&quot;r b header&quot; scope=&quot;col&quot;&gt;DF&lt;/th&gt;
&lt;th class=&quot;r b header&quot; scope=&quot;col&quot;&gt;Estimate&lt;/th&gt;
&lt;th class=&quot;r b header&quot; scope=&quot;col&quot;&gt;Standard Error&lt;/th&gt;
&lt;th class=&quot;r b header&quot; scope=&quot;col&quot;&gt;t Value&lt;/th&gt;
&lt;th class=&quot;r b header&quot; scope=&quot;col&quot;&gt;Approx&lt;br /&gt;Pr &amp;gt; |t|&lt;/th&gt;&lt;/tr&gt;
&lt;/thead&gt;
&lt;tbody&gt;
&lt;tr&gt;
&lt;th class=&quot;l rowheader&quot; scope=&quot;row&quot;&gt;Intercept&lt;/th&gt;
&lt;td class=&quot;r data&quot;&gt;1&lt;/td&gt;
&lt;td class=&quot;r data&quot; nowrap=&quot;&quot;&gt;-4809&lt;/td&gt;
&lt;td class=&quot;r data&quot;&gt;2677&lt;/td&gt;
&lt;td class=&quot;r data&quot; nowrap=&quot;&quot;&gt;-1.80&lt;/td&gt;
&lt;td class=&quot;r data&quot;&gt;0.0725&lt;/td&gt;&lt;/tr&gt;
&lt;tr&gt;
&lt;th class=&quot;l rowheader&quot; scope=&quot;row&quot;&gt;auctionendtime&lt;/th&gt;
&lt;td class=&quot;r data&quot;&gt;1&lt;/td&gt;
&lt;td class=&quot;r data&quot; nowrap=&quot;&quot;&gt;2.9085E-6&lt;/td&gt;
&lt;td class=&quot;r data&quot;&gt;0&lt;/td&gt;
&lt;td class=&quot;r data&quot;&gt;Infty&lt;/td&gt;
&lt;td class=&quot;r data&quot;&gt;&amp;lt;.0001&lt;/td&gt;&lt;/tr&gt;
&lt;tr&gt;
&lt;th class=&quot;l rowheader&quot; scope=&quot;row&quot;&gt;AR1&lt;/th&gt;
&lt;td class=&quot;r data&quot;&gt;1&lt;/td&gt;
&lt;td class=&quot;r data&quot; nowrap=&quot;&quot;&gt;-0.0204&lt;/td&gt;
&lt;td class=&quot;r data&quot;&gt;0.0372&lt;/td&gt;
&lt;td class=&quot;r data&quot; nowrap=&quot;&quot;&gt;-0.55&lt;/td&gt;
&lt;td class=&quot;r data&quot;&gt;0.5839&lt;/td&gt;&lt;/tr&gt;
&lt;tr&gt;
&lt;th class=&quot;l rowheader&quot; scope=&quot;row&quot;&gt;AR2&lt;/th&gt;
&lt;td class=&quot;r data&quot;&gt;1&lt;/td&gt;
&lt;td class=&quot;r data&quot;&gt;0.0745&lt;/td&gt;
&lt;td class=&quot;r data&quot;&gt;0.0363&lt;/td&gt;
&lt;td class=&quot;r data&quot;&gt;2.05&lt;/td&gt;
&lt;td class=&quot;r data&quot;&gt;0.0403&lt;/td&gt;&lt;/tr&gt;
&lt;tr&gt;
&lt;th class=&quot;l rowheader&quot; scope=&quot;row&quot;&gt;EARCH0&lt;/th&gt;
&lt;td class=&quot;r data&quot;&gt;1&lt;/td&gt;
&lt;td class=&quot;r data&quot;&gt;0.6534&lt;/td&gt;
&lt;td class=&quot;r data&quot;&gt;0.0613&lt;/td&gt;
&lt;td class=&quot;r data&quot;&gt;10.66&lt;/td&gt;
&lt;td class=&quot;r data&quot;&gt;&amp;lt;.0001&lt;/td&gt;&lt;/tr&gt;
&lt;tr&gt;
&lt;th class=&quot;l rowheader&quot; scope=&quot;row&quot;&gt;EARCH1&lt;/th&gt;
&lt;td class=&quot;r data&quot;&gt;1&lt;/td&gt;
&lt;td class=&quot;r data&quot; nowrap=&quot;&quot;&gt;-0.1449&lt;/td&gt;
&lt;td class=&quot;r data&quot;&gt;0.0341&lt;/td&gt;
&lt;td class=&quot;r data&quot; nowrap=&quot;&quot;&gt;-4.25&lt;/td&gt;
&lt;td class=&quot;r data&quot;&gt;&amp;lt;.0001&lt;/td&gt;&lt;/tr&gt;
&lt;tr&gt;
&lt;th class=&quot;l rowheader&quot; scope=&quot;row&quot;&gt;EGARCH1&lt;/th&gt;
&lt;td class=&quot;r data&quot;&gt;1&lt;/td&gt;
&lt;td class=&quot;r data&quot;&gt;0.8578&lt;/td&gt;
&lt;td class=&quot;r data&quot;&gt;0.0221&lt;/td&gt;
&lt;td class=&quot;r data&quot;&gt;38.76&lt;/td&gt;
&lt;td class=&quot;r data&quot;&gt;&amp;lt;.0001&lt;/td&gt;&lt;/tr&gt;
&lt;tr&gt;
&lt;th class=&quot;l rowheader&quot; scope=&quot;row&quot;&gt;EGARCH15&lt;/th&gt;
&lt;td class=&quot;r data&quot;&gt;1&lt;/td&gt;
&lt;td class=&quot;r data&quot; nowrap=&quot;&quot;&gt;-0.1340&lt;/td&gt;
&lt;td class=&quot;r data&quot;&gt;0.0157&lt;/td&gt;
&lt;td class=&quot;r data&quot; nowrap=&quot;&quot;&gt;-8.56&lt;/td&gt;
&lt;td class=&quot;r data&quot;&gt;&amp;lt;.0001&lt;/td&gt;&lt;/tr&gt;
&lt;tr&gt;
&lt;th class=&quot;l rowheader&quot; scope=&quot;row&quot;&gt;THETA&lt;/th&gt;
&lt;td class=&quot;r data&quot;&gt;1&lt;/td&gt;
&lt;td class=&quot;r data&quot;&gt;0.4318&lt;/td&gt;
&lt;td class=&quot;r data&quot;&gt;0.1766&lt;/td&gt;
&lt;td class=&quot;r data&quot;&gt;2.45&lt;/td&gt;
&lt;td class=&quot;r data&quot;&gt;0.0145&lt;/td&gt;&lt;/tr&gt;
&lt;/tbody&gt;&lt;/table&gt;
&lt;br /&gt;&lt;a href=&quot;https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEgNHLghv94g7lygg_mqzbVnCoJSum5tpuCBATEyXDI1FRKi50vg2vpMsFgH3bJ7ZW14ukqaaXzBuI8KKbsFD9e92ZK0GfWj4zyqch_Oy4VYxCwirMJTGdSg1L5RnAQndwYlSZawxjIse7sC/s1600/Garch_fit_diagnostics.png&quot; imageanchor=&quot;1&quot; style=&quot;margin-left: 1em; margin-right: 1em;&quot;&gt;&lt;img border=&quot;0&quot; src=&quot;https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEgNHLghv94g7lygg_mqzbVnCoJSum5tpuCBATEyXDI1FRKi50vg2vpMsFgH3bJ7ZW14ukqaaXzBuI8KKbsFD9e92ZK0GfWj4zyqch_Oy4VYxCwirMJTGdSg1L5RnAQndwYlSZawxjIse7sC/s1600/Garch_fit_diagnostics.png&quot; /&gt;&lt;/a&gt;&lt;br /&gt;&lt;br /&gt;&lt;/div&gt;
&lt;/div&gt;
&lt;div style=&quot;text-align: left;&quot;&gt;
The output here suggests that lag 15 is significant (seems kind of odd). We probably need more data to support this. In&amp;nbsp;layman&#39;s&amp;nbsp;terms, this suggests that an auction end price 15 periods prior has an effect on the next one.&lt;/div&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;div class=&quot;separator&quot; style=&quot;clear: both; text-align: center;&quot;&gt;
&lt;a href=&quot;https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEh6z8oRdL-e9oICjv0VIHxy-6WAueuzcRBWU9i68kzw9lNJc3xjzM_xclLTaNGbeH1GQMTOsfAUHy2p298Ue3jjIyNiyp1FB_kvlyvGDDHqRqT5SW8nPTnLtiVbpszvAOHDqlZjHnu52mwS/s1600/garch_std.png&quot; imageanchor=&quot;1&quot; style=&quot;margin-left: 1em; margin-right: 1em;&quot;&gt;&lt;img border=&quot;0&quot; src=&quot;https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEh6z8oRdL-e9oICjv0VIHxy-6WAueuzcRBWU9i68kzw9lNJc3xjzM_xclLTaNGbeH1GQMTOsfAUHy2p298Ue3jjIyNiyp1FB_kvlyvGDDHqRqT5SW8nPTnLtiVbpszvAOHDqlZjHnu52mwS/s1600/garch_std.png&quot; /&gt;&lt;/a&gt;&lt;/div&gt;
&lt;br /&gt;
This chart shows the predicted standard deviation in black. As you can see, there are&amp;nbsp;significant&amp;nbsp;differences of what the standard deviation is at certain points in time. So for those of you who use the idea of a &quot;strike price&quot; at 2 or 3 standard deviations away, you are ignoring the fact that the volatility isn&#39;t constant across time.&lt;/div&gt;
&lt;div&gt;
&lt;/div&gt;
&lt;/div&gt;
&lt;/div&gt;
</content><link rel='replies' type='application/atom+xml' href='http://pennystats.blogspot.com/feeds/7151509429326817063/comments/default' title='Post Comments'/><link rel='replies' type='text/html' href='http://pennystats.blogspot.com/2013/01/disproving-idea-of-constant-strike-price.html#comment-form' title='0 Comments'/><link rel='edit' type='application/atom+xml' href='http://www.blogger.com/feeds/8078258480436189776/posts/default/7151509429326817063'/><link rel='self' type='application/atom+xml' href='http://www.blogger.com/feeds/8078258480436189776/posts/default/7151509429326817063'/><link rel='alternate' type='text/html' href='http://pennystats.blogspot.com/2013/01/disproving-idea-of-constant-strike-price.html' title='Disproving the idea of a constant &quot;strike price&quot;'/><author><name>Unknown</name><email>noreply@blogger.com</email><gd:image rel='http://schemas.google.com/g/2005#thumbnail' width='16' height='16' src='https://img1.blogblog.com/img/b16-rounded.gif'/></author><media:thumbnail xmlns:media="http://search.yahoo.com/mrss/" url="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEhd1HVoxNFtxZUyu7gT03_qpDV4BbVmofkTUxrDgqIUGIgpXcy_Jo1WTgdqtN6sQ_Vn82ZZihe0TK336GKYWwZ2QzifVb9dPI8r7tcvu06SzVUfqMBcmliUBthjnxoj0spjP842ZUuAkZ_L/s72-c/Valoatility_June34.png" height="72" width="72"/><thr:total>0</thr:total></entry><entry><id>tag:blogger.com,1999:blog-8078258480436189776.post-7000682781262629936</id><published>2013-01-11T10:28:00.002-08:00</published><updated>2013-01-30T10:31:47.326-08:00</updated><category scheme="http://www.blogger.com/atom/ns#" term="business proposal"/><category scheme="http://www.blogger.com/atom/ns#" term="penny auction"/><category scheme="http://www.blogger.com/atom/ns#" term="predictive modelling"/><category scheme="http://www.blogger.com/atom/ns#" term="risk"/><category scheme="http://www.blogger.com/atom/ns#" term="strategy"/><category scheme="http://www.blogger.com/atom/ns#" term="tips"/><title type='text'>Extracting a business proposition from data</title><content type='html'>&lt;div dir=&quot;ltr&quot; style=&quot;text-align: left;&quot; trbidi=&quot;on&quot;&gt;
It has been a few months since my last post. Turns out a 10 month masters degree takes most of your free time!&lt;br /&gt;
&lt;br /&gt;
One of the last things I was working on was turning some of my insights into value. My original idea was to use statistics to win auctions, sell items, and try to optimize a rate of return. Going back to the drawing board, I came up with an idea that flipped the previous one on its head:&lt;br /&gt;
&lt;br /&gt;
&lt;h4 style=&quot;text-align: left;&quot;&gt;
What if I provided a service that would give a user the statistics they needed to be successful (for a fee), while minimizing overhead costs and risk on my end?&lt;/h4&gt;
&lt;br /&gt;
Using a business strategy like this would allow me to tap the vast user base that come to websites like Quibids.com without risking much capital on my end. In return, I could provide the data to users with advanced statistics for a monthly fee along with other types of value items (such as tutorials). There are many things you can do with a subscription service that would let scale up much easier than if you were buying the items outright. Plus it would give me a chance to do statistics and teach people how to use them (Which is what I wanted to do anyways).&lt;br /&gt;
&lt;br /&gt;
Feel free to contact me or leave a comment with what you think.&lt;/div&gt;
</content><link rel='replies' type='application/atom+xml' href='http://pennystats.blogspot.com/feeds/7000682781262629936/comments/default' title='Post Comments'/><link rel='replies' type='text/html' href='http://pennystats.blogspot.com/2013/01/extracting-business-proposition-from.html#comment-form' title='1 Comments'/><link rel='edit' type='application/atom+xml' href='http://www.blogger.com/feeds/8078258480436189776/posts/default/7000682781262629936'/><link rel='self' type='application/atom+xml' href='http://www.blogger.com/feeds/8078258480436189776/posts/default/7000682781262629936'/><link rel='alternate' type='text/html' href='http://pennystats.blogspot.com/2013/01/extracting-business-proposition-from.html' title='Extracting a business proposition from data'/><author><name>Unknown</name><email>noreply@blogger.com</email><gd:image rel='http://schemas.google.com/g/2005#thumbnail' width='16' height='16' src='https://img1.blogblog.com/img/b16-rounded.gif'/></author><thr:total>1</thr:total></entry><entry><id>tag:blogger.com,1999:blog-8078258480436189776.post-1031273467400120502</id><published>2012-10-08T15:49:00.000-07:00</published><updated>2012-10-08T15:49:55.497-07:00</updated><category scheme="http://www.blogger.com/atom/ns#" term="bidding behavior"/><category scheme="http://www.blogger.com/atom/ns#" term="hazard"/><category scheme="http://www.blogger.com/atom/ns#" term="non proportional model"/><category scheme="http://www.blogger.com/atom/ns#" term="predictive modelling"/><category scheme="http://www.blogger.com/atom/ns#" term="proportional model"/><category scheme="http://www.blogger.com/atom/ns#" term="quibids"/><category scheme="http://www.blogger.com/atom/ns#" term="survival analysis"/><title type='text'>More survival analysis stuff</title><content type='html'>&lt;div dir=&quot;ltr&quot; style=&quot;text-align: left;&quot; trbidi=&quot;on&quot;&gt;
One of the things I am trying to understand are the patterns at the end of an auction. If there is a way to visually understand who has entered and exited an auction along with who remains, you would have a significant advantage over other users. In this case, basic survival charts can show a play-by-play analysis of what&amp;nbsp;occurred&amp;nbsp;in an auction. The chart below is from a 50 bid Voucher auction:&lt;br /&gt;
&lt;br /&gt;
&lt;div class=&quot;separator&quot; style=&quot;clear: both; text-align: center;&quot;&gt;
&lt;a href=&quot;https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEj9vGcpB5ywEN5hXIg28kSzIQZXaMOQB4fPEAN6YTTH3f3VnVb6gXFGNd_kZlzhDIw70A1j0Mu3hGWAYv1ZH6GoIZo1cgP8JY79lgW3_8NXphdObf9sIdHe0XlZGHxkkQLMM1p99WZxk9aq/s1600/SurvivalChart1.jpg&quot; imageanchor=&quot;1&quot; style=&quot;margin-left: 1em; margin-right: 1em;&quot;&gt;&lt;img border=&quot;0&quot; src=&quot;https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEj9vGcpB5ywEN5hXIg28kSzIQZXaMOQB4fPEAN6YTTH3f3VnVb6gXFGNd_kZlzhDIw70A1j0Mu3hGWAYv1ZH6GoIZo1cgP8JY79lgW3_8NXphdObf9sIdHe0XlZGHxkkQLMM1p99WZxk9aq/s1600/SurvivalChart1.jpg&quot; /&gt;&lt;/a&gt;&lt;/div&gt;
&lt;br /&gt;
A visual inspection suggests that many of the bidders have a fixed rate of bidding. Once they exhaust their bids, they abruptly stop bidding. These people would be easy to model into a given auction (if we have enough historical data for the bidder). Even without it, we could create a function to predict the expected quantity of bids based on the rate of bidding. Some confidence interval could also be used to suggest entry points in an auction based on their expected exit from the auction.&lt;br /&gt;
&lt;br /&gt;
The real problem is predicting these values. In a live auction, we can only plot the survival of a user once they leave an auction. One idea would be to plot the &quot;expected&quot; survival plot of each user as they enter the auction. Once in, we could provide a pseudo-survival rate based on historical data or a function as described previously.&lt;br /&gt;
&lt;br /&gt;
I am also looking into using proportional/nonproportional hazard models to try to predict an expected exit time of each bidder. More to come.&lt;/div&gt;
</content><link rel='replies' type='application/atom+xml' href='http://pennystats.blogspot.com/feeds/1031273467400120502/comments/default' title='Post Comments'/><link rel='replies' type='text/html' href='http://pennystats.blogspot.com/2012/10/more-survival-analysis-stuff.html#comment-form' title='0 Comments'/><link rel='edit' type='application/atom+xml' href='http://www.blogger.com/feeds/8078258480436189776/posts/default/1031273467400120502'/><link rel='self' type='application/atom+xml' href='http://www.blogger.com/feeds/8078258480436189776/posts/default/1031273467400120502'/><link rel='alternate' type='text/html' href='http://pennystats.blogspot.com/2012/10/more-survival-analysis-stuff.html' title='More survival analysis stuff'/><author><name>Unknown</name><email>noreply@blogger.com</email><gd:image rel='http://schemas.google.com/g/2005#thumbnail' width='16' height='16' src='https://img1.blogblog.com/img/b16-rounded.gif'/></author><media:thumbnail xmlns:media="http://search.yahoo.com/mrss/" url="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEj9vGcpB5ywEN5hXIg28kSzIQZXaMOQB4fPEAN6YTTH3f3VnVb6gXFGNd_kZlzhDIw70A1j0Mu3hGWAYv1ZH6GoIZo1cgP8JY79lgW3_8NXphdObf9sIdHe0XlZGHxkkQLMM1p99WZxk9aq/s72-c/SurvivalChart1.jpg" height="72" width="72"/><thr:total>0</thr:total></entry><entry><id>tag:blogger.com,1999:blog-8078258480436189776.post-1900910011019958576</id><published>2012-10-02T08:05:00.000-07:00</published><updated>2012-10-02T08:05:08.297-07:00</updated><category scheme="http://www.blogger.com/atom/ns#" term="bidding behavior"/><category scheme="http://www.blogger.com/atom/ns#" term="hazard"/><category scheme="http://www.blogger.com/atom/ns#" term="hazard function"/><category scheme="http://www.blogger.com/atom/ns#" term="hazard rate"/><category scheme="http://www.blogger.com/atom/ns#" term="quibids"/><category scheme="http://www.blogger.com/atom/ns#" term="statistics"/><category scheme="http://www.blogger.com/atom/ns#" term="survival analysis"/><title type='text'>Survival Analysis and Hazard Functions</title><content type='html'>&lt;div dir=&quot;ltr&quot; style=&quot;text-align: left;&quot; trbidi=&quot;on&quot;&gt;
If we want to predict the ending point of an individual auction, it is important to understand the hazards that occur at certain points in the auction. By understanding these patterns in an auction, we can understand specific points of attrition for individuals. It is important to note that the hazard function is not related to winning an auction. Just because you last the longest in an auction does not necessarily mean you won an auction. In many cases, others will swoop in near the end an win with relatively few bids.&lt;br /&gt;
&lt;br /&gt;
&lt;div class=&quot;separator&quot; style=&quot;clear: both; text-align: left;&quot;&gt;
&lt;br /&gt;&lt;/div&gt;
&lt;div class=&quot;separator&quot; style=&quot;clear: both; text-align: left;&quot;&gt;
For all of the charts, they are from auctions for iPads. They are a random sample and should give a general idea of the increasing hazard rates (NOT hazard probabilities) during each auction. If you are not familiar with hazard rates, they are proportional to hazard probabilities. In essence, a higher value suggests that the hazard of leaving (or likelihood of leaving the auction) is higher. The spikes suggest that there is a high likelihood of quitting at low time duration, medium time duration, and high time duration.&lt;/div&gt;
&lt;div class=&quot;separator&quot; style=&quot;clear: both; text-align: left;&quot;&gt;
&lt;br /&gt;&lt;/div&gt;
&lt;div class=&quot;separator&quot; style=&quot;clear: both; text-align: left;&quot;&gt;
&lt;u&gt;Auction 1 for iPad&lt;/u&gt;&lt;/div&gt;
&lt;br /&gt;
&lt;div class=&quot;separator&quot; style=&quot;clear: both; text-align: center;&quot;&gt;
&lt;a href=&quot;https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEisIkOlfihyphenhyphenfEKqfeP8y2P4g8EvK9nd7i4dTJIrpakKNol2LCHRih9nkigFNyUdS06Lm7GTvBhnNksOgvruGLOP26w483N_IH88AoPD-a-Q25pmFrdMQCvf_QJnbEPVUxZFx53-9UhEt8BQ/s1600/Hazard1.png&quot; imageanchor=&quot;1&quot; style=&quot;margin-left: 1em; margin-right: 1em;&quot;&gt;&lt;img border=&quot;0&quot; src=&quot;https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEisIkOlfihyphenhyphenfEKqfeP8y2P4g8EvK9nd7i4dTJIrpakKNol2LCHRih9nkigFNyUdS06Lm7GTvBhnNksOgvruGLOP26w483N_IH88AoPD-a-Q25pmFrdMQCvf_QJnbEPVUxZFx53-9UhEt8BQ/s1600/Hazard1.png&quot; /&gt;&lt;/a&gt;&lt;/div&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;u&gt;Auction 2 for iPad&lt;/u&gt;&lt;br /&gt;
&lt;u&gt;&lt;br /&gt;&lt;/u&gt;
&lt;div class=&quot;separator&quot; style=&quot;clear: both; text-align: center;&quot;&gt;
&lt;a href=&quot;https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEghi527xe-kB_b5meRJKAYggORejZ8C0e2k3CbgyDkv4_R7LhVCRqzh_OY9mkBn-NXWxHc4HjJ-H3XiFEzLDlHgXPDqp40F2uWhbbvEfGZRJQRla6BfAqaO2vBH70XcjBjSWOsPfIFlU6C-/s1600/Hazard2.png&quot; imageanchor=&quot;1&quot; style=&quot;margin-left: 1em; margin-right: 1em;&quot;&gt;&lt;img border=&quot;0&quot; src=&quot;https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEghi527xe-kB_b5meRJKAYggORejZ8C0e2k3CbgyDkv4_R7LhVCRqzh_OY9mkBn-NXWxHc4HjJ-H3XiFEzLDlHgXPDqp40F2uWhbbvEfGZRJQRla6BfAqaO2vBH70XcjBjSWOsPfIFlU6C-/s1600/Hazard2.png&quot; /&gt;&lt;/a&gt;&lt;/div&gt;
&lt;br /&gt;
&lt;u&gt;Auction 3 for iPad&lt;/u&gt;&lt;br /&gt;
&lt;br /&gt;
&lt;div class=&quot;separator&quot; style=&quot;clear: both; text-align: center;&quot;&gt;
&lt;a href=&quot;https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEjRrt5liONS6whSttgNIIbqvSzRqOWKVjeqzo4mWYIyF9lt7TSYI5Om1WZjJCRepd8clDvt56JXonwR3PSkGNbcgqzdu4Xcu6O48HGyDNxKoKm8p5SXhPuQpnBMYMoxzCEXfACYZqBjYAdK/s1600/Hazard3.png&quot; imageanchor=&quot;1&quot; style=&quot;margin-left: 1em; margin-right: 1em;&quot;&gt;&lt;img border=&quot;0&quot; src=&quot;https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEjRrt5liONS6whSttgNIIbqvSzRqOWKVjeqzo4mWYIyF9lt7TSYI5Om1WZjJCRepd8clDvt56JXonwR3PSkGNbcgqzdu4Xcu6O48HGyDNxKoKm8p5SXhPuQpnBMYMoxzCEXfACYZqBjYAdK/s1600/Hazard3.png&quot; /&gt;&lt;/a&gt;&lt;/div&gt;
&lt;br /&gt;
&lt;u&gt;Auction 4 for iPad&lt;/u&gt;&lt;br /&gt;
&lt;br /&gt;
&lt;div class=&quot;separator&quot; style=&quot;clear: both; text-align: center;&quot;&gt;
&lt;a href=&quot;https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEhrEuPumXQslKI5NydhJkPjWTQePcfDSDO1N3TT2MGWkwlGfB_EsjiTwW6SFEMTVIxwpZt8JUpF04d8zEb7fXJAkaRsFBMu-Icc8hHXbUUaOkkblEgTK-Prli6nD5ulcfQUc9hGXH0Wn6mf/s1600/Hazard4.png&quot; imageanchor=&quot;1&quot; style=&quot;margin-left: 1em; margin-right: 1em;&quot;&gt;&lt;img border=&quot;0&quot; src=&quot;https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEhrEuPumXQslKI5NydhJkPjWTQePcfDSDO1N3TT2MGWkwlGfB_EsjiTwW6SFEMTVIxwpZt8JUpF04d8zEb7fXJAkaRsFBMu-Icc8hHXbUUaOkkblEgTK-Prli6nD5ulcfQUc9hGXH0Wn6mf/s1600/Hazard4.png&quot; /&gt;&lt;/a&gt;&lt;/div&gt;
&lt;div class=&quot;separator&quot; style=&quot;clear: both; text-align: left;&quot;&gt;
&lt;br /&gt;&lt;/div&gt;
&lt;div class=&quot;separator&quot; style=&quot;clear: both; text-align: left;&quot;&gt;
In general, there appears to be a W-Shape or U-Shape to the hazards. There may be some relationship between hazard pattern and the maximum time in the auction. The maximum time in the auction is highly correlated with the ending auction price (for someone to be in the auction for a long period of time, they have to bid for a long period of time OR start and stop over a long period of time).&lt;/div&gt;
&lt;div class=&quot;separator&quot; style=&quot;clear: both; text-align: left;&quot;&gt;
&lt;br /&gt;&lt;/div&gt;
&lt;div class=&quot;separator&quot; style=&quot;clear: both; text-align: left;&quot;&gt;
Later on I will model expected end points for auction using this phenomena and other variables.&lt;/div&gt;
&lt;br /&gt;&lt;/div&gt;
</content><link rel='replies' type='application/atom+xml' href='http://pennystats.blogspot.com/feeds/1900910011019958576/comments/default' title='Post Comments'/><link rel='replies' type='text/html' href='http://pennystats.blogspot.com/2012/10/survival-analysis-and-hazard-functions.html#comment-form' title='0 Comments'/><link rel='edit' type='application/atom+xml' href='http://www.blogger.com/feeds/8078258480436189776/posts/default/1900910011019958576'/><link rel='self' type='application/atom+xml' href='http://www.blogger.com/feeds/8078258480436189776/posts/default/1900910011019958576'/><link rel='alternate' type='text/html' href='http://pennystats.blogspot.com/2012/10/survival-analysis-and-hazard-functions.html' title='Survival Analysis and Hazard Functions'/><author><name>Unknown</name><email>noreply@blogger.com</email><gd:image rel='http://schemas.google.com/g/2005#thumbnail' width='16' height='16' src='https://img1.blogblog.com/img/b16-rounded.gif'/></author><media:thumbnail xmlns:media="http://search.yahoo.com/mrss/" url="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEisIkOlfihyphenhyphenfEKqfeP8y2P4g8EvK9nd7i4dTJIrpakKNol2LCHRih9nkigFNyUdS06Lm7GTvBhnNksOgvruGLOP26w483N_IH88AoPD-a-Q25pmFrdMQCvf_QJnbEPVUxZFx53-9UhEt8BQ/s72-c/Hazard1.png" height="72" width="72"/><thr:total>0</thr:total></entry><entry><id>tag:blogger.com,1999:blog-8078258480436189776.post-4740771453275743350</id><published>2012-08-13T05:58:00.001-07:00</published><updated>2012-08-13T05:58:28.355-07:00</updated><category scheme="http://www.blogger.com/atom/ns#" term="behavior"/><category scheme="http://www.blogger.com/atom/ns#" term="bidding behavior"/><category scheme="http://www.blogger.com/atom/ns#" term="gift card"/><category scheme="http://www.blogger.com/atom/ns#" term="patterns"/><category scheme="http://www.blogger.com/atom/ns#" term="quibids"/><category scheme="http://www.blogger.com/atom/ns#" term="strategy"/><title type='text'>Insights into bidding behavior</title><content type='html'>&lt;div dir=&quot;ltr&quot; style=&quot;text-align: left;&quot; trbidi=&quot;on&quot;&gt;
Until this point, all I had to work with were total bid quantities per bidder. This was useful for basic modelling, but not much more than that. With the new data set provided by&amp;nbsp;&lt;a href=&quot;http://www.quibidsinsider.com/&quot;&gt;http://www.quibidsinsider.com&lt;/a&gt;, I have been able to drill down much deeper into bidding behavior. This data has bid times tracked by the second as well as their bid number.&lt;br /&gt;
&lt;br /&gt;
This information reveals insights into each bidder. For reference, this auction was for a $50 Walmart Gift Card and ended with 1720 bids ($17.20). Each circle represents a bid. The line is just a general trend line.&lt;br /&gt;
&lt;br /&gt;
Some bidders will bid continuously until they decide that they don&#39;t want to play anymore. These are generally the strict BidOMatic bidders who set strict bidding ranges.&lt;br /&gt;
&lt;br /&gt;
&lt;div class=&quot;separator&quot; style=&quot;clear: both; text-align: center;&quot;&gt;
&lt;a href=&quot;https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEhiGlbYyquC3rpwSB26k504lgZX_Qinq08w7Niqr__tVoFHLIeOY-g0omC3cJ71EmClz9bDasuwpQQLGhq8wODZ0NW2nG3bQ9TVu_SAGWDNBZVNWA_JhFdJYSHtxnlJT3Zo8qyfF6DWYQ_Q/s1600/wvuferrari.png&quot; imageanchor=&quot;1&quot; style=&quot;margin-left: 1em; margin-right: 1em;&quot;&gt;&lt;img border=&quot;0&quot; src=&quot;https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEhiGlbYyquC3rpwSB26k504lgZX_Qinq08w7Niqr__tVoFHLIeOY-g0omC3cJ71EmClz9bDasuwpQQLGhq8wODZ0NW2nG3bQ9TVu_SAGWDNBZVNWA_JhFdJYSHtxnlJT3Zo8qyfF6DWYQ_Q/s1600/wvuferrari.png&quot; /&gt;&lt;/a&gt;&lt;/div&gt;
&lt;div class=&quot;separator&quot; style=&quot;clear: both; text-align: center;&quot;&gt;
&lt;br /&gt;&lt;/div&gt;
&lt;div class=&quot;separator&quot; style=&quot;clear: both; text-align: left;&quot;&gt;
&lt;br /&gt;&lt;/div&gt;
&lt;div class=&quot;separator&quot; style=&quot;clear: both; text-align: left;&quot;&gt;
&lt;br /&gt;&lt;/div&gt;
&lt;div class=&quot;separator&quot; style=&quot;clear: both; text-align: left;&quot;&gt;
Most bidders do not bid linearly. In fact, there are a variety of different strategies employed by each user. Some bid hard early, wait, and try to bid again later (as seen below).&lt;/div&gt;
&lt;br /&gt;
&lt;div class=&quot;separator&quot; style=&quot;clear: both; text-align: center;&quot;&gt;
&lt;a href=&quot;https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEhHY_PLf4UL2gKvTGgU5CFSk07xOs9b1y9fAlt1XSP4MkQ2eD_84hfl3N7hyPXNgFqV0czoOdl2CBkhNIbyQNc44-TiWx92IKPAMKd9OSJ3uBNCgFRk52xKLv17vJ0aGnNUAxJx7g-3xGfl/s1600/sjdnc34.png&quot; imageanchor=&quot;1&quot; style=&quot;margin-left: 1em; margin-right: 1em;&quot;&gt;&lt;img border=&quot;0&quot; src=&quot;https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEhHY_PLf4UL2gKvTGgU5CFSk07xOs9b1y9fAlt1XSP4MkQ2eD_84hfl3N7hyPXNgFqV0czoOdl2CBkhNIbyQNc44-TiWx92IKPAMKd9OSJ3uBNCgFRk52xKLv17vJ0aGnNUAxJx7g-3xGfl/s1600/sjdnc34.png&quot; /&gt;&lt;/a&gt;&lt;/div&gt;
&lt;div class=&quot;separator&quot; style=&quot;clear: both; text-align: center;&quot;&gt;
&lt;br /&gt;&lt;/div&gt;
&lt;div class=&quot;separator&quot; style=&quot;clear: both; text-align: center;&quot;&gt;
&lt;br /&gt;&lt;/div&gt;
&lt;div class=&quot;separator&quot; style=&quot;clear: both; text-align: center;&quot;&gt;
&lt;br /&gt;&lt;/div&gt;
&lt;div class=&quot;separator&quot; style=&quot;clear: both; text-align: left;&quot;&gt;
Others will bid lightly and&amp;nbsp;sporadically&amp;nbsp;during each auction without any&amp;nbsp;discernible&amp;nbsp;pattern.&lt;/div&gt;
&lt;div class=&quot;separator&quot; style=&quot;clear: both; text-align: center;&quot;&gt;
&lt;a href=&quot;https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEgzxBjQWtWQdh9Br33ItDwSz9DNGlIf6W0ltuZ8J0Uw3QV1q0XlxJTRG0Hs1slMohPBAS4oZ_schGNkrmoaP8vlXNhn60aXrcI1Sd07saf1Wwr2NTbywXndEPkDzqZD_u2JyTrK2Q5fYu3b/s1600/schewe2u2.png&quot; imageanchor=&quot;1&quot; style=&quot;margin-left: 1em; margin-right: 1em;&quot;&gt;&lt;img border=&quot;0&quot; src=&quot;https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEgzxBjQWtWQdh9Br33ItDwSz9DNGlIf6W0ltuZ8J0Uw3QV1q0XlxJTRG0Hs1slMohPBAS4oZ_schGNkrmoaP8vlXNhn60aXrcI1Sd07saf1Wwr2NTbywXndEPkDzqZD_u2JyTrK2Q5fYu3b/s1600/schewe2u2.png&quot; /&gt;&lt;/a&gt;&lt;/div&gt;
&lt;div class=&quot;separator&quot; style=&quot;clear: both; text-align: left;&quot;&gt;
&lt;br /&gt;&lt;/div&gt;
&lt;div class=&quot;separator&quot; style=&quot;clear: both; text-align: left;&quot;&gt;
&lt;br /&gt;&lt;/div&gt;
&lt;div class=&quot;separator&quot; style=&quot;clear: both; text-align: left;&quot;&gt;
&lt;br /&gt;&lt;/div&gt;
&lt;div class=&quot;separator&quot; style=&quot;clear: both; text-align: left;&quot;&gt;
In reality, these patterns aren&#39;t particularly useful when trying to understand how auction winners win. To determine that, we need to examine what an auction winner does.&amp;nbsp;&lt;/div&gt;
&lt;div class=&quot;separator&quot; style=&quot;clear: both; text-align: left;&quot;&gt;
&lt;br /&gt;&lt;/div&gt;
&lt;div class=&quot;separator&quot; style=&quot;clear: both; text-align: center;&quot;&gt;
&lt;a href=&quot;https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEhcwZ85AeM03nbcjW6vZ5NIP8DIZFouQjCWFo3uFfHpq5_Rf7FMZqFKdlAt0dlH1_lNdmfc3cpjzwGim8N_d98docvNASwSiR1y5o8e_xNVapZEmPsJT13IKkvdatGb7QlLZlNp465gjp2w/s1600/5starebayer.png&quot; imageanchor=&quot;1&quot; style=&quot;margin-left: 1em; margin-right: 1em;&quot;&gt;&lt;img border=&quot;0&quot; src=&quot;https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEhcwZ85AeM03nbcjW6vZ5NIP8DIZFouQjCWFo3uFfHpq5_Rf7FMZqFKdlAt0dlH1_lNdmfc3cpjzwGim8N_d98docvNASwSiR1y5o8e_xNVapZEmPsJT13IKkvdatGb7QlLZlNp465gjp2w/s1600/5starebayer.png&quot; /&gt;&lt;/a&gt;&lt;/div&gt;
&lt;div class=&quot;separator&quot; style=&quot;clear: both; text-align: left;&quot;&gt;
&lt;br /&gt;&lt;/div&gt;
&lt;div class=&quot;separator&quot; style=&quot;clear: both; text-align: left;&quot;&gt;
&lt;br /&gt;&lt;/div&gt;
&lt;div class=&quot;separator&quot; style=&quot;clear: both; text-align: left;&quot;&gt;
&lt;br /&gt;&lt;/div&gt;
&lt;div class=&quot;separator&quot; style=&quot;clear: both; text-align: left;&quot;&gt;
In this case, 5starebayer won the auction. He/she employed a concentrated burst attack over about a 20 minute time period. Perhaps this was when the user detected the exit of an aggressive bidder or when a BidOMatic bidder ran out of bids. In any case, the strategy worked (in this particular auction) while others did not.&lt;/div&gt;
&lt;div class=&quot;separator&quot; style=&quot;clear: both; text-align: left;&quot;&gt;
&lt;br /&gt;&lt;/div&gt;
&lt;div class=&quot;separator&quot; style=&quot;clear: both; text-align: left;&quot;&gt;
It remains to be seen if each user has similar bidding patterns in each auction. This is something I will be investigating further.&lt;/div&gt;
&lt;br /&gt;&lt;/div&gt;
</content><link rel='replies' type='application/atom+xml' href='http://pennystats.blogspot.com/feeds/4740771453275743350/comments/default' title='Post Comments'/><link rel='replies' type='text/html' href='http://pennystats.blogspot.com/2012/08/insights-into-bidding-behavior.html#comment-form' title='0 Comments'/><link rel='edit' type='application/atom+xml' href='http://www.blogger.com/feeds/8078258480436189776/posts/default/4740771453275743350'/><link rel='self' type='application/atom+xml' href='http://www.blogger.com/feeds/8078258480436189776/posts/default/4740771453275743350'/><link rel='alternate' type='text/html' href='http://pennystats.blogspot.com/2012/08/insights-into-bidding-behavior.html' title='Insights into bidding behavior'/><author><name>Unknown</name><email>noreply@blogger.com</email><gd:image rel='http://schemas.google.com/g/2005#thumbnail' width='16' height='16' src='https://img1.blogblog.com/img/b16-rounded.gif'/></author><media:thumbnail xmlns:media="http://search.yahoo.com/mrss/" url="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEhiGlbYyquC3rpwSB26k504lgZX_Qinq08w7Niqr__tVoFHLIeOY-g0omC3cJ71EmClz9bDasuwpQQLGhq8wODZ0NW2nG3bQ9TVu_SAGWDNBZVNWA_JhFdJYSHtxnlJT3Zo8qyfF6DWYQ_Q/s72-c/wvuferrari.png" height="72" width="72"/><thr:total>0</thr:total></entry><entry><id>tag:blogger.com,1999:blog-8078258480436189776.post-4528632121604642641</id><published>2012-08-05T14:10:00.001-07:00</published><updated>2012-08-05T14:10:52.349-07:00</updated><category scheme="http://www.blogger.com/atom/ns#" term="auction"/><category scheme="http://www.blogger.com/atom/ns#" term="data"/><category scheme="http://www.blogger.com/atom/ns#" term="penny auction"/><category scheme="http://www.blogger.com/atom/ns#" term="quibids"/><category scheme="http://www.blogger.com/atom/ns#" term="quibidsinsider"/><category scheme="http://www.blogger.com/atom/ns#" term="scraper"/><category scheme="http://www.blogger.com/atom/ns#" term="script"/><title type='text'>A new shift in direction</title><content type='html'>&lt;div dir=&quot;ltr&quot; style=&quot;text-align: left;&quot; trbidi=&quot;on&quot;&gt;
&lt;div&gt;
Several things have&amp;nbsp;occurred&amp;nbsp;since my last post. I would like to summarize them as good and bad news. Let&#39;s start with the bad, just to get it out of the way:&lt;/div&gt;
&lt;div&gt;
&lt;br /&gt;&lt;/div&gt;
&lt;div&gt;
&lt;b&gt;&lt;u&gt;The Bad:&lt;/u&gt;&lt;/b&gt;&lt;/div&gt;
&lt;div&gt;
 First, I started my graduate program. It has been extremely time intensive and has put me into a position where I have little time to maintain or fix the existing script. I am&amp;nbsp;announcing&amp;nbsp;that&lt;b&gt; &lt;u&gt;I will not be fixing or updating the script in any way&lt;/u&gt;&lt;/b&gt;. However, the script is still a great jumping off point for anyone looking to try to do something similar.&lt;/div&gt;
&lt;div&gt;
&lt;br /&gt;&lt;/div&gt;
&lt;div&gt;
&lt;b&gt;&lt;u&gt;The Good:&lt;/u&gt;&lt;/b&gt;&lt;/div&gt;
&lt;div&gt;
I have teamed up with a fellow North Carolina State researcher who operates a fully automated Quibids scraper (&lt;a href=&quot;http://quibidsinsider.com/&quot;&gt;http://quibidsinsider.com/&lt;/a&gt;). Since he is actually a programmer, the capabilities of the website are significantly greater than the script I wrote. The best part is that I will now have access to more data. And with more data, I can do more analysis (You know, the original purpose of this project).&lt;/div&gt;
&lt;div&gt;
&lt;br /&gt;&lt;/div&gt;
&lt;div&gt;
So from now on, the blog will be solely based on the analysis of that data. Ultimately, I would like to create some kind of predictive modeling to determine probabilities of winning auctions based on lots of factors (User behavior, time of date, etc.) It may even spin off into a pay service similar to &lt;a href=&quot;http://www.allpennyauctions.com/&quot;&gt;www.allpennyauctions.com&lt;/a&gt;. Who knows. Should be an interesting adventure.&lt;/div&gt;
&lt;/div&gt;</content><link rel='replies' type='application/atom+xml' href='http://pennystats.blogspot.com/feeds/4528632121604642641/comments/default' title='Post Comments'/><link rel='replies' type='text/html' href='http://pennystats.blogspot.com/2012/08/a-new-shift-in-direction.html#comment-form' title='6 Comments'/><link rel='edit' type='application/atom+xml' href='http://www.blogger.com/feeds/8078258480436189776/posts/default/4528632121604642641'/><link rel='self' type='application/atom+xml' href='http://www.blogger.com/feeds/8078258480436189776/posts/default/4528632121604642641'/><link rel='alternate' type='text/html' href='http://pennystats.blogspot.com/2012/08/a-new-shift-in-direction.html' title='A new shift in direction'/><author><name>Unknown</name><email>noreply@blogger.com</email><gd:image rel='http://schemas.google.com/g/2005#thumbnail' width='16' height='16' src='https://img1.blogblog.com/img/b16-rounded.gif'/></author><thr:total>6</thr:total></entry><entry><id>tag:blogger.com,1999:blog-8078258480436189776.post-7334443120150873665</id><published>2012-06-28T07:12:00.001-07:00</published><updated>2012-06-28T07:12:24.221-07:00</updated><category scheme="http://www.blogger.com/atom/ns#" term="quibids"/><category scheme="http://www.blogger.com/atom/ns#" term="scrape"/><category scheme="http://www.blogger.com/atom/ns#" term="statistics"/><title type='text'>Quibids website changes</title><content type='html'>&lt;div dir=&quot;ltr&quot; style=&quot;text-align: left;&quot; trbidi=&quot;on&quot;&gt;
Well it was bound to happen. Quibids changed the design of their website. By doing so, they crippled my data mining script. I will have to investigate and update it to get data mining again.&lt;/div&gt;</content><link rel='replies' type='application/atom+xml' href='http://pennystats.blogspot.com/feeds/7334443120150873665/comments/default' title='Post Comments'/><link rel='replies' type='text/html' href='http://pennystats.blogspot.com/2012/06/quibids-website-changes.html#comment-form' title='0 Comments'/><link rel='edit' type='application/atom+xml' href='http://www.blogger.com/feeds/8078258480436189776/posts/default/7334443120150873665'/><link rel='self' type='application/atom+xml' href='http://www.blogger.com/feeds/8078258480436189776/posts/default/7334443120150873665'/><link rel='alternate' type='text/html' href='http://pennystats.blogspot.com/2012/06/quibids-website-changes.html' title='Quibids website changes'/><author><name>Unknown</name><email>noreply@blogger.com</email><gd:image rel='http://schemas.google.com/g/2005#thumbnail' width='16' height='16' src='https://img1.blogblog.com/img/b16-rounded.gif'/></author><thr:total>0</thr:total></entry><entry><id>tag:blogger.com,1999:blog-8078258480436189776.post-7807542051313822373</id><published>2012-06-19T10:54:00.001-07:00</published><updated>2012-06-19T10:54:31.933-07:00</updated><category scheme="http://www.blogger.com/atom/ns#" term="chart"/><category scheme="http://www.blogger.com/atom/ns#" term="chart of the day"/><category scheme="http://www.blogger.com/atom/ns#" term="gift card"/><category scheme="http://www.blogger.com/atom/ns#" term="quibids"/><category scheme="http://www.blogger.com/atom/ns#" term="strategy"/><title type='text'>Pennystats Chart of the Day - 6/19/12</title><content type='html'>&lt;div dir=&quot;ltr&quot; style=&quot;text-align: left;&quot; trbidi=&quot;on&quot;&gt;
Its been a few days since my last post (just got back from vacation), so I tried to come up with something that will really help bidders understand what they are up against in a competitive auction.&lt;div&gt;
&lt;br /&gt;&lt;/div&gt;
&lt;div&gt;
I decided to look at $25 gift cards again to quantify how much people will typically bid in a given auction. To my surprise, they were fairly consistent with what I uncovered in the&amp;nbsp;&lt;a href=&quot;http://pennystats.blogspot.com/2012/06/pennystats-chart-of-day-61212.html&quot;&gt;$10 gift card auctions&lt;/a&gt;. Most of the aggressive bidding occurs between 2am and 8am. This further compels me to believe that bidders are more aggressive when there are fewer auctions available.&lt;/div&gt;
&lt;div&gt;
&lt;br /&gt;&lt;/div&gt;
&lt;div&gt;
Bidding aggressiveness nearly plateaus between 12pm-8pm, then steadily ramps up for the evening. In general, the weekends appeared to be the time for least aggressive bidding. I would suggest that the best time to aggressively bid on $25 gift cards would be on the weekends between 12pm-4pm, when there are plentiful auctions available.&lt;/div&gt;
&lt;div&gt;
&lt;br /&gt;&lt;/div&gt;
&lt;div class=&quot;separator&quot; style=&quot;clear: both; text-align: center;&quot;&gt;
&lt;a href=&quot;https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEjqelZUwikshctyn3fD1Vp0t45bgaDRLLTZda1QC83qkDDjFWCMGWWhmhgu6dJPCwWibn2hElhwl6xjnPx_Vz0zghPpHovOB1K_eCiH6yinZpZJLxIFbuGLdMDROB30Wrt78bcbwgVBuYfI/s1600/COTD-061912.JPG&quot; imageanchor=&quot;1&quot; style=&quot;margin-left: 1em; margin-right: 1em;&quot;&gt;&lt;img border=&quot;0&quot; src=&quot;https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEjqelZUwikshctyn3fD1Vp0t45bgaDRLLTZda1QC83qkDDjFWCMGWWhmhgu6dJPCwWibn2hElhwl6xjnPx_Vz0zghPpHovOB1K_eCiH6yinZpZJLxIFbuGLdMDROB30Wrt78bcbwgVBuYfI/s1600/COTD-061912.JPG&quot; /&gt;&lt;/a&gt;&lt;/div&gt;
&lt;div&gt;
&lt;br /&gt;&lt;/div&gt;
&lt;/div&gt;</content><link rel='replies' type='application/atom+xml' href='http://pennystats.blogspot.com/feeds/7807542051313822373/comments/default' title='Post Comments'/><link rel='replies' type='text/html' href='http://pennystats.blogspot.com/2012/06/pennystats-chart-of-day-61912.html#comment-form' title='6 Comments'/><link rel='edit' type='application/atom+xml' href='http://www.blogger.com/feeds/8078258480436189776/posts/default/7807542051313822373'/><link rel='self' type='application/atom+xml' href='http://www.blogger.com/feeds/8078258480436189776/posts/default/7807542051313822373'/><link rel='alternate' type='text/html' href='http://pennystats.blogspot.com/2012/06/pennystats-chart-of-day-61912.html' title='Pennystats Chart of the Day - 6/19/12'/><author><name>Unknown</name><email>noreply@blogger.com</email><gd:image rel='http://schemas.google.com/g/2005#thumbnail' width='16' height='16' src='https://img1.blogblog.com/img/b16-rounded.gif'/></author><media:thumbnail xmlns:media="http://search.yahoo.com/mrss/" url="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEjqelZUwikshctyn3fD1Vp0t45bgaDRLLTZda1QC83qkDDjFWCMGWWhmhgu6dJPCwWibn2hElhwl6xjnPx_Vz0zghPpHovOB1K_eCiH6yinZpZJLxIFbuGLdMDROB30Wrt78bcbwgVBuYfI/s72-c/COTD-061912.JPG" height="72" width="72"/><thr:total>6</thr:total></entry><entry><id>tag:blogger.com,1999:blog-8078258480436189776.post-8992110558937368482</id><published>2012-06-15T18:03:00.000-07:00</published><updated>2012-06-15T18:03:39.761-07:00</updated><category scheme="http://www.blogger.com/atom/ns#" term="chart"/><category scheme="http://www.blogger.com/atom/ns#" term="chart of the day"/><category scheme="http://www.blogger.com/atom/ns#" term="quibids"/><category scheme="http://www.blogger.com/atom/ns#" term="strategy"/><category scheme="http://www.blogger.com/atom/ns#" term="tips"/><title type='text'>Pennystats Chart of the Day - 6/15/12</title><content type='html'>&lt;div dir=&quot;ltr&quot; style=&quot;text-align: left;&quot; trbidi=&quot;on&quot;&gt;
Profiting from winning auctions is another challenge. Since retail prices on Quibids is often an&amp;nbsp;exaggeration&amp;nbsp;or even outrageous, winning auctions that can easily be flipped is important in generating a steady revenue stream.&lt;br /&gt;
&lt;br /&gt;
&lt;a href=&quot;http://www.plasticjungle.com/&quot;&gt;The Plastic Jungle&lt;/a&gt;&amp;nbsp;is a company that offers to resell your gift cards for a percentage of the value. Like the&amp;nbsp;&lt;a href=&quot;http://pennystats.blogspot.com/2012/06/pennystats-chart-of-day-61412.html&quot;&gt;varying auction prices&lt;/a&gt;&amp;nbsp;on gift cards, Plastic Jungle offers varying redemption rates. They range from nearly 97% to about 84% of retail price.&lt;br /&gt;
&lt;br /&gt;
An important side note is that the minimum gift card size they accept is $25. This limits the auctions you can target, but the majority of the auctions are $25 and up.&lt;br /&gt;
&lt;br /&gt;
&lt;div class=&quot;separator&quot; style=&quot;clear: both; text-align: center;&quot;&gt;
&lt;a href=&quot;https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEhUyHV_iJq46a_KRVcKyFx-BUPSsATo3S8UGIhEbYm0_yDjnc4i38dBzfIXZ-LZ3fibOfvqMjAazxOdHCnZ2W3IuVT2-oMS906Y1LEHUbzeaOW255zHeGciGncsIf1rTO8mSUWJVJLGRJK7/s1600/COTD-061512.jpg&quot; imageanchor=&quot;1&quot; style=&quot;margin-left: 1em; margin-right: 1em;&quot;&gt;&lt;img border=&quot;0&quot; src=&quot;https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEhUyHV_iJq46a_KRVcKyFx-BUPSsATo3S8UGIhEbYm0_yDjnc4i38dBzfIXZ-LZ3fibOfvqMjAazxOdHCnZ2W3IuVT2-oMS906Y1LEHUbzeaOW255zHeGciGncsIf1rTO8mSUWJVJLGRJK7/s1600/COTD-061512.jpg&quot; /&gt;&lt;/a&gt;&lt;/div&gt;
&lt;br /&gt;&lt;/div&gt;</content><link rel='replies' type='application/atom+xml' href='http://pennystats.blogspot.com/feeds/8992110558937368482/comments/default' title='Post Comments'/><link rel='replies' type='text/html' href='http://pennystats.blogspot.com/2012/06/pennystats-chart-of-day-61512.html#comment-form' title='2 Comments'/><link rel='edit' type='application/atom+xml' href='http://www.blogger.com/feeds/8078258480436189776/posts/default/8992110558937368482'/><link rel='self' type='application/atom+xml' href='http://www.blogger.com/feeds/8078258480436189776/posts/default/8992110558937368482'/><link rel='alternate' type='text/html' href='http://pennystats.blogspot.com/2012/06/pennystats-chart-of-day-61512.html' title='Pennystats Chart of the Day - 6/15/12'/><author><name>Unknown</name><email>noreply@blogger.com</email><gd:image rel='http://schemas.google.com/g/2005#thumbnail' width='16' height='16' src='https://img1.blogblog.com/img/b16-rounded.gif'/></author><media:thumbnail xmlns:media="http://search.yahoo.com/mrss/" url="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEhUyHV_iJq46a_KRVcKyFx-BUPSsATo3S8UGIhEbYm0_yDjnc4i38dBzfIXZ-LZ3fibOfvqMjAazxOdHCnZ2W3IuVT2-oMS906Y1LEHUbzeaOW255zHeGciGncsIf1rTO8mSUWJVJLGRJK7/s72-c/COTD-061512.jpg" height="72" width="72"/><thr:total>2</thr:total></entry><entry><id>tag:blogger.com,1999:blog-8078258480436189776.post-4173968571407096457</id><published>2012-06-14T19:46:00.000-07:00</published><updated>2012-06-14T19:49:27.024-07:00</updated><category scheme="http://www.blogger.com/atom/ns#" term="chart"/><category scheme="http://www.blogger.com/atom/ns#" term="chart of the day"/><category scheme="http://www.blogger.com/atom/ns#" term="gift card"/><category scheme="http://www.blogger.com/atom/ns#" term="quibids"/><title type='text'>Pennystats Chart of the Day - 6/14/12</title><content type='html'>&lt;div dir=&quot;ltr&quot; style=&quot;text-align: left;&quot; trbidi=&quot;on&quot;&gt;
&lt;b&gt;All equal value gift cards shall not be treated as such!&lt;/b&gt;&lt;br /&gt;
&lt;br /&gt;
Looking at $25 gift cards (my favorite range since they are the majority of the data), not all gift cards sell for the same price. In fact, some of them are down right neglected. The majority of the bass pro shop giftcards sell, on average, for less than 40 total bids. Compare that to the Walmart gift cards who average nearly 80 every day of the week. By far, the best value for gift cards are the Sunoco gas cards on the weekend.&lt;br /&gt;
&lt;br /&gt;
Surprisingly, it appeared that the best time to attempt to win these gift cards is on the weekend. Since there are an increase in auctions on the weekend, more of these cards are listed. One theory suggests that competitive bidders are focused in other categories during the weekend while $25 gift cards are neglected. I saw a similar trend while looking at&amp;nbsp;&lt;a href=&quot;http://pennystats.blogspot.com/2012/06/pennystats-chart-of-day-61212.html&quot;&gt;$10 gift cards&lt;/a&gt;.&lt;br /&gt;
&lt;br /&gt;
&lt;div class=&quot;separator&quot; style=&quot;clear: both; text-align: center;&quot;&gt;
&lt;a href=&quot;https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEigiclBwMl_PXw3QMJNK00EWmpe7dxTOWTEUpbKsSzy_fEVRHezeCvOiwRiAgYbTTyQhtI0a8Zo3mCMYvAyRg7RzthSCCu-gg2ab5YFwjwifCUjIk3r5-F27tNoziMIK06U2B2bwqiJ77Z0/s1600/COTD-061412.jpg&quot; imageanchor=&quot;1&quot; style=&quot;margin-left: 1em; margin-right: 1em;&quot;&gt;&lt;img border=&quot;0&quot; src=&quot;https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEigiclBwMl_PXw3QMJNK00EWmpe7dxTOWTEUpbKsSzy_fEVRHezeCvOiwRiAgYbTTyQhtI0a8Zo3mCMYvAyRg7RzthSCCu-gg2ab5YFwjwifCUjIk3r5-F27tNoziMIK06U2B2bwqiJ77Z0/s1600/COTD-061412.jpg&quot; /&gt;&lt;/a&gt;&lt;/div&gt;
&lt;br /&gt;&lt;/div&gt;</content><link rel='replies' type='application/atom+xml' href='http://pennystats.blogspot.com/feeds/4173968571407096457/comments/default' title='Post Comments'/><link rel='replies' type='text/html' href='http://pennystats.blogspot.com/2012/06/pennystats-chart-of-day-61412.html#comment-form' title='0 Comments'/><link rel='edit' type='application/atom+xml' href='http://www.blogger.com/feeds/8078258480436189776/posts/default/4173968571407096457'/><link rel='self' type='application/atom+xml' href='http://www.blogger.com/feeds/8078258480436189776/posts/default/4173968571407096457'/><link rel='alternate' type='text/html' href='http://pennystats.blogspot.com/2012/06/pennystats-chart-of-day-61412.html' title='Pennystats Chart of the Day - 6/14/12'/><author><name>Unknown</name><email>noreply@blogger.com</email><gd:image rel='http://schemas.google.com/g/2005#thumbnail' width='16' height='16' src='https://img1.blogblog.com/img/b16-rounded.gif'/></author><media:thumbnail xmlns:media="http://search.yahoo.com/mrss/" url="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEigiclBwMl_PXw3QMJNK00EWmpe7dxTOWTEUpbKsSzy_fEVRHezeCvOiwRiAgYbTTyQhtI0a8Zo3mCMYvAyRg7RzthSCCu-gg2ab5YFwjwifCUjIk3r5-F27tNoziMIK06U2B2bwqiJ77Z0/s72-c/COTD-061412.jpg" height="72" width="72"/><thr:total>0</thr:total></entry><entry><id>tag:blogger.com,1999:blog-8078258480436189776.post-2756096539698151084</id><published>2012-06-14T10:53:00.002-07:00</published><updated>2012-06-14T10:53:54.174-07:00</updated><category scheme="http://www.blogger.com/atom/ns#" term="hosting"/><category scheme="http://www.blogger.com/atom/ns#" term="scraping"/><category scheme="http://www.blogger.com/atom/ns#" term="server"/><category scheme="http://www.blogger.com/atom/ns#" term="xlhost"/><title type='text'>Protip while using XLHost</title><content type='html'>&lt;div dir=&quot;ltr&quot; style=&quot;text-align: left;&quot; trbidi=&quot;on&quot;&gt;
Here&#39;s a little tip for anyone who decides to use XLHost for dedicated server hosting....&lt;br /&gt;
&lt;div&gt;
&lt;br /&gt;&lt;/div&gt;
&lt;div&gt;
&lt;b&gt;TURN OFF WINDOWS UPDATE!&lt;/b&gt;&lt;/div&gt;
&lt;div&gt;
&lt;br /&gt;&lt;/div&gt;
&lt;div&gt;
If you don&#39;t, Windows will restart and it will screw up your data collection...&lt;/div&gt;
&lt;div&gt;
&lt;br /&gt;&lt;/div&gt;
&lt;div&gt;
Like it just did for me....&lt;/div&gt;
&lt;/div&gt;</content><link rel='replies' type='application/atom+xml' href='http://pennystats.blogspot.com/feeds/2756096539698151084/comments/default' title='Post Comments'/><link rel='replies' type='text/html' href='http://pennystats.blogspot.com/2012/06/protip-while-using-xlhost.html#comment-form' title='0 Comments'/><link rel='edit' type='application/atom+xml' href='http://www.blogger.com/feeds/8078258480436189776/posts/default/2756096539698151084'/><link rel='self' type='application/atom+xml' href='http://www.blogger.com/feeds/8078258480436189776/posts/default/2756096539698151084'/><link rel='alternate' type='text/html' href='http://pennystats.blogspot.com/2012/06/protip-while-using-xlhost.html' title='Protip while using XLHost'/><author><name>Unknown</name><email>noreply@blogger.com</email><gd:image rel='http://schemas.google.com/g/2005#thumbnail' width='16' height='16' src='https://img1.blogblog.com/img/b16-rounded.gif'/></author><thr:total>0</thr:total></entry><entry><id>tag:blogger.com,1999:blog-8078258480436189776.post-1701532215279850997</id><published>2012-06-13T09:59:00.001-07:00</published><updated>2012-06-13T09:59:43.907-07:00</updated><category scheme="http://www.blogger.com/atom/ns#" term="auction"/><category scheme="http://www.blogger.com/atom/ns#" term="gift card"/><category scheme="http://www.blogger.com/atom/ns#" term="quibids"/><category scheme="http://www.blogger.com/atom/ns#" term="statistics"/><category scheme="http://www.blogger.com/atom/ns#" term="strategy"/><category scheme="http://www.blogger.com/atom/ns#" term="tips"/><title type='text'>More data for analysis and insights</title><content type='html'>&lt;div dir=&quot;ltr&quot; style=&quot;text-align: left;&quot; trbidi=&quot;on&quot;&gt;
This week I am collecting data from all the Electronics and Voucher auctions. From a quick glance of the data, it appears that auctions behave differently than gift cards. This is an interesting and important indicator. &lt;b&gt;It proves that in order to win auctions for a low cost, bidders should understand the types of auctions they are dealing with.&amp;nbsp;&lt;/b&gt;&lt;br /&gt;
&lt;br /&gt;
Instead of blindly bidding on an item based on vague &quot;averages&quot; that do not consider time and day, bidders need to consider the charts that have been posted to know if they truly got a bargain. &lt;b&gt;Most importantly, it is clear that winning low cost auctions requires discipline and calculating risk before you place bids.&amp;nbsp;&lt;/b&gt;&lt;br /&gt;
&lt;br /&gt;
For instance, if it was Saturday afternoon and you were attempting to win a $15 gas card, your first instinct should be figure out what the average selling price is for that day and time. To get a low cost card, you may way to try your hand at multiple auctions. If you notice that one auction has more action than the other, you should focus your interest on the least active auctions. You should also have an exact number that you are willing to spend in order to get that auction. Should you surpass it, it&#39;s time to regroup and identify another potential auction. &lt;b&gt;Run away bidding and Buy-It-Now auctions are a waste of time and money.&lt;/b&gt;&lt;br /&gt;
&lt;br /&gt;
Methodical bidding is key to making money in these auctions. &lt;b&gt;If you have a good strategy and stick to your bidding system, you will make money.&lt;/b&gt;&lt;/div&gt;</content><link rel='replies' type='application/atom+xml' href='http://pennystats.blogspot.com/feeds/1701532215279850997/comments/default' title='Post Comments'/><link rel='replies' type='text/html' href='http://pennystats.blogspot.com/2012/06/more-data-for-analysis-and-insights.html#comment-form' title='0 Comments'/><link rel='edit' type='application/atom+xml' href='http://www.blogger.com/feeds/8078258480436189776/posts/default/1701532215279850997'/><link rel='self' type='application/atom+xml' href='http://www.blogger.com/feeds/8078258480436189776/posts/default/1701532215279850997'/><link rel='alternate' type='text/html' href='http://pennystats.blogspot.com/2012/06/more-data-for-analysis-and-insights.html' title='More data for analysis and insights'/><author><name>Unknown</name><email>noreply@blogger.com</email><gd:image rel='http://schemas.google.com/g/2005#thumbnail' width='16' height='16' src='https://img1.blogblog.com/img/b16-rounded.gif'/></author><thr:total>0</thr:total></entry><entry><id>tag:blogger.com,1999:blog-8078258480436189776.post-6233830076941831929</id><published>2012-06-13T07:15:00.000-07:00</published><updated>2012-06-13T07:18:00.357-07:00</updated><category scheme="http://www.blogger.com/atom/ns#" term="chart"/><category scheme="http://www.blogger.com/atom/ns#" term="chart of the day"/><category scheme="http://www.blogger.com/atom/ns#" term="gift card"/><category scheme="http://www.blogger.com/atom/ns#" term="quibids"/><category scheme="http://www.blogger.com/atom/ns#" term="strategy"/><category scheme="http://www.blogger.com/atom/ns#" term="tips"/><title type='text'>Pennystats Chart of the Day - 6/13/12</title><content type='html'>&lt;div dir=&quot;ltr&quot; style=&quot;text-align: left;&quot; trbidi=&quot;on&quot;&gt;
Following the theme of the&amp;nbsp;&lt;a href=&quot;http://pennystats.blogspot.com/2012/06/pennystats-chart-of-day-61212.html&quot;&gt;$10 gift card data&lt;/a&gt;&amp;nbsp;from yesterday, I took a look at $15 gift cards selling averages. In general, the trends were similar to $10 gift cards. Averages and variation was significantly higher in the early morning and were minimized in the mid-afternoon.&lt;br /&gt;
&lt;br /&gt;
One interesting trend that occured was the minimization of average bid totals on the weekend. Saturday between 2-10pm were the best times to land a $15 gift card for the lowest average price. The data is very different from what we showed in the&amp;nbsp;&lt;a href=&quot;http://pennystats.blogspot.com/2012/06/pennystats-chart-of-day-61112.html&quot;&gt;$25/$50 gift card range&lt;/a&gt;.&lt;br /&gt;
&lt;br /&gt;
&lt;div class=&quot;separator&quot; style=&quot;clear: both; text-align: center;&quot;&gt;
&lt;a href=&quot;https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEhXzzYshsSHq9zrwQRvq1HEcQq9E0ncBsoqEavmpBm3sIaHvuwxgo_xIUHAembogjUyT5UCjbwDcY6s2JBefwIpaF8SZ6ZgcFtizqTCupiAeiP2KpDzcakqIxcB-HRNUenju3w71rSm4_Lq/s1600/COTD-061312.JPG&quot; imageanchor=&quot;1&quot; style=&quot;margin-left: 1em; margin-right: 1em;&quot;&gt;&lt;img border=&quot;0&quot; src=&quot;https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEhXzzYshsSHq9zrwQRvq1HEcQq9E0ncBsoqEavmpBm3sIaHvuwxgo_xIUHAembogjUyT5UCjbwDcY6s2JBefwIpaF8SZ6ZgcFtizqTCupiAeiP2KpDzcakqIxcB-HRNUenju3w71rSm4_Lq/s1600/COTD-061312.JPG&quot; /&gt;&lt;/a&gt;&lt;/div&gt;
&lt;br /&gt;&lt;/div&gt;</content><link rel='replies' type='application/atom+xml' href='http://pennystats.blogspot.com/feeds/6233830076941831929/comments/default' title='Post Comments'/><link rel='replies' type='text/html' href='http://pennystats.blogspot.com/2012/06/pennystats-chart-of-day-61312.html#comment-form' title='0 Comments'/><link rel='edit' type='application/atom+xml' href='http://www.blogger.com/feeds/8078258480436189776/posts/default/6233830076941831929'/><link rel='self' type='application/atom+xml' href='http://www.blogger.com/feeds/8078258480436189776/posts/default/6233830076941831929'/><link rel='alternate' type='text/html' href='http://pennystats.blogspot.com/2012/06/pennystats-chart-of-day-61312.html' title='Pennystats Chart of the Day - 6/13/12'/><author><name>Unknown</name><email>noreply@blogger.com</email><gd:image rel='http://schemas.google.com/g/2005#thumbnail' width='16' height='16' src='https://img1.blogblog.com/img/b16-rounded.gif'/></author><media:thumbnail xmlns:media="http://search.yahoo.com/mrss/" url="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEhXzzYshsSHq9zrwQRvq1HEcQq9E0ncBsoqEavmpBm3sIaHvuwxgo_xIUHAembogjUyT5UCjbwDcY6s2JBefwIpaF8SZ6ZgcFtizqTCupiAeiP2KpDzcakqIxcB-HRNUenju3w71rSm4_Lq/s72-c/COTD-061312.JPG" height="72" width="72"/><thr:total>0</thr:total></entry><entry><id>tag:blogger.com,1999:blog-8078258480436189776.post-5578100370066249026</id><published>2012-06-12T12:02:00.000-07:00</published><updated>2012-06-12T12:02:09.288-07:00</updated><category scheme="http://www.blogger.com/atom/ns#" term="chart"/><category scheme="http://www.blogger.com/atom/ns#" term="chart of the day"/><category scheme="http://www.blogger.com/atom/ns#" term="statistics"/><category scheme="http://www.blogger.com/atom/ns#" term="strategy"/><category scheme="http://www.blogger.com/atom/ns#" term="tips"/><title type='text'>Pennystats Chart of the Day - 6/12/12</title><content type='html'>&lt;div dir=&quot;ltr&quot; style=&quot;text-align: left;&quot; trbidi=&quot;on&quot;&gt;
Reviewing $10 Gift Card auction data revealed another interesting aspect of Penny Auction psychology. Today&#39;s chart shows the average total bids of each auction based on the day of the week and the end time of the auction. Unlike the chart from&amp;nbsp;&lt;a href=&quot;http://pennystats.blogspot.com/2012/06/pennystats-chart-of-day-61112.html&quot;&gt;yesterday&lt;/a&gt;, the average auction prices increase during off-peak hours.&lt;br /&gt;
&lt;br /&gt;
Stranger still, the lowest, most consistent averages with the least variance occured during peak times between 2-8pm. One theory I have is that during off peak hours, there are fewer auctions listed. Because of this, competition grows on low cost items (Such as $10 Gift Cards).&lt;br /&gt;
&lt;br /&gt;
&lt;div class=&quot;separator&quot; style=&quot;clear: both; text-align: center;&quot;&gt;
&lt;a href=&quot;https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEhqNu5Xph0-_hubpUFxf7dTNMQe2Nf2bB7q1U-z1ax1OvTncNp6yamVLcIBD1PVnWjz_lk6M3l9G70eD8ML5IXu_cCQ4Da_2HK9teSh3ydWF4zcyFeu9aIo4KDPVOFyBlAzUWZ_X4caer79/s1600/COTD-061212.JPG&quot; imageanchor=&quot;1&quot; style=&quot;margin-left: 1em; margin-right: 1em;&quot;&gt;&lt;img border=&quot;0&quot; src=&quot;https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEhqNu5Xph0-_hubpUFxf7dTNMQe2Nf2bB7q1U-z1ax1OvTncNp6yamVLcIBD1PVnWjz_lk6M3l9G70eD8ML5IXu_cCQ4Da_2HK9teSh3ydWF4zcyFeu9aIo4KDPVOFyBlAzUWZ_X4caer79/s1600/COTD-061212.JPG&quot; /&gt;&lt;/a&gt;&lt;/div&gt;
&lt;br /&gt;&lt;/div&gt;</content><link rel='replies' type='application/atom+xml' href='http://pennystats.blogspot.com/feeds/5578100370066249026/comments/default' title='Post Comments'/><link rel='replies' type='text/html' href='http://pennystats.blogspot.com/2012/06/pennystats-chart-of-day-61212.html#comment-form' title='0 Comments'/><link rel='edit' type='application/atom+xml' href='http://www.blogger.com/feeds/8078258480436189776/posts/default/5578100370066249026'/><link rel='self' type='application/atom+xml' href='http://www.blogger.com/feeds/8078258480436189776/posts/default/5578100370066249026'/><link rel='alternate' type='text/html' href='http://pennystats.blogspot.com/2012/06/pennystats-chart-of-day-61212.html' title='Pennystats Chart of the Day - 6/12/12'/><author><name>Unknown</name><email>noreply@blogger.com</email><gd:image rel='http://schemas.google.com/g/2005#thumbnail' width='16' height='16' src='https://img1.blogblog.com/img/b16-rounded.gif'/></author><media:thumbnail xmlns:media="http://search.yahoo.com/mrss/" url="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEhqNu5Xph0-_hubpUFxf7dTNMQe2Nf2bB7q1U-z1ax1OvTncNp6yamVLcIBD1PVnWjz_lk6M3l9G70eD8ML5IXu_cCQ4Da_2HK9teSh3ydWF4zcyFeu9aIo4KDPVOFyBlAzUWZ_X4caer79/s72-c/COTD-061212.JPG" height="72" width="72"/><thr:total>0</thr:total></entry><entry><id>tag:blogger.com,1999:blog-8078258480436189776.post-6897168050369492975</id><published>2012-06-11T10:24:00.000-07:00</published><updated>2012-06-12T12:02:17.860-07:00</updated><category scheme="http://www.blogger.com/atom/ns#" term="chart"/><category scheme="http://www.blogger.com/atom/ns#" term="chart of the day"/><category scheme="http://www.blogger.com/atom/ns#" term="penny auction"/><category scheme="http://www.blogger.com/atom/ns#" term="quibids"/><category scheme="http://www.blogger.com/atom/ns#" term="statistics"/><category scheme="http://www.blogger.com/atom/ns#" term="strategy"/><title type='text'>Pennystats Chart of the Day - 6/11/12</title><content type='html'>&lt;div dir=&quot;ltr&quot; style=&quot;text-align: left;&quot; trbidi=&quot;on&quot;&gt;
After a week of collecting some interesting gift card data, I started poking around to find potential auction value. More specifically, I wanted to know what types of auctions sell cheap (in terms of total bids) and when they happen. Not surprisingly, the best deals on gift cards&amp;nbsp;occurred&amp;nbsp;early in the morning ( between 2am and 10am). The data was fairly consistent on any given day.&lt;br /&gt;
&lt;br /&gt;
So this is the chart of the day -- Percentage of auctions for $25 and $50 gift cards that sold for less than 20 total bids. The average of those sub-20 bid auctions were typically between 3-6 bids with a standard deviation between 3-6.&lt;br /&gt;
&lt;br /&gt;
&lt;div class=&quot;separator&quot; style=&quot;clear: both; text-align: center;&quot;&gt;
&lt;a href=&quot;https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEhMbM4losDfs42WmbIVm3R_xlRDZ0Iu9RRWnmda0aNjyBDRqGH6-VQhf_JEaCI7ywJltZxF38lp_GNIBzsJV9Akk6o7iXKHcbyvvknoMRYyxC7XR9IcIy0kTzNT7MqrC73oiA6ds8FqSOR6/s1600/COTD-061112.JPG&quot; imageanchor=&quot;1&quot; style=&quot;clear: left; float: left; margin-bottom: 1em; margin-right: 1em;&quot;&gt;&lt;img border=&quot;0&quot; src=&quot;https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEhMbM4losDfs42WmbIVm3R_xlRDZ0Iu9RRWnmda0aNjyBDRqGH6-VQhf_JEaCI7ywJltZxF38lp_GNIBzsJV9Akk6o7iXKHcbyvvknoMRYyxC7XR9IcIy0kTzNT7MqrC73oiA6ds8FqSOR6/s1600/COTD-061112.JPG&quot; /&gt;&lt;/a&gt;&lt;/div&gt;
&lt;br /&gt;&lt;/div&gt;</content><link rel='replies' type='application/atom+xml' href='http://pennystats.blogspot.com/feeds/6897168050369492975/comments/default' title='Post Comments'/><link rel='replies' type='text/html' href='http://pennystats.blogspot.com/2012/06/pennystats-chart-of-day-61112.html#comment-form' title='0 Comments'/><link rel='edit' type='application/atom+xml' href='http://www.blogger.com/feeds/8078258480436189776/posts/default/6897168050369492975'/><link rel='self' type='application/atom+xml' href='http://www.blogger.com/feeds/8078258480436189776/posts/default/6897168050369492975'/><link rel='alternate' type='text/html' href='http://pennystats.blogspot.com/2012/06/pennystats-chart-of-day-61112.html' title='Pennystats Chart of the Day - 6/11/12'/><author><name>Unknown</name><email>noreply@blogger.com</email><gd:image rel='http://schemas.google.com/g/2005#thumbnail' width='16' height='16' src='https://img1.blogblog.com/img/b16-rounded.gif'/></author><media:thumbnail xmlns:media="http://search.yahoo.com/mrss/" url="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEhMbM4losDfs42WmbIVm3R_xlRDZ0Iu9RRWnmda0aNjyBDRqGH6-VQhf_JEaCI7ywJltZxF38lp_GNIBzsJV9Akk6o7iXKHcbyvvknoMRYyxC7XR9IcIy0kTzNT7MqrC73oiA6ds8FqSOR6/s72-c/COTD-061112.JPG" height="72" width="72"/><thr:total>0</thr:total></entry><entry><id>tag:blogger.com,1999:blog-8078258480436189776.post-6275015051220292906</id><published>2012-06-06T14:28:00.001-07:00</published><updated>2013-01-07T11:53:22.537-08:00</updated><category scheme="http://www.blogger.com/atom/ns#" term="ajax"/><category scheme="http://www.blogger.com/atom/ns#" term="penny auction"/><category scheme="http://www.blogger.com/atom/ns#" term="python"/><category scheme="http://www.blogger.com/atom/ns#" term="quibids"/><category scheme="http://www.blogger.com/atom/ns#" term="scrape"/><category scheme="http://www.blogger.com/atom/ns#" term="script"/><category scheme="http://www.blogger.com/atom/ns#" term="selenium"/><title type='text'>AuctionScrape for QuiBids launch!</title><content type='html'>&lt;div dir=&quot;ltr&quot; style=&quot;text-align: left;&quot; trbidi=&quot;on&quot;&gt;
Well the day has finally come. This is the initial release of AuctionScrape (for Windows) for mining auction data on QuiBids.&lt;br /&gt;
&lt;br /&gt;
&lt;b&gt;&lt;u&gt;Requirements:&lt;/u&gt;&lt;/b&gt;&lt;br /&gt;
&lt;a href=&quot;http://selenium.googlecode.com/files/selenium-server-standalone-2.22.0.jar&quot;&gt;Selenium Server&lt;/a&gt;&lt;br /&gt;
&lt;a href=&quot;http://www.oracle.com/technetwork/java/javase/downloads/index.html&quot;&gt;Java Developer Kit&lt;/a&gt;&lt;br /&gt;
&lt;a href=&quot;http://www.python.org/getit/releases/2.7/&quot;&gt;Python 2.7&lt;/a&gt;&lt;br /&gt;
-Python Dependencies Selenium and &lt;a href=&quot;http://www.lfd.uci.edu/~gohlke/pythonlibs/#base&quot;&gt;Base Distribution&lt;/a&gt;&lt;br /&gt;
&lt;a href=&quot;http://www.xlhost.com/hosting/dedicated-servers/&quot;&gt;A fast server with lots of RAM&lt;/a&gt;&amp;nbsp;&lt;b&gt;(Tested on 64 bit Windows 2008 Standard Edition configuration. Script does not currently work with Windows XP. Untested on Windows 2003 Server.)&lt;/b&gt;&lt;br /&gt;
&lt;a href=&quot;http://www.mozilla.org/en-US/firefox/new/&quot;&gt;Firefox (on that server)&lt;/a&gt;&lt;br /&gt;
&lt;br /&gt;
&lt;b&gt;&lt;u&gt;How to setup AuctionScrape&lt;/u&gt;&lt;/b&gt;&lt;br /&gt;
1. Adjust the data/time on your computer clock to match the real time. AuctionScrape sets up auctions to launch based on the clock in Windows. If it is incorrect, you will get bad data.&lt;br /&gt;
&lt;br /&gt;
2. Download/purchase/setup all of the requirements above.&lt;br /&gt;
&lt;br /&gt;
3. When completed, run the &#39;setup.py&#39; script in the attached package.&lt;br /&gt;
&lt;br /&gt;
4. Move all of the files in the downloaded ZIP to the AuctionScrape directory.&lt;br /&gt;
&lt;br /&gt;
5. Install the Python dependencies. To get Selenium and the required package urllib (included in the base distribution), you can launch a new command window and type:&lt;br /&gt;
&lt;blockquote class=&quot;tr_bq&quot;&gt;
pip install -U selenium&lt;/blockquote&gt;
&lt;blockquote class=&quot;tr_bq&quot;&gt;
pip install -U urllib3&amp;nbsp;&lt;/blockquote&gt;
6. Decide what section of the website you want to scrape. It can be specific like $10 gift cards, or it can be general, like all active auctions. By default, the scraper is setup to scrape all gift card auctions. To change this, open auctiongrabber.py and look for this text (there are 2 locations that you will need to change):&lt;br /&gt;
&lt;br /&gt;
&lt;blockquote class=&quot;tr_bq&quot;&gt;
&lt;blockquote class=&quot;tr_bq&quot;&gt;
#### CHANGE THIS LINE TO ADJUST SECTION YOU WANT TO SCRAPE&lt;/blockquote&gt;
&lt;blockquote class=&quot;tr_bq&quot;&gt;
sel.open(&#39;/categories/Gift-Cards/&#39;)&lt;/blockquote&gt;
&lt;/blockquote&gt;
&lt;blockquote class=&quot;tr_bq&quot;&gt;
&amp;nbsp;#### CHANGE THIS LINE TO ADJUST SECTION YOU WANT TO SCRAPE&lt;/blockquote&gt;
&lt;blockquote class=&quot;tr_bq&quot;&gt;
&amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; url=&#39;http://www.quibids.com/categories/Gift-Cards/&#39; + str(z)+ &#39;&#39;&lt;/blockquote&gt;
&lt;blockquote class=&quot;tr_bq&quot;&gt;
&amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; selurl = &#39;/categories/Gift-Cards/&#39; + str(z)+ &#39;&#39;&lt;/blockquote&gt;
&lt;br /&gt;
In both cases, you will need to change (and match) the section you want to scrape. For instance, if I wanted to scrape $10 gift cards, I would go to quibids.com, select live auctions and click on &quot;$10 Gift Cards&quot;. Once loaded, the URL bar would look like this:&lt;br /&gt;
&lt;br /&gt;
&lt;blockquote class=&quot;tr_bq&quot;&gt;
http://www.quibids.com/categories/Gift-Cards/10-Gift-Card/&lt;/blockquote&gt;
&lt;br /&gt;
To scrape this section, I would adjust the code in auctiongrabber.py to the following:&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;blockquote class=&quot;tr_bq&quot;&gt;
&lt;blockquote class=&quot;tr_bq&quot;&gt;
&lt;blockquote class=&quot;tr_bq&quot;&gt;
#### CHANGE THIS LINE TO ADJUST SECTION YOU WANT TO SCRAPE&lt;/blockquote&gt;
&lt;blockquote class=&quot;tr_bq&quot;&gt;
sel.open(&#39;
/categories/Gift-Cards/10-Gift-Card/&#39;)&lt;/blockquote&gt;
&lt;/blockquote&gt;
&lt;blockquote class=&quot;tr_bq&quot;&gt;
&amp;nbsp;#### CHANGE THIS LINE TO ADJUST SECTION YOU WANT TO SCRAPE&lt;/blockquote&gt;
&lt;blockquote class=&quot;tr_bq&quot;&gt;
&amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; url=&#39;http://www.quibids.com/categories
/categories/Gift-Cards/10-Gift-Card/&#39; + str(z)+ &#39;&#39;&lt;/blockquote&gt;
&lt;blockquote class=&quot;tr_bq&quot;&gt;
&amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; selurl = &#39;
/categories/Gift-Cards/10-Gift-Card/&#39; + str(z)+ &#39;&#39;&lt;/blockquote&gt;
&lt;/blockquote&gt;
&lt;br /&gt;
Be careful not to add any spaces as it will probably crash auctiongrabber.&lt;br /&gt;
&lt;br /&gt;
&lt;b&gt;&lt;u&gt;How to run AuctionScrape:&lt;/u&gt;&lt;/b&gt;&lt;br /&gt;
1. Start selenium server. To do this, you will need to open a command line window and type in the following:&lt;br /&gt;
&lt;blockquote class=&quot;tr_bq&quot;&gt;
java -jar selenium-server-standalone-2.22.0.jar -singleWindow&lt;/blockquote&gt;
If it doesn&#39;t work, check if you are in the correct directory with selenium in it and that the name of the application is correct.&lt;br /&gt;
&lt;br /&gt;
2. Launch auctiongrabber. You can do this by command line or in the Python Shell included with Python 2.7. It will setup all the auctions in the task manager.&lt;br /&gt;
&lt;br /&gt;
&lt;b&gt;&lt;u&gt;How to stop AuctionScrape:&lt;/u&gt;&lt;/b&gt;&lt;br /&gt;
1. Close the Selenium Server command window.&lt;br /&gt;
&lt;br /&gt;
2. Run auctionstop.py&lt;br /&gt;
&lt;br /&gt;
3. Close all Firefox and Python windows.&lt;br /&gt;
&lt;br /&gt;
&lt;b&gt;&lt;u&gt;Final notes and comments:&lt;/u&gt;&lt;/b&gt;&lt;br /&gt;
1. Be aware that AuctionScrape cleans itself and backs up files every day at 11:55pm. The files are moved into the &quot;backup&quot; directory. During the daily scraping, the current list of auctions scraped is in &quot;AuctionScrape/Total-Auction-Data.csv&quot;. &lt;b&gt;DO NOT CHANGE THE FILE OR OPEN THE FILE WHEN THERE ARE AUCTIONS RUNNING. YOU WILL LOSE DATA.&lt;/b&gt;&lt;br /&gt;
&lt;b&gt;&lt;br /&gt;&lt;/b&gt;
2. Be aware that when AuctionScrape cleans up the scheduled auctions, it &lt;b&gt;DELETES ALL SCHEDULED TASKS.&lt;/b&gt;&amp;nbsp;That means if you have other tasks scheduled to run everyday, they will be &lt;b&gt;PERMANENTLY REMOVED.&lt;/b&gt;&amp;nbsp;The reason for this is a glitch in the schtasks command with Windows. I didn&#39;t want it to work this way, but it was the only way I could get it to do what I wanted.&lt;br /&gt;
&lt;br /&gt;
3. &lt;b&gt;DO NOT USE WITH WINDOWS XP.&lt;/b&gt;&amp;nbsp;It is a known issue that the task scheduler cannot be automated with Windows XP. Unless you like submitting a password for every scheduled auction, do not try to run this on Windows XP.&lt;br /&gt;
&lt;br /&gt;
4. &lt;b&gt;DO NOT SET WORKING DIRECTORY WITH SPACES IN IT. &lt;/b&gt;This is another known issue. It will be fixed in a future update. For now, no spaces.&lt;br /&gt;
&lt;br /&gt;
3. Auctions that failed to get setup in the task manager are dumped into &quot;AuctionScrape\FailedAuctionList.csv&quot;. If you want to monitor these auctions, you will need to setup the launch time in the task manager by hand.&lt;br /&gt;
&lt;br /&gt;
&lt;b&gt;&lt;u&gt;DOWNLOAD and DONATE&lt;/u&gt;&lt;/b&gt;&lt;br /&gt;
Please note that I spend nearly 150 hours developing this script so that everyone would have equal access to record and analyze data as they please. I didn&#39;t put any stipulations on how much/what you can record (like other websites). Use the software as you please. Modify it as you please.&lt;br /&gt;
&lt;br /&gt;
If you appreciate the work that I did and want me to continue developing the software and analyzing the data, please donate. I quit my job to go back to school so I don&#39;t have any income coming in for the next year. Any amount will help. Thank you.&lt;br /&gt;
&lt;br /&gt;
&lt;form action=&quot;https://www.paypal.com/cgi-bin/webscr&quot; method=&quot;post&quot;&gt;
&lt;input name=&quot;cmd&quot; type=&quot;hidden&quot; value=&quot;_s-xclick&quot; /&gt;
&lt;input name=&quot;hosted_button_id&quot; type=&quot;hidden&quot; value=&quot;Y7FU9QMVRLQ5C&quot; /&gt;
&lt;input alt=&quot;PayPal - The safer, easier way to pay online!&quot; border=&quot;0&quot; name=&quot;submit&quot; src=&quot;https://www.paypalobjects.com/en_US/i/btn/btn_donateCC_LG.gif&quot; type=&quot;image&quot; /&gt;
&lt;img alt=&quot;&quot; border=&quot;0&quot; height=&quot;1&quot; src=&quot;https://www.paypalobjects.com/en_US/i/scr/pixel.gif&quot; width=&quot;1&quot; /&gt;&lt;b&gt;&lt;u&gt;&lt;a href=&quot;http://www.sendspace.com/file/vflki4&quot;&gt;DOWNLOAD AUCTIONSCRAPE V1&lt;/a&gt;&lt;/u&gt;&lt;/b&gt;&lt;/form&gt;
&lt;/div&gt;
</content><link rel='replies' type='application/atom+xml' href='http://pennystats.blogspot.com/feeds/6275015051220292906/comments/default' title='Post Comments'/><link rel='replies' type='text/html' href='http://pennystats.blogspot.com/2012/06/auctionscrape-for-quibids-launch.html#comment-form' title='4 Comments'/><link rel='edit' type='application/atom+xml' href='http://www.blogger.com/feeds/8078258480436189776/posts/default/6275015051220292906'/><link rel='self' type='application/atom+xml' href='http://www.blogger.com/feeds/8078258480436189776/posts/default/6275015051220292906'/><link rel='alternate' type='text/html' href='http://pennystats.blogspot.com/2012/06/auctionscrape-for-quibids-launch.html' title='AuctionScrape for QuiBids launch!'/><author><name>Unknown</name><email>noreply@blogger.com</email><gd:image rel='http://schemas.google.com/g/2005#thumbnail' width='16' height='16' src='https://img1.blogblog.com/img/b16-rounded.gif'/></author><thr:total>4</thr:total></entry><entry><id>tag:blogger.com,1999:blog-8078258480436189776.post-5591068333273818796</id><published>2012-06-06T10:35:00.000-07:00</published><updated>2012-06-06T10:35:09.636-07:00</updated><category scheme="http://www.blogger.com/atom/ns#" term="auction"/><category scheme="http://www.blogger.com/atom/ns#" term="excel"/><category scheme="http://www.blogger.com/atom/ns#" term="penny auction"/><category scheme="http://www.blogger.com/atom/ns#" term="python"/><category scheme="http://www.blogger.com/atom/ns#" term="quibids"/><category scheme="http://www.blogger.com/atom/ns#" term="scrape"/><title type='text'>Some more auction data</title><content type='html'>&lt;div dir=&quot;ltr&quot; style=&quot;text-align: left;&quot; trbidi=&quot;on&quot;&gt;
I realized that the data I provided wasn&#39;t actually a complete day.&lt;br /&gt;
&lt;br /&gt;
Here is all recorded auction data for all gift cards for 6/5/12.&lt;br /&gt;
&lt;br /&gt;
&lt;a href=&quot;http://www.2shared.com/file/Iw3y2byD/Total-Auction-Data-060512.html&quot;&gt;Download 6/5/12 Auction Data&lt;/a&gt;&lt;br /&gt;
&lt;br /&gt;
The actual script will be uploaded shortly.&lt;/div&gt;</content><link rel='replies' type='application/atom+xml' href='http://pennystats.blogspot.com/feeds/5591068333273818796/comments/default' title='Post Comments'/><link rel='replies' type='text/html' href='http://pennystats.blogspot.com/2012/06/some-more-auction-data.html#comment-form' title='0 Comments'/><link rel='edit' type='application/atom+xml' href='http://www.blogger.com/feeds/8078258480436189776/posts/default/5591068333273818796'/><link rel='self' type='application/atom+xml' href='http://www.blogger.com/feeds/8078258480436189776/posts/default/5591068333273818796'/><link rel='alternate' type='text/html' href='http://pennystats.blogspot.com/2012/06/some-more-auction-data.html' title='Some more auction data'/><author><name>Unknown</name><email>noreply@blogger.com</email><gd:image rel='http://schemas.google.com/g/2005#thumbnail' width='16' height='16' src='https://img1.blogblog.com/img/b16-rounded.gif'/></author><thr:total>0</thr:total></entry><entry><id>tag:blogger.com,1999:blog-8078258480436189776.post-6219450700388958286</id><published>2012-06-03T18:11:00.000-07:00</published><updated>2012-06-03T18:11:00.189-07:00</updated><category scheme="http://www.blogger.com/atom/ns#" term="auction"/><category scheme="http://www.blogger.com/atom/ns#" term="output"/><category scheme="http://www.blogger.com/atom/ns#" term="penny auction"/><category scheme="http://www.blogger.com/atom/ns#" term="python"/><category scheme="http://www.blogger.com/atom/ns#" term="quibids"/><category scheme="http://www.blogger.com/atom/ns#" term="scrape"/><title type='text'>Auction Scraper is up and running!</title><content type='html'>&lt;div dir=&quot;ltr&quot; style=&quot;text-align: left;&quot; trbidi=&quot;on&quot;&gt;
&lt;b&gt;Today was a milestone.&lt;/b&gt;&lt;br /&gt;
&lt;br /&gt;
After working out server host problems (I leased a quad core Xeon at XLHost.com) and several programming problems, I have &lt;u&gt;FINALLY&lt;/u&gt;&amp;nbsp;gotten the software up and running.&lt;br /&gt;
&lt;br /&gt;
To test how robust my software is, I tried collecting all 4000 active auctions at once. After about an hour, the server began to seize up with 95 Python windows and 95 Firefox windows. The data recorded from the auctions wasn&#39;t good and lacked various pieces of information. In general, it was unreliable.&lt;br /&gt;
&lt;br /&gt;
The next test I ran was for gift cards only. There are still a significant amount of auctions (nearly 2000 listed), but it seems to be running comfortably at about 20 Python and Firefox windows at a time. Nearly all of the auction data is complete.&lt;br /&gt;
&lt;br /&gt;
Not surprisingly, the software uses a lot of bandwidth. I was shocked to see it generate over 20 Giga&lt;b&gt;BYTES&lt;/b&gt; of transfer in only a matter of hours. I may need to purchase an additional bandwidth&amp;nbsp;allotment!&lt;br /&gt;
&lt;br /&gt;
You can download a preview output of data you can expect with the auction software&amp;nbsp;&lt;a href=&quot;http://www.freefilehosting.net/total-auction-data-release&quot;&gt;here&lt;/a&gt;.&lt;br /&gt;
(Sorry for the crappy upload host. It was the only one I could use where I didn&#39;t have to signup for anything.)&lt;/div&gt;</content><link rel='replies' type='application/atom+xml' href='http://pennystats.blogspot.com/feeds/6219450700388958286/comments/default' title='Post Comments'/><link rel='replies' type='text/html' href='http://pennystats.blogspot.com/2012/06/auction-scraper-is-up-and-running.html#comment-form' title='0 Comments'/><link rel='edit' type='application/atom+xml' href='http://www.blogger.com/feeds/8078258480436189776/posts/default/6219450700388958286'/><link rel='self' type='application/atom+xml' href='http://www.blogger.com/feeds/8078258480436189776/posts/default/6219450700388958286'/><link rel='alternate' type='text/html' href='http://pennystats.blogspot.com/2012/06/auction-scraper-is-up-and-running.html' title='Auction Scraper is up and running!'/><author><name>Unknown</name><email>noreply@blogger.com</email><gd:image rel='http://schemas.google.com/g/2005#thumbnail' width='16' height='16' src='https://img1.blogblog.com/img/b16-rounded.gif'/></author><thr:total>0</thr:total></entry><entry><id>tag:blogger.com,1999:blog-8078258480436189776.post-4331318138902869146</id><published>2012-05-30T13:19:00.001-07:00</published><updated>2012-05-31T12:46:29.406-07:00</updated><category scheme="http://www.blogger.com/atom/ns#" term="auction"/><category scheme="http://www.blogger.com/atom/ns#" term="crawl"/><category scheme="http://www.blogger.com/atom/ns#" term="penny auction"/><category scheme="http://www.blogger.com/atom/ns#" term="python"/><category scheme="http://www.blogger.com/atom/ns#" term="quibids"/><category scheme="http://www.blogger.com/atom/ns#" term="scrape"/><category scheme="http://www.blogger.com/atom/ns#" term="statistics"/><title type='text'>Script finished, crawling imminent!</title><content type='html'>&lt;div dir=&quot;ltr&quot; style=&quot;text-align: left;&quot; trbidi=&quot;on&quot;&gt;
With the scraping script complete, I have decided to begin the data scraping process. Due to the nature of how the program scrapes auctions, I need some pretty beefy hardware and connection speed to make it happen.&lt;br /&gt;
&lt;br /&gt;
After a little browsing, I settled on a Windows server from iWeb.com. For $135 a month I get:&lt;br /&gt;
-10,000GB of Bandwidth per month&lt;br /&gt;
-Core i3 3.0Ghz HT processor&lt;br /&gt;
-6GB RAM&lt;br /&gt;
-320GB Hard Drive&lt;br /&gt;
-Windows Server 2008 Standard Edition&lt;br /&gt;
&lt;br /&gt;
The only thing I have left to do for a script release is write a setup file. Hopefully that will be completed by this weekend.&lt;br /&gt;
&lt;br /&gt;
For those who are curious how it works, I am using Selenium RC to parse the individual auctions and then read &amp;nbsp;specific information (Bidders, Bid Type, and Price) during the course of the auction. I used this instead of BeautifulSoup and other modules because it was the only one that could recover the information after the server side AJAX requests.&amp;nbsp;Once it is completed, it sorts and organizes the auction information into a cleaned up auction and bidder file. The last step adds the final information to an overall summary file. All the files are CSV so they can be easily exported to your favorite data analysis package (Excel, SAS, etc.)&lt;br /&gt;
&lt;br /&gt;
Warning to those who are programmers that look at the code -- please note that I am not a trained programmer. Some of the loops I wrote could easily be condensed, but I don&#39;t have the understanding,&amp;nbsp;motivation, or interest in doing so since I am on a tightening deadline.&lt;br /&gt;
&lt;br /&gt;
&lt;b&gt;&lt;u&gt;UPDATE:&lt;/u&gt;&lt;/b&gt;&lt;br /&gt;
&lt;i&gt;iWeb may not have been the best choice of web server. They are located in Quebec so they reach the Canadian version of Quibids.com. I am trying to develop a work around, but Selenium does not want to play nicely with authentication for a proxy. More to come...&lt;/i&gt;&lt;/div&gt;</content><link rel='replies' type='application/atom+xml' href='http://pennystats.blogspot.com/feeds/4331318138902869146/comments/default' title='Post Comments'/><link rel='replies' type='text/html' href='http://pennystats.blogspot.com/2012/05/script-finished-crawling-imminent.html#comment-form' title='0 Comments'/><link rel='edit' type='application/atom+xml' href='http://www.blogger.com/feeds/8078258480436189776/posts/default/4331318138902869146'/><link rel='self' type='application/atom+xml' href='http://www.blogger.com/feeds/8078258480436189776/posts/default/4331318138902869146'/><link rel='alternate' type='text/html' href='http://pennystats.blogspot.com/2012/05/script-finished-crawling-imminent.html' title='Script finished, crawling imminent!'/><author><name>Unknown</name><email>noreply@blogger.com</email><gd:image rel='http://schemas.google.com/g/2005#thumbnail' width='16' height='16' src='https://img1.blogblog.com/img/b16-rounded.gif'/></author><thr:total>0</thr:total></entry><entry><id>tag:blogger.com,1999:blog-8078258480436189776.post-8520972300930265982</id><published>2012-05-16T15:49:00.001-07:00</published><updated>2012-05-17T06:00:27.931-07:00</updated><category scheme="http://www.blogger.com/atom/ns#" term="beta"/><category scheme="http://www.blogger.com/atom/ns#" term="python"/><category scheme="http://www.blogger.com/atom/ns#" term="scraper"/><category scheme="http://www.blogger.com/atom/ns#" term="testing"/><title type='text'>Beta Testers</title><content type='html'>&lt;div dir=&quot;ltr&quot; style=&quot;text-align: left;&quot; trbidi=&quot;on&quot;&gt;
I am looking for a few people to beta test/improve my script. Ideally, I would like to work with people who have previous python experience, are willing to help document bugs and have the capability to cleanup the code. If you have all of those credentials (or even if you don&#39;t but are still interested), please reply to this topic with a way for me to contact you. I would like to start testing this within the next week.&lt;/div&gt;</content><link rel='replies' type='application/atom+xml' href='http://pennystats.blogspot.com/feeds/8520972300930265982/comments/default' title='Post Comments'/><link rel='replies' type='text/html' href='http://pennystats.blogspot.com/2012/05/beta-testers.html#comment-form' title='4 Comments'/><link rel='edit' type='application/atom+xml' href='http://www.blogger.com/feeds/8078258480436189776/posts/default/8520972300930265982'/><link rel='self' type='application/atom+xml' href='http://www.blogger.com/feeds/8078258480436189776/posts/default/8520972300930265982'/><link rel='alternate' type='text/html' href='http://pennystats.blogspot.com/2012/05/beta-testers.html' title='Beta Testers'/><author><name>Unknown</name><email>noreply@blogger.com</email><gd:image rel='http://schemas.google.com/g/2005#thumbnail' width='16' height='16' src='https://img1.blogblog.com/img/b16-rounded.gif'/></author><thr:total>4</thr:total></entry><entry><id>tag:blogger.com,1999:blog-8078258480436189776.post-2061547338669619759</id><published>2012-05-14T12:07:00.001-07:00</published><updated>2012-05-14T12:07:26.810-07:00</updated><category scheme="http://www.blogger.com/atom/ns#" term="ajax"/><category scheme="http://www.blogger.com/atom/ns#" term="data"/><category scheme="http://www.blogger.com/atom/ns#" term="excel"/><category scheme="http://www.blogger.com/atom/ns#" term="output"/><category scheme="http://www.blogger.com/atom/ns#" term="penny auction"/><category scheme="http://www.blogger.com/atom/ns#" term="python"/><category scheme="http://www.blogger.com/atom/ns#" term="scraping"/><category scheme="http://www.blogger.com/atom/ns#" term="statistics"/><title type='text'>Auction grabber nearing completion</title><content type='html'>&lt;div dir=&quot;ltr&quot; style=&quot;text-align: left;&quot; trbidi=&quot;on&quot;&gt;
The auction grabbing script I am using is nearly complete. It grabs each auction that is currently available on the penny auction website and dumps the auction number, auction type, and end time.&lt;br /&gt;
&lt;br /&gt;
From this information, I want to setup a scheduled script launcher for the last 5 minutes of the auction (since typically no one bids until around that time). That would be easy to do on Linux, but it may take a little more effort on Windows.&lt;br /&gt;
&lt;br /&gt;
Here is the typical output that the script generates:&lt;br /&gt;
&lt;br /&gt;
&lt;a href=&quot;https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEhJNuymIzG0ShxLMXNi4dPSh7Qoqk8IRMfQ_n3M1FwP95wousnmTof5vvKkP8OpO5R1EjIGejFIw7430m62yRGr9t0-P9JZRihuq2xW9FaXwYee-S8tw9uqAtQ13TfVZAoI46chlrdmfTx4/s1600/auctiongrabber.JPG&quot; imageanchor=&quot;1&quot; style=&quot;margin-left: 1em; margin-right: 1em; text-align: center;&quot;&gt;&lt;img border=&quot;0&quot; src=&quot;https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEhJNuymIzG0ShxLMXNi4dPSh7Qoqk8IRMfQ_n3M1FwP95wousnmTof5vvKkP8OpO5R1EjIGejFIw7430m62yRGr9t0-P9JZRihuq2xW9FaXwYee-S8tw9uqAtQ13TfVZAoI46chlrdmfTx4/s1600/auctiongrabber.JPG&quot; /&gt;&lt;/a&gt;&lt;br /&gt;
&lt;br /&gt;&lt;/div&gt;</content><link rel='replies' type='application/atom+xml' href='http://pennystats.blogspot.com/feeds/2061547338669619759/comments/default' title='Post Comments'/><link rel='replies' type='text/html' href='http://pennystats.blogspot.com/2012/05/auction-grabber-nearing-completion.html#comment-form' title='0 Comments'/><link rel='edit' type='application/atom+xml' href='http://www.blogger.com/feeds/8078258480436189776/posts/default/2061547338669619759'/><link rel='self' type='application/atom+xml' href='http://www.blogger.com/feeds/8078258480436189776/posts/default/2061547338669619759'/><link rel='alternate' type='text/html' href='http://pennystats.blogspot.com/2012/05/auction-grabber-nearing-completion.html' title='Auction grabber nearing completion'/><author><name>Unknown</name><email>noreply@blogger.com</email><gd:image rel='http://schemas.google.com/g/2005#thumbnail' width='16' height='16' src='https://img1.blogblog.com/img/b16-rounded.gif'/></author><media:thumbnail xmlns:media="http://search.yahoo.com/mrss/" url="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEhJNuymIzG0ShxLMXNi4dPSh7Qoqk8IRMfQ_n3M1FwP95wousnmTof5vvKkP8OpO5R1EjIGejFIw7430m62yRGr9t0-P9JZRihuq2xW9FaXwYee-S8tw9uqAtQ13TfVZAoI46chlrdmfTx4/s72-c/auctiongrabber.JPG" height="72" width="72"/><thr:total>0</thr:total></entry><entry><id>tag:blogger.com,1999:blog-8078258480436189776.post-9147558059822127671</id><published>2012-05-11T12:09:00.001-07:00</published><updated>2012-05-11T12:09:50.593-07:00</updated><category scheme="http://www.blogger.com/atom/ns#" term="auction"/><category scheme="http://www.blogger.com/atom/ns#" term="data"/><category scheme="http://www.blogger.com/atom/ns#" term="excel"/><category scheme="http://www.blogger.com/atom/ns#" term="penny auction"/><category scheme="http://www.blogger.com/atom/ns#" term="python"/><category scheme="http://www.blogger.com/atom/ns#" term="scraping"/><category scheme="http://www.blogger.com/atom/ns#" term="script"/><category scheme="http://www.blogger.com/atom/ns#" term="statistics"/><category scheme="http://www.blogger.com/atom/ns#" term="strategy"/><title type='text'>Finalizing python script, data output and personal thoughts</title><content type='html'>&lt;div dir=&quot;ltr&quot; style=&quot;text-align: left;&quot; trbidi=&quot;on&quot;&gt;
With the script nearly completed, I still have a few minor decisions to make regarding how data should be written for analysis.&lt;br /&gt;
&lt;br /&gt;
Currently, I have three files for individual auction output. First is the raw, individual auction information. Next is an organized and cleaned up auction list (With Bid Cost, Bidder, and Bid Type). Lastly, I have an output file with the bidders and their respective bid quantity for each auction.&lt;br /&gt;
&lt;br /&gt;
To run an effective statistical analysis, I need to create a summary data file that would have the most important data in it from the auction. This would be information like Auction Number, Auction Item, Total Bid Count, Winner Bid Count, etc. I could create some new metrics like &quot;After Cost Profit&quot;, taking into account the bids spend, item cost and shipping cost.&lt;br /&gt;
&lt;br /&gt;
Another item I would like to investigate is the quantity of bidders and their bids. For instance, if a bidder has spent nearly $50 in bids on a $50 item, the likelihood that they will give-up increases with every bid (in theory). Running some analysis could determine the point where most bidders will begin to give up in a bid war.&lt;br /&gt;
&lt;br /&gt;
The most important situation I want to recognize is where low auction selling price occurs. The only buying strategies I have come across on the internet are those where people try to steal an auction at the end of it when the price is already inflated and other bidders are exhausted. Since nearly half of all auctions for low priced items end with low bidding prices (see the charts from my first post), low cost situations is what smart bidders should be looking for.&lt;br /&gt;
&lt;br /&gt;
The last minor aspect I would like to investigate is the relationship between auction selling price and the number of similar auctions ending at the same time. From anecdotal evidence, it appears that when an item is aggressively sought after, bidders will ignore other auctions ending at the same time, even if it is the same item. Recognizing this situation would contribute to the understanding of when lost auction selling price occurs.&lt;/div&gt;</content><link rel='replies' type='application/atom+xml' href='http://pennystats.blogspot.com/feeds/9147558059822127671/comments/default' title='Post Comments'/><link rel='replies' type='text/html' href='http://pennystats.blogspot.com/2012/05/finalizing-python-script-data-output.html#comment-form' title='0 Comments'/><link rel='edit' type='application/atom+xml' href='http://www.blogger.com/feeds/8078258480436189776/posts/default/9147558059822127671'/><link rel='self' type='application/atom+xml' href='http://www.blogger.com/feeds/8078258480436189776/posts/default/9147558059822127671'/><link rel='alternate' type='text/html' href='http://pennystats.blogspot.com/2012/05/finalizing-python-script-data-output.html' title='Finalizing python script, data output and personal thoughts'/><author><name>Unknown</name><email>noreply@blogger.com</email><gd:image rel='http://schemas.google.com/g/2005#thumbnail' width='16' height='16' src='https://img1.blogblog.com/img/b16-rounded.gif'/></author><thr:total>0</thr:total></entry><entry><id>tag:blogger.com,1999:blog-8078258480436189776.post-3067269019116706750</id><published>2012-05-04T11:29:00.001-07:00</published><updated>2012-05-04T11:30:18.935-07:00</updated><category scheme="http://www.blogger.com/atom/ns#" term="data"/><category scheme="http://www.blogger.com/atom/ns#" term="excel"/><category scheme="http://www.blogger.com/atom/ns#" term="output"/><category scheme="http://www.blogger.com/atom/ns#" term="python"/><category scheme="http://www.blogger.com/atom/ns#" term="scraping"/><category scheme="http://www.blogger.com/atom/ns#" term="statistics"/><category scheme="http://www.blogger.com/atom/ns#" term="strategy"/><title type='text'>Example output of data</title><content type='html'>&lt;div dir=&quot;ltr&quot; style=&quot;text-align: left;&quot; trbidi=&quot;on&quot;&gt;
If you are curious, here is the data output you can expect to see with my script. I am still in the development stage, so I may add or remove things that add useful information.&lt;br /&gt;
&lt;br /&gt;
Currently, I cannot dump the bid time of each individual bid (Not sure that it matters, but it may be insightful into bidding psychology). I have considered adding a feature to check if the auction is hidden upon completion of the auction. That categorical data will probably be helpful in regression analysis. I am also considering adding an output feature that would list the bidders with how many bids they have placed over the course of the auction in real-time (as opposed to after the auction ends).&lt;br /&gt;
&lt;br /&gt;
Here is the typical auction output data for the script:&lt;br /&gt;
&lt;br /&gt;
&lt;div class=&quot;separator&quot; style=&quot;clear: both; text-align: center;&quot;&gt;
&lt;a href=&quot;https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEg4s7AOP1rl_8Ss5MUDrBKsHie_AUifs2xPSg0Ysi59s7XpGPNO-dvs996UMiWCNU9zZTS4F8gRfP7b5aEH-xA_MW5AcxUhhFwRNo2yLEBIoZr8SGXcDh06jl-5ECQcdpCII_OMKChqF_d2/s1600/auctionoutput.JPG&quot; imageanchor=&quot;1&quot; style=&quot;clear: left; float: left; margin-bottom: 1em; margin-right: 1em;&quot;&gt;&lt;img border=&quot;0&quot; height=&quot;305&quot; src=&quot;https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEg4s7AOP1rl_8Ss5MUDrBKsHie_AUifs2xPSg0Ysi59s7XpGPNO-dvs996UMiWCNU9zZTS4F8gRfP7b5aEH-xA_MW5AcxUhhFwRNo2yLEBIoZr8SGXcDh06jl-5ECQcdpCII_OMKChqF_d2/s400/auctionoutput.JPG&quot; width=&quot;400&quot; /&gt;&lt;/a&gt;&lt;/div&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;a name=&#39;more&#39;&gt;&lt;/a&gt;&lt;br /&gt;
&lt;br /&gt;
I am also considering adding output that would dump general auction information to a comprehensive auction file (i.e. Auction Type, Total Bids, Bids by Winner, Winning Bid Type, Auction Duration (past anticipated end time), and Total Bidders). That stuff might be useful!&lt;/div&gt;</content><link rel='replies' type='application/atom+xml' href='http://pennystats.blogspot.com/feeds/3067269019116706750/comments/default' title='Post Comments'/><link rel='replies' type='text/html' href='http://pennystats.blogspot.com/2012/05/example-output-of-data.html#comment-form' title='0 Comments'/><link rel='edit' type='application/atom+xml' href='http://www.blogger.com/feeds/8078258480436189776/posts/default/3067269019116706750'/><link rel='self' type='application/atom+xml' href='http://www.blogger.com/feeds/8078258480436189776/posts/default/3067269019116706750'/><link rel='alternate' type='text/html' href='http://pennystats.blogspot.com/2012/05/example-output-of-data.html' title='Example output of data'/><author><name>Unknown</name><email>noreply@blogger.com</email><gd:image rel='http://schemas.google.com/g/2005#thumbnail' width='16' height='16' src='https://img1.blogblog.com/img/b16-rounded.gif'/></author><media:thumbnail xmlns:media="http://search.yahoo.com/mrss/" url="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEg4s7AOP1rl_8Ss5MUDrBKsHie_AUifs2xPSg0Ysi59s7XpGPNO-dvs996UMiWCNU9zZTS4F8gRfP7b5aEH-xA_MW5AcxUhhFwRNo2yLEBIoZr8SGXcDh06jl-5ECQcdpCII_OMKChqF_d2/s72-c/auctionoutput.JPG" height="72" width="72"/><thr:total>0</thr:total></entry><entry><id>tag:blogger.com,1999:blog-8078258480436189776.post-7966864797402223462</id><published>2012-05-03T20:44:00.000-07:00</published><updated>2012-05-03T20:44:36.650-07:00</updated><title type='text'>Scraping auctions with urllib2</title><content type='html'>&lt;div dir=&quot;ltr&quot; style=&quot;text-align: left;&quot; trbidi=&quot;on&quot;&gt;
After completing the individual auction scraper, I needed to create a script that would scrape all available auctions. To my dismay, there were nearly 200 live auctions in each section. The computing resources required to run each auction&amp;nbsp;simultaneously&amp;nbsp;would be prohibitive.&lt;br /&gt;
&lt;br /&gt;
To mitigate this problem, I came up with a clever method of checking the auction time left with what I decided to be an appropriate starting point. After all, there&#39;s no sense recording an auction with 30 hours left when you could get the same data if you started with only 5 minutes left.&lt;br /&gt;
&lt;br /&gt;
Even so, &amp;nbsp;I am concerned about the computing resources needed to record all of the auctions. Right now I am looking at hosting options to run the script and perform the excessive back end resource requirements.&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;&lt;/div&gt;</content><link rel='replies' type='application/atom+xml' href='http://pennystats.blogspot.com/feeds/7966864797402223462/comments/default' title='Post Comments'/><link rel='replies' type='text/html' href='http://pennystats.blogspot.com/2012/05/scraping-auctions-with-urllib2.html#comment-form' title='0 Comments'/><link rel='edit' type='application/atom+xml' href='http://www.blogger.com/feeds/8078258480436189776/posts/default/7966864797402223462'/><link rel='self' type='application/atom+xml' href='http://www.blogger.com/feeds/8078258480436189776/posts/default/7966864797402223462'/><link rel='alternate' type='text/html' href='http://pennystats.blogspot.com/2012/05/scraping-auctions-with-urllib2.html' title='Scraping auctions with urllib2'/><author><name>Unknown</name><email>noreply@blogger.com</email><gd:image rel='http://schemas.google.com/g/2005#thumbnail' width='16' height='16' src='https://img1.blogblog.com/img/b16-rounded.gif'/></author><thr:total>0</thr:total></entry><entry><id>tag:blogger.com,1999:blog-8078258480436189776.post-7374853280416105795</id><published>2012-05-01T11:09:00.000-07:00</published><updated>2012-05-01T15:41:57.252-07:00</updated><category scheme="http://www.blogger.com/atom/ns#" term="auction"/><category scheme="http://www.blogger.com/atom/ns#" term="python"/><category scheme="http://www.blogger.com/atom/ns#" term="scraping"/><category scheme="http://www.blogger.com/atom/ns#" term="script"/><category scheme="http://www.blogger.com/atom/ns#" term="selenium"/><category scheme="http://www.blogger.com/atom/ns#" term="selenium rc"/><title type='text'>Selenium for scraping in python</title><content type='html'>&lt;div dir=&quot;ltr&quot; style=&quot;text-align: left;&quot; trbidi=&quot;on&quot;&gt;
After several days of searching, I found a viable solution for large scale data scraping!&lt;br /&gt;
&lt;br /&gt;
By using a combination of Selenium RC (remote console) and the client version on my local machine, I have put together a working script that will pull data values from the page while dumping them into a CSV file.&lt;br /&gt;
&lt;br /&gt;
The biggest struggle behind the coding (other than having no experience with python) was from the AJAX code on the auction website server. Every time I parsed the page with Beautifulsoup , Scrapy or any other scraping script, it would return null values for the containers I wanted.&lt;br /&gt;
&lt;br /&gt;
By using Selenium, I can automate the process of grabbing info from the page on each refresh. The code itself is fairly simple. The next step would be to write a scraping function (probably using Beautifulsoup since it is easy for static html) to grab all the auctions, then dumping them into a list to be monitored by Selenium.&lt;br /&gt;
&lt;br /&gt;
I have a final exam this week so I don&#39;t expect to get much done. But I will be on vacation the next week, so hopefully I can complete the code and start harvesting some rich data sets!&lt;/div&gt;</content><link rel='replies' type='application/atom+xml' href='http://pennystats.blogspot.com/feeds/7374853280416105795/comments/default' title='Post Comments'/><link rel='replies' type='text/html' href='http://pennystats.blogspot.com/2012/05/selenium-for-scraping-in-python.html#comment-form' title='0 Comments'/><link rel='edit' type='application/atom+xml' href='http://www.blogger.com/feeds/8078258480436189776/posts/default/7374853280416105795'/><link rel='self' type='application/atom+xml' href='http://www.blogger.com/feeds/8078258480436189776/posts/default/7374853280416105795'/><link rel='alternate' type='text/html' href='http://pennystats.blogspot.com/2012/05/selenium-for-scraping-in-python.html' title='Selenium for scraping in python'/><author><name>Unknown</name><email>noreply@blogger.com</email><gd:image rel='http://schemas.google.com/g/2005#thumbnail' width='16' height='16' src='https://img1.blogblog.com/img/b16-rounded.gif'/></author><thr:total>0</thr:total></entry></feed>