<?xml version='1.0' encoding='UTF-8'?><?xml-stylesheet href="http://www.blogger.com/styles/atom.css" type="text/css"?><feed xmlns='http://www.w3.org/2005/Atom' xmlns:openSearch='http://a9.com/-/spec/opensearchrss/1.0/' xmlns:blogger='http://schemas.google.com/blogger/2008' xmlns:georss='http://www.georss.org/georss' xmlns:gd="http://schemas.google.com/g/2005" xmlns:thr='http://purl.org/syndication/thread/1.0'><id>tag:blogger.com,1999:blog-1825393237232252749</id><updated>2024-02-20T01:25:52.599-08:00</updated><category term="osm"/><category term="fosm_maps"/><category term="klina"/><category term="openstreetmap"/><category term="georss"/><category term="gps"/><category term="josm"/><category term="offenbach"/><category term="osmgit"/><category term="Abduganievich"/><category term="EPSG:102157"/><category term="ETRS_1989_Kosovo_Grid"/><category term="GeoLocation"/><category term="GeoSpoof"/><category term="JUWTF"/><category term="Karimov"/><category term="ai"/><category term="android"/><category term="archive.org"/><category term="berlin"/><category term="bing"/><category term="cc-by-sa"/><category term="compression"/><category term="convert"/><category term="distributed_maps"/><category term="eff"/><category term="emacs"/><category term="fsf"/><category term="gdal"/><category term="gdal2tiles"/><category term="gdal_translate"/><category term="geo"/><category term="geotagging"/><category term="gitosm"/><category term="gml"/><category term="gpx"/><category term="h4ck3rm1k3"/><category term="history"/><category term="iOS"/><category term="inkscape"/><category term="iphone"/><category term="kosova"/><category term="kosovaref"/><category term="kosovo"/><category term="latlonspoof"/><category term="location"/><category term="logisticsplus"/><category term="logo"/><category term="mediawiki"/><category term="nsa"/><category term="odbl"/><category term="openstreetamap"/><category term="pdftoppm"/><category term="pristina"/><category term="privacy"/><category term="prizren"/><category term="protobuf"/><category term="rendering optimization"/><category term="revert changes"/><category term="rss"/><category term="sfk10 salus"/><category term="spook"/><category term="svg"/><category term="transiki gtfs"/><category term="wahlkreise"/><category term="wikimedia"/><category term="wikipedia"/><title type='text'>OSMOpenLayers</title><subtitle type='html'>My Openstreetmap OSGEO and general mapping blog.</subtitle><link rel='http://schemas.google.com/g/2005#feed' type='application/atom+xml' href='http://osmopenlayers.blogspot.com/feeds/posts/default'/><link rel='self' type='application/atom+xml' href='http://www.blogger.com/feeds/1825393237232252749/posts/default?redirect=false'/><link rel='alternate' type='text/html' href='http://osmopenlayers.blogspot.com/'/><link rel='hub' href='http://pubsubhubbub.appspot.com/'/><link rel='next' type='application/atom+xml' href='http://www.blogger.com/feeds/1825393237232252749/posts/default?start-index=26&amp;max-results=25&amp;redirect=false'/><author><name>H4ck3rm1k3</name><uri>http://www.blogger.com/profile/04484528013589914857</uri><email>noreply@blogger.com</email><gd:image rel='http://schemas.google.com/g/2005#thumbnail' width='16' height='16' src='https://img1.blogblog.com/img/b16-rounded.gif'/></author><generator version='7.00' uri='http://www.blogger.com'>Blogger</generator><openSearch:totalResults>232</openSearch:totalResults><openSearch:startIndex>1</openSearch:startIndex><openSearch:itemsPerPage>25</openSearch:itemsPerPage><entry><id>tag:blogger.com,1999:blog-1825393237232252749.post-673119784204533997</id><published>2013-02-23T09:37:00.001-08:00</published><updated>2013-02-23T09:37:18.556-08:00</updated><title type='text'>OSM for topeka</title><content type='html'>&lt;div dir=&quot;ltr&quot; style=&quot;text-align: left;&quot; trbidi=&quot;on&quot;&gt;
We recently moved to Topeka Kansas to be close to my family, after living abroad for many years I decided to finally leave europe and come back home. My mom and sister live in Topeka, so that is where we moved.&lt;br /&gt;
&lt;br /&gt;
Now, living in Topeka has been a real learning experience, there are many differences to Frankfurt! In any case, I started to work on openstreetmap.org (&lt;a href=&quot;http://wiki.openstreetmap.org/wiki/Kansas&quot;&gt;http://wiki.openstreetmap.org/wiki/Kansas&lt;/a&gt;) here and to build up my local knowledge of the Area. Also working on other things like commons &lt;a href=&quot;http://commons.wikimedia.org/wiki/Category:Topeka,_Kansas&quot;&gt;http://commons.wikimedia.org/wiki/Category:Topeka,_Kansas&lt;/a&gt;&amp;nbsp; and wikipedia for Topeka (&lt;a href=&quot;http://en.wikipedia.org/wiki/Wikipedia:Meetup/Topeka/Wikipedia_Day&quot;&gt;http://en.wikipedia.org/wiki/Wikipedia:Meetup/Topeka/Wikipedia_Day&lt;/a&gt; , &lt;a href=&quot;http://en.wikipedia.org/wiki/Wikipedia:GLAM/US/Kansas&quot;&gt;http://en.wikipedia.org/wiki/Wikipedia:GLAM/US/Kansas&lt;/a&gt;) .&lt;br /&gt;
&lt;br /&gt;
I have been adding in all the trails and bikepaths (&lt;a href=&quot;http://topekabikeway.org/&quot;&gt;topekabikeway.org&lt;/a&gt;) to the map.&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
Work has gone well, and I am now working on tools to fixup and cleanup the data entered. I have stopped to manually do this. Researching into python scripting for josm, then looking into creating jython scripts that can use JOSM classes and do work. &lt;a href=&quot;http://github.com/h4ck3rm1k3/josm-script-jython-streetrepair/&quot;&gt;http://github.com/h4ck3rm1k3/josm-script-jython-streetrepair/&lt;/a&gt;&lt;br /&gt;
&lt;br /&gt;
Now I am thinking about how to properly setup a local search engine for my little part of the world. &lt;br /&gt;
&lt;br /&gt;
Well one of the features that I would like is to look for things on some address on the internet. This has gotten me thinking about setting up my own indexing of the data, because google does not like people using APIs to its search, why not use my own apache solr ? &lt;a href=&quot;http://www.ibm.com/developerworks/opensource/library/j-spatial/index.html&quot;&gt;http://www.ibm.com/developerworks/opensource/library/j-spatial/index.html&lt;/a&gt; This is using lucene&amp;nbsp; &lt;a href=&quot;http://lucene.apache.org/&quot;&gt;http://lucene.apache.org/&lt;/a&gt;&lt;br /&gt;
&lt;br /&gt;
There is a geocoding tool as well &lt;a href=&quot;http://code.google.com/p/gisgraphy/&quot;&gt;http://code.google.com/p/gisgraphy/&lt;/a&gt;&lt;br /&gt;
&lt;br /&gt;&lt;br /&gt;
So my plan is to pull in articles from the newspaper, the city council and other sources, index them and make them available. I wonder what about facebook? How can I find all the facepages or google locations for topeka? well We will have to see if it is available or legal. What about all the websites for local businesses? Remember dmoz ? &lt;a href=&quot;http://www.dmoz.org/Regional/North_America/United_States/Kansas/Localities/T/Topeka/&quot;&gt;http://www.dmoz.org/Regional/North_America/United_States/Kansas/Localities/T/Topeka/&lt;/a&gt; ? Well also we have stored a lot of websites in the osm pages.&lt;br /&gt;
&lt;br /&gt;
Anyway, so these are my current ideas, more to come.&lt;br /&gt;
mike&lt;/div&gt;
</content><link rel='replies' type='application/atom+xml' href='http://osmopenlayers.blogspot.com/feeds/673119784204533997/comments/default' title='Post Comments'/><link rel='replies' type='text/html' href='http://osmopenlayers.blogspot.com/2013/02/osm-for-topeka.html#comment-form' title='0 Comments'/><link rel='edit' type='application/atom+xml' href='http://www.blogger.com/feeds/1825393237232252749/posts/default/673119784204533997'/><link rel='self' type='application/atom+xml' href='http://www.blogger.com/feeds/1825393237232252749/posts/default/673119784204533997'/><link rel='alternate' type='text/html' href='http://osmopenlayers.blogspot.com/2013/02/osm-for-topeka.html' title='OSM for topeka'/><author><name>H4ck3rm1k3</name><uri>http://www.blogger.com/profile/04484528013589914857</uri><email>noreply@blogger.com</email><gd:image rel='http://schemas.google.com/g/2005#thumbnail' width='16' height='16' src='https://img1.blogblog.com/img/b16-rounded.gif'/></author><thr:total>0</thr:total></entry><entry><id>tag:blogger.com,1999:blog-1825393237232252749.post-8109047130111164102</id><published>2012-12-27T08:32:00.001-08:00</published><updated>2012-12-27T08:32:13.318-08:00</updated><title type='text'>Legality of using names derived from public records in kansas</title><content type='html'>&lt;div dir=&quot;ltr&quot; style=&quot;text-align: left;&quot; trbidi=&quot;on&quot;&gt;
&lt;br /&gt;
The law here&amp;nbsp;&lt;a href=&quot;http://kansasstatutes.lesterama.org/Chapter_45/Article_2/45-230.html&quot;&gt;http://kansasstatutes.lesterama.org/Chapter_45/Article_2/45-230.html&lt;/a&gt;&amp;nbsp;says : &quot;list of names and addresses&quot;,&lt;br /&gt;
&lt;br /&gt;
&lt;blockquote class=&quot;tr_bq&quot;&gt;
&lt;b&gt;Statute 45-230: Unlawful use of names derived from public records.&lt;/b&gt;&amp;nbsp;(a) No person shall knowingly sell, give or receive, for the purpose of selling or offering for sale any property or service to persons listed therein, any list of names and addresses contained in or derived from public records except:&lt;/blockquote&gt;
&lt;br /&gt;
This does not include just addresses. It says names and addresses and talks about people. So it is illegal to extract information about people from public records and then sell that information. This basically restricts the usage of personal data contained in public records.&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
This is summed up here as well : &amp;nbsp;&lt;a href=&quot;http://kansasstatutes.lesterama.org/Chapter_45/Article_2/45-220.html&quot;&gt;http://kansasstatutes.lesterama.org/Chapter_45/Article_2/45-220.html&lt;/a&gt;&lt;br /&gt;
&lt;blockquote class=&quot;tr_bq&quot;&gt;
(2) &amp;nbsp; the requester does not intend to, and will not: (A) Use any list of names or addresses contained in or derived from the records or information for the purpose of selling or offering for sale any property or service to any person listed or to any person who resides at any address listed; or (B) sell, give or otherwise make available to any person any list of names or addresses contained in or derived from the records or information for the purpose of allowing that person to sell or offer for sale any property or service to any person listed or to any person who resides at any address listed.&lt;/blockquote&gt;
&lt;br /&gt;
So basically the names &lt;b&gt;and&lt;/b&gt; addresses cannot be published to use them commercially, meaning that you cannot offer goods or services for sale. But this also talks about list of names or addresses. It talks about allowing people to sell or offer to any person listed or person who resides. So this would also preclude using the address and saying &quot;to the resident&quot; at the house (&quot;any person who resides at any address listed&quot;).&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
Now if you look at the map layer of google, you will see the county lot data that is visible.&lt;br /&gt;
You can see that there is no other source of the parcel data except from the county:&lt;br /&gt;
&lt;a href=&quot;https://maps.google.com/maps?q=39.119099,-95.658594&amp;amp;ll=39.119182,-95.658656&amp;amp;spn=0.005927,0.011362&amp;amp;num=1&amp;amp;gl=us&amp;amp;t=m&amp;amp;z=17&quot;&gt;https://maps.google.com/maps?q=39.119099,-95.658594&amp;amp;ll=39.119182,-95.658656&amp;amp;spn=0.005927,0.011362&amp;amp;num=1&amp;amp;gl=us&amp;amp;t=m&amp;amp;z=17&lt;/a&gt;&lt;br /&gt;
there are no visible signs that the parcel is shaped like this :&lt;br /&gt;
&lt;a href=&quot;http://www.snco.us/Ap/R_prop/Listing.asp?PRCL_ID=1030504001011000&quot;&gt;http://www.snco.us/Ap/R_prop/Listing.asp?PRCL_ID=1030504001011000&lt;/a&gt;&lt;br /&gt;
&lt;a href=&quot;http://gis.snco.us/publicgis/PS/?PRCL_ID=1030504001011000&quot;&gt;http://gis.snco.us/publicgis/PS/?PRCL_ID=1030504001011000&lt;/a&gt;&lt;br /&gt;
&lt;br /&gt;
So obviously, google has imported the parcel data. And this parcel data provides the house number and zip code of the address so that could be used to send them a mail.&lt;br /&gt;
&lt;br /&gt;
Now, going with that example,&amp;nbsp;&lt;a href=&quot;http://www.zillow.com/homedetails/3926-N-Kansas-Ave-Topeka-KS-66617/77462539_zpid/&quot;&gt;http://www.zillow.com/homedetails/3926-N-Kansas-Ave-Topeka-KS-66617/77462539_zpid/&lt;/a&gt;&amp;nbsp;is the same location, trulia has the same info&amp;nbsp;&lt;a href=&quot;http://www.trulia.com/homes/Kansas/Topeka/sold/368163-3926-N-Kansas-Ave-Topeka-KS-66617&quot;&gt;http://www.trulia.com/homes/Kansas/Topeka/sold/368163-3926-N-Kansas-Ave-Topeka-KS-66617&lt;/a&gt;&amp;nbsp;and this contains all the tax information and much more information that could be used to target people.&lt;br /&gt;
See also&amp;nbsp;&lt;a href=&quot;http://www.homegain.com/homevalues/Topeka-KS/66617/3926-North-Kansas-Avenue&quot;&gt;http://www.homegain.com/homevalues/Topeka-KS/66617/3926-North-Kansas-Avenue&lt;/a&gt;&amp;nbsp;, &lt;br /&gt;
and here &amp;nbsp;&lt;a href=&quot;http://www.realtor.com/realestateandhomes-detail/3926-N-Kansas-Ave_Topeka_KS_66617_M70192-63011#/listingType-any/pg-1&quot;&gt;http://www.realtor.com/realestateandhomes-detail/3926-N-Kansas-Ave_Topeka_KS_66617_M70192-63011#/listingType-any/pg-1&lt;/a&gt;&amp;nbsp;&lt;a href=&quot;http://www.eppraisal.com/Home-Values-3930-n-kansas-ave-topeka-ks-66617-195003071.mvc&quot;&gt;http://www.eppraisal.com/Home-Values-3930-n-kansas-ave-topeka-ks-66617-195003071.mvc&lt;/a&gt;&lt;br /&gt;
&lt;br /&gt;
Here is the same information :&lt;a href=&quot;http://www.propertycrunch.com/Kansas/Topeka/n&quot;&gt;http://www.propertycrunch.com/Kansas/Topeka/n&lt;/a&gt;&amp;nbsp;it is a list of addresses that could be used to contact the people living there.&lt;br /&gt;
&lt;br /&gt;
Now there is more information about that address, here is the phone number and name of the current resident supposedly :&lt;br /&gt;
&lt;a href=&quot;http://411.info/people/Kansas/Topeka/Ensley-Robt/64119065.html&quot;&gt;http://411.info/people/Kansas/Topeka/Ensley-Robt/64119065.html&lt;/a&gt;&amp;nbsp;that is also here&amp;nbsp;&lt;a href=&quot;http://www.spokeo.com/Kansas+Ave+Topeka+KS+addresses+2#28483161&quot;&gt;http://www.spokeo.com/Kansas+Ave+Topeka+KS+addresses+2#28483161&lt;/a&gt;&lt;br /&gt;
here is the telephone book entry&amp;nbsp;&lt;a href=&quot;http://www.ypsort.com/info/ks/2531840/&quot;&gt;http://www.ypsort.com/info/ks/2531840/&lt;/a&gt;&amp;nbsp;.&lt;br /&gt;
&lt;br /&gt;
So you can see there are two types of data available, one is the property info, the other is the telephone book. It can be see that trulia and co collect all the property information from the county directly and from there you can use that information to contact the owner to offer to buy or sell property. Also google provides this information that can be used for the same purpose. My question is if this is violation of the law of kansas, because I can use this address information to locate people and offer them things for sale. &lt;br /&gt;
&lt;br /&gt;&lt;/div&gt;
</content><link rel='replies' type='application/atom+xml' href='http://osmopenlayers.blogspot.com/feeds/8109047130111164102/comments/default' title='Post Comments'/><link rel='replies' type='text/html' href='http://osmopenlayers.blogspot.com/2012/12/legality-of-using-names-derived-from.html#comment-form' title='0 Comments'/><link rel='edit' type='application/atom+xml' href='http://www.blogger.com/feeds/1825393237232252749/posts/default/8109047130111164102'/><link rel='self' type='application/atom+xml' href='http://www.blogger.com/feeds/1825393237232252749/posts/default/8109047130111164102'/><link rel='alternate' type='text/html' href='http://osmopenlayers.blogspot.com/2012/12/legality-of-using-names-derived-from.html' title='Legality of using names derived from public records in kansas'/><author><name>H4ck3rm1k3</name><uri>http://www.blogger.com/profile/04484528013589914857</uri><email>noreply@blogger.com</email><gd:image rel='http://schemas.google.com/g/2005#thumbnail' width='16' height='16' src='https://img1.blogblog.com/img/b16-rounded.gif'/></author><thr:total>0</thr:total></entry><entry><id>tag:blogger.com,1999:blog-1825393237232252749.post-1051236444009758961</id><published>2012-10-15T22:23:00.001-07:00</published><updated>2012-10-15T22:23:50.004-07:00</updated><title type='text'>idea of the day</title><content type='html'>&lt;div dir=&quot;ltr&quot; style=&quot;text-align: left;&quot; trbidi=&quot;on&quot;&gt;
The idea of the day is to use the google api to generate google sites for hosting the data for a small area of the map. Lists of POIs and pages for major things.&lt;/div&gt;
</content><link rel='replies' type='application/atom+xml' href='http://osmopenlayers.blogspot.com/feeds/1051236444009758961/comments/default' title='Post Comments'/><link rel='replies' type='text/html' href='http://osmopenlayers.blogspot.com/2012/10/idea-of-day.html#comment-form' title='0 Comments'/><link rel='edit' type='application/atom+xml' href='http://www.blogger.com/feeds/1825393237232252749/posts/default/1051236444009758961'/><link rel='self' type='application/atom+xml' href='http://www.blogger.com/feeds/1825393237232252749/posts/default/1051236444009758961'/><link rel='alternate' type='text/html' href='http://osmopenlayers.blogspot.com/2012/10/idea-of-day.html' title='idea of the day'/><author><name>H4ck3rm1k3</name><uri>http://www.blogger.com/profile/04484528013589914857</uri><email>noreply@blogger.com</email><gd:image rel='http://schemas.google.com/g/2005#thumbnail' width='16' height='16' src='https://img1.blogblog.com/img/b16-rounded.gif'/></author><thr:total>0</thr:total></entry><entry><id>tag:blogger.com,1999:blog-1825393237232252749.post-7217304923062723274</id><published>2012-10-08T02:26:00.000-07:00</published><updated>2012-10-08T02:26:10.882-07:00</updated><title type='text'>Petition Apple for Disclosure of its usage of Openstreetmap Data</title><content type='html'>&lt;div dir=&quot;ltr&quot; style=&quot;text-align: left;&quot; trbidi=&quot;on&quot;&gt;
&lt;br /&gt;
         
    I would like to ask apple to fully disclose the amount and nature of
 the data that It used from openstreetmap. The attribution given on the 
website from them is not up to the normal standard. I have created a 
petition for all supporters and contributors of openstreetmap to sign 
and ask apple for disclosure. &lt;a href=&quot;http://www.change.org/petitions/apple-inc-uphold-the-terms-of-cc-by-sa-2-0-license&quot; rel=&quot;nofollow&quot; target=&quot;_blank&quot;&gt;http://www.change.org/petitions/apple-inc-uphold-the-terms-of-cc-by-sa-2-0-license&lt;/a&gt; please sign the petition and share it. Thank you,&lt;br /&gt;
James Michael DuPont   &lt;/div&gt;
</content><link rel='replies' type='application/atom+xml' href='http://osmopenlayers.blogspot.com/feeds/7217304923062723274/comments/default' title='Post Comments'/><link rel='replies' type='text/html' href='http://osmopenlayers.blogspot.com/2012/10/petition-apple-for-disclosure-of-its.html#comment-form' title='0 Comments'/><link rel='edit' type='application/atom+xml' href='http://www.blogger.com/feeds/1825393237232252749/posts/default/7217304923062723274'/><link rel='self' type='application/atom+xml' href='http://www.blogger.com/feeds/1825393237232252749/posts/default/7217304923062723274'/><link rel='alternate' type='text/html' href='http://osmopenlayers.blogspot.com/2012/10/petition-apple-for-disclosure-of-its.html' title='Petition Apple for Disclosure of its usage of Openstreetmap Data'/><author><name>H4ck3rm1k3</name><uri>http://www.blogger.com/profile/04484528013589914857</uri><email>noreply@blogger.com</email><gd:image rel='http://schemas.google.com/g/2005#thumbnail' width='16' height='16' src='https://img1.blogblog.com/img/b16-rounded.gif'/></author><thr:total>0</thr:total></entry><entry><id>tag:blogger.com,1999:blog-1825393237232252749.post-3786405041857083281</id><published>2012-10-03T04:44:00.002-07:00</published><updated>2012-10-03T04:44:39.210-07:00</updated><title type='text'>Local nominatim server</title><content type='html'>&lt;div dir=&quot;ltr&quot; style=&quot;text-align: left;&quot; trbidi=&quot;on&quot;&gt;
Idea of the day :&lt;br /&gt;
&lt;br /&gt;
we need a drop in replacement for google data, geonames and osm&amp;nbsp;nominatim for applications to use, It should be as simple as loading an osm file into it and running a local server.&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;&lt;/div&gt;
</content><link rel='replies' type='application/atom+xml' href='http://osmopenlayers.blogspot.com/feeds/3786405041857083281/comments/default' title='Post Comments'/><link rel='replies' type='text/html' href='http://osmopenlayers.blogspot.com/2012/10/local-nominatim-server.html#comment-form' title='0 Comments'/><link rel='edit' type='application/atom+xml' href='http://www.blogger.com/feeds/1825393237232252749/posts/default/3786405041857083281'/><link rel='self' type='application/atom+xml' href='http://www.blogger.com/feeds/1825393237232252749/posts/default/3786405041857083281'/><link rel='alternate' type='text/html' href='http://osmopenlayers.blogspot.com/2012/10/local-nominatim-server.html' title='Local nominatim server'/><author><name>H4ck3rm1k3</name><uri>http://www.blogger.com/profile/04484528013589914857</uri><email>noreply@blogger.com</email><gd:image rel='http://schemas.google.com/g/2005#thumbnail' width='16' height='16' src='https://img1.blogblog.com/img/b16-rounded.gif'/></author><thr:total>0</thr:total></entry><entry><id>tag:blogger.com,1999:blog-1825393237232252749.post-9173074193056078958</id><published>2012-06-24T11:23:00.003-07:00</published><updated>2012-06-24T11:23:45.034-07:00</updated><title type='text'>Details on bucket upload</title><content type='html'>&lt;div dir=&quot;ltr&quot; style=&quot;text-align: left;&quot; trbidi=&quot;on&quot;&gt;
Here are some notes on my bucket upload script :&lt;br /&gt;
git@github.com:h4ck3rm1k3/s3cmd-modification.git&lt;br /&gt;
&lt;a href=&quot;http://github.com/h4ck3rm1k3/s3cmd-modification&quot;&gt;github.com/h4ck3rm1k3/s3cmd-modification&lt;/a&gt;&lt;br /&gt;
&lt;br /&gt;
putzip reads the bucket description, a list of files from the data dir,&lt;br /&gt;
it create zip file on the temp dir&lt;br /&gt;
&lt;br /&gt;
The list of bucket descriptions are created with the split command based on the list of &#39;block files&#39; so the split command splits the linear list of block files into buckets.&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
I have repaired the files on these buckets :&lt;br /&gt;
&lt;a href=&quot;http://archive.org/details/fosm-20120401130001-xaaps&quot;&gt;http://archive.org/details/fosm-20120401130001-xaaps&lt;/a&gt;&lt;br /&gt;
&lt;br /&gt;
&lt;div style=&quot;margin-bottom: 0px; margin-left: 0px; margin-right: 0px; margin-top: 0px;&quot;&gt;
&lt;a href=&quot;http://archive.org/details/fosm-20120401130001-xaapr&quot;&gt;http://archive.org/details/fosm-20120401130001-xaapr&lt;/a&gt;&lt;/div&gt;
&lt;div style=&quot;margin-bottom: 0px; margin-left: 0px; margin-right: 0px; margin-top: 0px;&quot;&gt;
&lt;/div&gt;
&lt;div style=&quot;margin-bottom: 0px; margin-left: 0px; margin-right: 0px; margin-top: 0px;&quot;&gt;
&lt;a href=&quot;http://archive.org/details/fosm-20120401130001-xaapq&quot;&gt;http://archive.org/details/fosm-20120401130001-xaapq&lt;/a&gt;&lt;/div&gt;
&lt;div style=&quot;margin-bottom: 0px; margin-left: 0px; margin-right: 0px; margin-top: 0px;&quot;&gt;
&lt;/div&gt;
&lt;div style=&quot;margin-bottom: 0px; margin-left: 0px; margin-right: 0px; margin-top: 0px;&quot;&gt;
&lt;a href=&quot;http://archive.org/details/fosm-20120401130001-xaapp&quot;&gt;http://archive.org/details/fosm-20120401130001-xaapp&lt;/a&gt;&lt;/div&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;div&gt;
&lt;br /&gt;&lt;/div&gt;
&lt;div&gt;
&lt;br /&gt;&lt;/div&gt;
&lt;div&gt;
&lt;br /&gt;&lt;/div&gt;
&lt;/div&gt;</content><link rel='replies' type='application/atom+xml' href='http://osmopenlayers.blogspot.com/feeds/9173074193056078958/comments/default' title='Post Comments'/><link rel='replies' type='text/html' href='http://osmopenlayers.blogspot.com/2012/06/details-on-bucket-upload.html#comment-form' title='0 Comments'/><link rel='edit' type='application/atom+xml' href='http://www.blogger.com/feeds/1825393237232252749/posts/default/9173074193056078958'/><link rel='self' type='application/atom+xml' href='http://www.blogger.com/feeds/1825393237232252749/posts/default/9173074193056078958'/><link rel='alternate' type='text/html' href='http://osmopenlayers.blogspot.com/2012/06/details-on-bucket-upload.html' title='Details on bucket upload'/><author><name>H4ck3rm1k3</name><uri>http://www.blogger.com/profile/04484528013589914857</uri><email>noreply@blogger.com</email><gd:image rel='http://schemas.google.com/g/2005#thumbnail' width='16' height='16' src='https://img1.blogblog.com/img/b16-rounded.gif'/></author><thr:total>0</thr:total></entry><entry><id>tag:blogger.com,1999:blog-1825393237232252749.post-7130610889371484365</id><published>2012-06-24T02:48:00.006-07:00</published><updated>2012-06-24T02:48:54.559-07:00</updated><title type='text'>Details about the planet buckets</title><content type='html'>&lt;div dir=&quot;ltr&quot; style=&quot;text-align: left;&quot; trbidi=&quot;on&quot;&gt;
Here are the details of the first postprocessing of the fosm index files.&lt;div&gt;
&lt;br /&gt;&lt;/div&gt;
&lt;div&gt;
Well lets review the basics, the plant file from april 01 2012 was split up into 900k blocks.&lt;/div&gt;
&lt;div&gt;
each block was put together with 500 other blocks in a bucket and put into the archive.org&lt;/div&gt;
&lt;div&gt;
&lt;br /&gt;&lt;/div&gt;
&lt;div&gt;
The first bucket is :&lt;/div&gt;
&lt;div&gt;
&lt;a href=&quot;http://archive.org/details/fosm-20120401130001-xaaaa&quot;&gt;http://archive.org/details/fosm-20120401130001-xaaaa&lt;/a&gt;&lt;/div&gt;
&lt;div&gt;
&lt;br /&gt;&lt;/div&gt;
&lt;div&gt;
The final bucket is located here:&lt;/div&gt;
&lt;div&gt;
&lt;a href=&quot;http://archive.org/details/fosm-20120401130001-xachy&quot;&gt;http://archive.org/details/fosm-20120401130001-xachy&lt;/a&gt;&lt;/div&gt;
&lt;div&gt;
&lt;br /&gt;&lt;/div&gt;
&lt;div&gt;
So the first set of buckets contains only nodes, all the way up to &amp;nbsp;xabua&lt;/div&gt;
&lt;div&gt;
&lt;a href=&quot;http://archive.org/details/fosm-20120401130001-xabua&quot;&gt;http://archive.org/details/fosm-20120401130001-xabua&lt;/a&gt;&lt;/div&gt;
&lt;div&gt;
&lt;br /&gt;&lt;/div&gt;
&lt;div&gt;
It is split between nodes and ways, The last node id is in the block numbered&amp;nbsp;598074&lt;/div&gt;
&lt;div&gt;
datafiles/598074/node_ids.bin&lt;/div&gt;
&lt;div&gt;
&lt;br /&gt;&lt;/div&gt;
&lt;div&gt;
The first way is located in block number&amp;nbsp;598075&lt;/div&gt;
&lt;div&gt;
datafiles/598075/way_ids.bin&lt;/div&gt;
&lt;div&gt;
&lt;br /&gt;&lt;/div&gt;
&lt;div&gt;
After that,&amp;nbsp;This bucket contains only ways :&amp;nbsp;xabub&lt;/div&gt;
&lt;div&gt;
&lt;a href=&quot;http://archive.org/details/fosm-20120401130001-xabub&quot;&gt;http://archive.org/details/fosm-20120401130001-xabub&lt;/a&gt;&lt;/div&gt;
&lt;div&gt;
&lt;br /&gt;&lt;/div&gt;
&lt;div&gt;
The first block that contains relations is: xacht&lt;/div&gt;
&lt;div&gt;
&lt;a href=&quot;http://archive.org/details/fosm-20120401130001-xacht&quot;&gt;http://archive.org/details/fosm-20120401130001-xacht&lt;/a&gt;&lt;/div&gt;
&lt;div&gt;
&lt;br /&gt;&lt;/div&gt;
&lt;div&gt;
The last node with way are :datafiles/776654/way_ids.bin&lt;/div&gt;
&lt;div&gt;
The first node with relations are here :&amp;nbsp;pine02/index/776704_i.tbz&lt;/div&gt;
&lt;div&gt;
&lt;br /&gt;&lt;/div&gt;
&lt;div&gt;
So, this is a basic layout. more to come.&lt;/div&gt;
&lt;div&gt;
&lt;br /&gt;&lt;/div&gt;
&lt;div&gt;
mike&lt;/div&gt;
&lt;/div&gt;</content><link rel='replies' type='application/atom+xml' href='http://osmopenlayers.blogspot.com/feeds/7130610889371484365/comments/default' title='Post Comments'/><link rel='replies' type='text/html' href='http://osmopenlayers.blogspot.com/2012/06/details-about-planet-buckets.html#comment-form' title='0 Comments'/><link rel='edit' type='application/atom+xml' href='http://www.blogger.com/feeds/1825393237232252749/posts/default/7130610889371484365'/><link rel='self' type='application/atom+xml' href='http://www.blogger.com/feeds/1825393237232252749/posts/default/7130610889371484365'/><link rel='alternate' type='text/html' href='http://osmopenlayers.blogspot.com/2012/06/details-about-planet-buckets.html' title='Details about the planet buckets'/><author><name>H4ck3rm1k3</name><uri>http://www.blogger.com/profile/04484528013589914857</uri><email>noreply@blogger.com</email><gd:image rel='http://schemas.google.com/g/2005#thumbnail' width='16' height='16' src='https://img1.blogblog.com/img/b16-rounded.gif'/></author><thr:total>0</thr:total></entry><entry><id>tag:blogger.com,1999:blog-1825393237232252749.post-3885379090557037256</id><published>2012-06-04T15:26:00.000-07:00</published><updated>2012-06-04T15:30:09.149-07:00</updated><title type='text'>Individual node id digit radix directories zip indexed files</title><content type='html'>&lt;div dir=&quot;ltr&quot; style=&quot;text-align: left;&quot; trbidi=&quot;on&quot;&gt;
Downloaded this data package of nodes :&lt;br /&gt;
&lt;a href=&quot;http://archive.org/details/fosm-20120401130001-xaaqw&quot;&gt;http://archive.org/details/fosm-20120401130001-xaaqw&lt;/a&gt;&lt;br /&gt;
&lt;br /&gt;
split the node data, each on one line already preprocessed, into node-id digit radix directories zip indexed files.&lt;br /&gt;
&lt;br /&gt;
this allows a lookup on the node id and getting one line of xml for that node.&lt;br /&gt;
&lt;br /&gt;
Here is an example :&lt;br /&gt;
&lt;a href=&quot;http://archive.org/details/fosm-20120401130001-node-id-xml&quot;&gt;http://archive.org/details/fosm-20120401130001-node-id-xml&lt;/a&gt;&lt;br /&gt;
&lt;br /&gt;
code :&lt;br /&gt;
https://github.com/h4ck3rm1k3/fosm-scraper-wiki/commit/6e632c7ed9c305e339a29ea6f49401ec64cc8184&lt;/div&gt;</content><link rel='replies' type='application/atom+xml' href='http://osmopenlayers.blogspot.com/feeds/3885379090557037256/comments/default' title='Post Comments'/><link rel='replies' type='text/html' href='http://osmopenlayers.blogspot.com/2012/06/individual-node-id-digit-radix.html#comment-form' title='0 Comments'/><link rel='edit' type='application/atom+xml' href='http://www.blogger.com/feeds/1825393237232252749/posts/default/3885379090557037256'/><link rel='self' type='application/atom+xml' href='http://www.blogger.com/feeds/1825393237232252749/posts/default/3885379090557037256'/><link rel='alternate' type='text/html' href='http://osmopenlayers.blogspot.com/2012/06/individual-node-id-digit-radix.html' title='Individual node id digit radix directories zip indexed files'/><author><name>H4ck3rm1k3</name><uri>http://www.blogger.com/profile/04484528013589914857</uri><email>noreply@blogger.com</email><gd:image rel='http://schemas.google.com/g/2005#thumbnail' width='16' height='16' src='https://img1.blogblog.com/img/b16-rounded.gif'/></author><thr:total>0</thr:total></entry><entry><id>tag:blogger.com,1999:blog-1825393237232252749.post-4248477930702025594</id><published>2012-06-02T22:08:00.001-07:00</published><updated>2012-06-02T22:08:30.324-07:00</updated><title type='text'>Large Zip file processing</title><content type='html'>&lt;div dir=&quot;ltr&quot; style=&quot;text-align: left;&quot; trbidi=&quot;on&quot;&gt;
&lt;br /&gt;
fighting the limitations of the file systems and memory on the task :&lt;br /&gt;
&amp;nbsp;&amp;nbsp;creating a directory structure that is a digit or radix tree of the numeric ids of the osm/fosm.&lt;br /&gt;
&lt;br /&gt;
in python i have not been able to manage creating the zip file. In perl it is also not easy to stream a zip file. We want to create the zip&amp;nbsp;incrementally.&lt;br /&gt;
&lt;br /&gt;
I am using these new modules, not in CPAN :&lt;br /&gt;
&lt;a href=&quot;https://github.com/jim-driscoll-hi/Archive--Zip--Streaming--Write&quot;&gt;https://github.com/jim-driscoll-hi/Archive--Zip--Streaming--Write&lt;/a&gt;&lt;br /&gt;
&lt;a href=&quot;https://github.com/jim-driscoll-hi/Archive--Zip--Build&quot;&gt;https://github.com/jim-driscoll-hi/Archive--Zip--Build&lt;/a&gt;&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
The python script&amp;nbsp;&lt;a href=&quot;https://github.com/h4ck3rm1k3/fosm-scraper-wiki/blob/master/fosm_index_proc_02.py&quot;&gt;https://github.com/h4ck3rm1k3/fosm-scraper-wiki/blob/master/fosm_index_proc_02.py&lt;/a&gt;&lt;br /&gt;
&lt;a href=&quot;https://github.com/h4ck3rm1k3/fosm-scraper-wiki/blob/master/fosm_index_proc_02.py&quot;&gt;&lt;/a&gt;downloads the fosm index from archive.org and interprets it.&lt;br /&gt;
The script produces a simple text file, and for each line we create a file in the zip archive.&lt;br /&gt;
&lt;br /&gt;
The perl script :&lt;br /&gt;
&lt;a href=&quot;https://github.com/h4ck3rm1k3/fosm-scraper-wiki/blob/master/streamzip.pl&quot;&gt;https://github.com/h4ck3rm1k3/fosm-scraper-wiki/blob/master/streamzip.pl&lt;/a&gt;&lt;br /&gt;
reads that file and produces a zip file and it runs with a stable memory profile of 1.7gb and uses 100% cpu.&lt;br /&gt;
&lt;br /&gt;
more to come.&lt;br /&gt;
&lt;br /&gt;
mike&lt;/div&gt;</content><link rel='replies' type='application/atom+xml' href='http://osmopenlayers.blogspot.com/feeds/4248477930702025594/comments/default' title='Post Comments'/><link rel='replies' type='text/html' href='http://osmopenlayers.blogspot.com/2012/06/large-zip-file-processing.html#comment-form' title='0 Comments'/><link rel='edit' type='application/atom+xml' href='http://www.blogger.com/feeds/1825393237232252749/posts/default/4248477930702025594'/><link rel='self' type='application/atom+xml' href='http://www.blogger.com/feeds/1825393237232252749/posts/default/4248477930702025594'/><link rel='alternate' type='text/html' href='http://osmopenlayers.blogspot.com/2012/06/large-zip-file-processing.html' title='Large Zip file processing'/><author><name>H4ck3rm1k3</name><uri>http://www.blogger.com/profile/04484528013589914857</uri><email>noreply@blogger.com</email><gd:image rel='http://schemas.google.com/g/2005#thumbnail' width='16' height='16' src='https://img1.blogblog.com/img/b16-rounded.gif'/></author><thr:total>0</thr:total></entry><entry><id>tag:blogger.com,1999:blog-1825393237232252749.post-7162476695488180712</id><published>2012-06-02T06:48:00.000-07:00</published><updated>2012-06-02T06:48:22.498-07:00</updated><title type='text'>Example of merging indexes</title><content type='html'>&lt;div dir=&quot;ltr&quot; style=&quot;text-align: left;&quot; trbidi=&quot;on&quot;&gt;
&lt;br /&gt;
So the new schema is to create a directory structure in a zip file, and store that on achive.org. It will allow for you to look up the data for a node with a single get, and push the hash/index work into the archive.org. Basically we create a directory and file like this :&lt;br /&gt;
1/4/4/5/5/9/2/7/6/5/data.txt&lt;br /&gt;
&lt;br /&gt;
for the node id&amp;nbsp;&lt;span class=&quot;Apple-style-span&quot; style=&quot;font-family: monospace; white-space: pre-wrap;&quot;&gt;1445592765&lt;/span&gt;&lt;br /&gt;
I created an example of the zip file, containing only the items starting with 1,&lt;br /&gt;
&lt;br /&gt;
The zip file&lt;br /&gt;
&lt;a href=&quot;http://archive.org/download/fosm-20120401130001-node-index/mnt%252Ftarget%252Fnode_index%252Fnode_index1.zip&quot;&gt;http://archive.org/download/fosm-20120401130001-node-index/mnt%252Ftarget%252Fnode_index%252Fnode_index1.zip&lt;/a&gt;&lt;br /&gt;
&lt;br /&gt;
Which resolves to :&lt;br /&gt;
&lt;a href=&quot;http://ia600609.us.archive.org/zipview.php?zip=/27/items/fosm-20120401130001-node-index/mnt%252Ftarget%252Fnode_index%252Fnode_index1.zip&amp;amp;file=mnt/target/index/1/4/4/5/5/9/2/7/6/5/data.txt&quot;&gt;http://ia600609.us.archive.org/zipview.php?zip=/27/items/fosm-20120401130001-node-index/mnt%252Ftarget%252Fnode_index%252Fnode_index1.zip&amp;amp;file=mnt/target/index/1/4/4/5/5/9/2/7/6/5/data.txt&lt;/a&gt;&lt;br /&gt;
&lt;br /&gt;
example data: from the bucket&amp;nbsp;&lt;span class=&quot;Apple-style-span&quot; style=&quot;font-family: monospace; white-space: pre-wrap;&quot;&gt;xaaac, from the block&amp;nbsp;&lt;/span&gt;&lt;span class=&quot;Apple-style-span&quot; style=&quot;font-family: monospace; white-space: pre-wrap;&quot;&gt;001031&lt;/span&gt;&lt;br /&gt;
&lt;span class=&quot;Apple-style-span&quot; style=&quot;font-family: monospace; white-space: pre-wrap;&quot;&gt;&lt;/span&gt;&lt;span class=&quot;Apple-style-span&quot; style=&quot;font-family: monospace; white-space: pre-wrap;&quot;&gt;the node id &lt;/span&gt;&lt;span class=&quot;Apple-style-span&quot; style=&quot;font-family: monospace; white-space: pre-wrap;&quot;&gt;1445592765 has the position in that index file&amp;nbsp;&lt;/span&gt;&lt;span class=&quot;Apple-style-span&quot; style=&quot;font-family: monospace; white-space: pre-wrap;&quot;&gt;3604&lt;/span&gt;&lt;span class=&quot;Apple-style-span&quot; style=&quot;font-family: monospace; white-space: pre-wrap;&quot;&gt; &lt;/span&gt;&lt;br /&gt;
&lt;br /&gt;
&lt;pre style=&quot;white-space: pre-wrap; word-wrap: break-word;&quot;&gt;cache/xaaac,xaaac,datafiles/001031/node_ids.bin,3604,1445592765&lt;/pre&gt;
&lt;pre style=&quot;white-space: pre-wrap; word-wrap: break-word;&quot;&gt;
&lt;/pre&gt;
&lt;pre style=&quot;white-space: pre-wrap; word-wrap: break-word;&quot;&gt;So that data would be located :&lt;/pre&gt;
&lt;pre style=&quot;word-wrap: break-word;&quot;&gt;&lt;span class=&quot;Apple-style-span&quot; style=&quot;white-space: pre-wrap;&quot;&gt;&lt;a href=&quot;http://archive.org/download/fosm-20120401130001-xaaac/xaaac.zip&quot;&gt;http://archive.org/download/fosm-20120401130001-xaaac/xaaac.zip&lt;/a&gt;&lt;/span&gt;&lt;/pre&gt;
&lt;pre style=&quot;word-wrap: break-word;&quot;&gt;&lt;span class=&quot;Apple-style-span&quot; style=&quot;white-space: pre-wrap;&quot;&gt;
&lt;/span&gt;&lt;/pre&gt;
&lt;pre style=&quot;word-wrap: break-word;&quot;&gt;&lt;span class=&quot;Apple-style-span&quot; style=&quot;white-space: pre-wrap;&quot;&gt;in the file : &lt;/span&gt;&lt;span class=&quot;Apple-style-span&quot; style=&quot;white-space: pre-wrap;&quot;&gt;001031.tbz, and that could be extracted directly from the zip.&lt;/span&gt;&lt;/pre&gt;
&lt;pre style=&quot;word-wrap: break-word;&quot;&gt;&lt;span class=&quot;Apple-style-span&quot; style=&quot;white-space: pre-wrap;&quot;&gt;
&lt;/span&gt;&lt;/pre&gt;
&lt;pre style=&quot;word-wrap: break-word;&quot;&gt;&lt;span class=&quot;Apple-style-span&quot; style=&quot;white-space: pre-wrap;&quot;&gt;
&lt;/span&gt;&lt;/pre&gt;
&lt;pre style=&quot;word-wrap: break-word;&quot;&gt;&lt;span class=&quot;Apple-style-span&quot; style=&quot;white-space: pre-wrap;&quot;&gt;I am redoing the zip files and will be uploading the full index soon.&lt;/span&gt;&lt;/pre&gt;
&lt;pre style=&quot;word-wrap: break-word;&quot;&gt;&lt;span class=&quot;Apple-style-span&quot; style=&quot;white-space: pre-wrap;&quot;&gt;
&lt;/span&gt;&lt;/pre&gt;
&lt;pre style=&quot;word-wrap: break-word;&quot;&gt;&lt;span class=&quot;Apple-style-span&quot; style=&quot;white-space: pre-wrap;&quot;&gt;mike&lt;/span&gt;&lt;/pre&gt;
&lt;/div&gt;</content><link rel='replies' type='application/atom+xml' href='http://osmopenlayers.blogspot.com/feeds/7162476695488180712/comments/default' title='Post Comments'/><link rel='replies' type='text/html' href='http://osmopenlayers.blogspot.com/2012/06/example-of-merging-indexes.html#comment-form' title='0 Comments'/><link rel='edit' type='application/atom+xml' href='http://www.blogger.com/feeds/1825393237232252749/posts/default/7162476695488180712'/><link rel='self' type='application/atom+xml' href='http://www.blogger.com/feeds/1825393237232252749/posts/default/7162476695488180712'/><link rel='alternate' type='text/html' href='http://osmopenlayers.blogspot.com/2012/06/example-of-merging-indexes.html' title='Example of merging indexes'/><author><name>H4ck3rm1k3</name><uri>http://www.blogger.com/profile/04484528013589914857</uri><email>noreply@blogger.com</email><gd:image rel='http://schemas.google.com/g/2005#thumbnail' width='16' height='16' src='https://img1.blogblog.com/img/b16-rounded.gif'/></author><thr:total>0</thr:total></entry><entry><id>tag:blogger.com,1999:blog-1825393237232252749.post-1193903894178777640</id><published>2012-05-17T12:55:00.000-07:00</published><updated>2012-05-17T12:55:16.677-07:00</updated><title type='text'>upload finished!!!!</title><content type='html'>&lt;div dir=&quot;ltr&quot; style=&quot;text-align: left;&quot; trbidi=&quot;on&quot;&gt;
&lt;span class=&quot;Apple-style-span&quot; style=&quot;background-color: rgba(255, 255, 255, 0.917969); color: #222222; font-family: arial, sans-serif; font-size: 13px;&quot;&gt;after the tips on how to speed up the uploads to&amp;nbsp;&lt;/span&gt;&lt;a href=&quot;http://archive.org/&quot; style=&quot;background-color: rgba(255, 255, 255, 0.917969); color: #1155cc; font-family: arial, sans-serif; font-size: 13px; text-align: -webkit-auto;&quot; target=&quot;_blank&quot;&gt;archive.org&lt;/a&gt;&lt;span class=&quot;Apple-style-span&quot; style=&quot;background-color: rgba(255, 255, 255, 0.917969); color: #222222; font-family: arial, sans-serif; font-size: 13px; text-align: -webkit-auto;&quot;&gt;, the uploads&lt;/span&gt;&lt;br style=&quot;background-color: rgba(255, 255, 255, 0.917969); color: #222222; font-family: arial, sans-serif; font-size: 13px; text-align: -webkit-auto;&quot; /&gt;&lt;span class=&quot;Apple-style-span&quot; style=&quot;background-color: rgba(255, 255, 255, 0.917969); color: #222222; font-family: arial, sans-serif; font-size: 13px; text-align: -webkit-auto;&quot;&gt;finished today in record time.&lt;/span&gt;&lt;br style=&quot;background-color: rgba(255, 255, 255, 0.917969); color: #222222; font-family: arial, sans-serif; font-size: 13px; text-align: -webkit-auto;&quot; /&gt;&lt;span class=&quot;Apple-style-span&quot; style=&quot;background-color: rgba(255, 255, 255, 0.917969); color: #222222; font-family: arial, sans-serif; font-size: 13px; text-align: -webkit-auto;&quot;&gt;we now have the full planet file in 1500 buckets of 500 files each.&lt;/span&gt;&lt;br style=&quot;background-color: rgba(255, 255, 255, 0.917969); color: #222222; font-family: arial, sans-serif; font-size: 13px; text-align: -webkit-auto;&quot; /&gt;&lt;br style=&quot;background-color: rgba(255, 255, 255, 0.917969); color: #222222; font-family: arial, sans-serif; font-size: 13px; text-align: -webkit-auto;&quot; /&gt;&lt;span class=&quot;Apple-style-span&quot; style=&quot;background-color: rgba(255, 255, 255, 0.917969); color: #222222; font-family: arial, sans-serif; font-size: 13px; text-align: -webkit-auto;&quot;&gt;starting with&lt;/span&gt;&lt;br style=&quot;background-color: rgba(255, 255, 255, 0.917969); color: #222222; font-family: arial, sans-serif; font-size: 13px; text-align: -webkit-auto;&quot; /&gt;&lt;a href=&quot;http://archive.org/details/fosm-20120401130001-xaaaa&quot; style=&quot;background-color: rgba(255, 255, 255, 0.917969); color: #1155cc; font-family: arial, sans-serif; font-size: 13px; text-align: -webkit-auto;&quot; target=&quot;_blank&quot;&gt;http://archive.org/details/&lt;wbr&gt;&lt;/wbr&gt;fosm-20120401130001-xaaaa&lt;/a&gt;&lt;br style=&quot;background-color: rgba(255, 255, 255, 0.917969); color: #222222; font-family: arial, sans-serif; font-size: 13px; text-align: -webkit-auto;&quot; /&gt;&lt;br style=&quot;background-color: rgba(255, 255, 255, 0.917969); color: #222222; font-family: arial, sans-serif; font-size: 13px; text-align: -webkit-auto;&quot; /&gt;&lt;span class=&quot;Apple-style-span&quot; style=&quot;background-color: rgba(255, 255, 255, 0.917969); color: #222222; font-family: arial, sans-serif; font-size: 13px; text-align: -webkit-auto;&quot;&gt;and ending with&lt;/span&gt;&lt;br style=&quot;background-color: rgba(255, 255, 255, 0.917969); color: #222222; font-family: arial, sans-serif; font-size: 13px; text-align: -webkit-auto;&quot; /&gt;&lt;a href=&quot;http://archive.org/details/fosm-20120401130001-xachy&quot; style=&quot;background-color: rgba(255, 255, 255, 0.917969); color: #1155cc; font-family: arial, sans-serif; font-size: 13px; text-align: -webkit-auto;&quot; target=&quot;_blank&quot;&gt;http://archive.org/details/&lt;wbr&gt;&lt;/wbr&gt;fosm-20120401130001-xachy&lt;/a&gt;&lt;br style=&quot;background-color: rgba(255, 255, 255, 0.917969); color: #222222; font-family: arial, sans-serif; font-size: 13px; text-align: -webkit-auto;&quot; /&gt;&lt;br style=&quot;background-color: rgba(255, 255, 255, 0.917969); color: #222222; font-family: arial, sans-serif; font-size: 13px; text-align: -webkit-auto;&quot; /&gt;&lt;span class=&quot;Apple-style-span&quot; style=&quot;background-color: rgba(255, 255, 255, 0.917969); color: #222222; font-family: arial, sans-serif; font-size: 13px; text-align: -webkit-auto;&quot;&gt;I am now reprocessing the existing first 300 files to put the in the&lt;/span&gt;&lt;br style=&quot;background-color: rgba(255, 255, 255, 0.917969); color: #222222; font-family: arial, sans-serif; font-size: 13px; text-align: -webkit-auto;&quot; /&gt;&lt;span class=&quot;Apple-style-span&quot; style=&quot;background-color: rgba(255, 255, 255, 0.917969); color: #222222; font-family: arial, sans-serif; font-size: 13px; text-align: -webkit-auto;&quot;&gt;same format(starting with xaaaa and ending with&lt;/span&gt;&lt;br style=&quot;background-color: rgba(255, 255, 255, 0.917969); color: #222222; font-family: arial, sans-serif; font-size: 13px; text-align: -webkit-auto;&quot; /&gt;&lt;a href=&quot;http://archive.org/details/fosm-20120401130001-xaapi&quot; style=&quot;background-color: rgba(255, 255, 255, 0.917969); color: #1155cc; font-family: arial, sans-serif; font-size: 13px; text-align: -webkit-auto;&quot; target=&quot;_blank&quot;&gt;http://archive.org/details/&lt;wbr&gt;&lt;/wbr&gt;fosm-20120401130001-xaapi&lt;/a&gt;&lt;span class=&quot;Apple-style-span&quot; style=&quot;background-color: rgba(255, 255, 255, 0.917969); color: #222222; font-family: arial, sans-serif; font-size: 13px; text-align: -webkit-auto;&quot;&gt;)&lt;/span&gt;&lt;br style=&quot;background-color: rgba(255, 255, 255, 0.917969); color: #222222; font-family: arial, sans-serif; font-size: 13px; text-align: -webkit-auto;&quot; /&gt;&lt;span class=&quot;Apple-style-span&quot; style=&quot;background-color: rgba(255, 255, 255, 0.917969); color: #222222; font-family: arial, sans-serif; font-size: 13px; text-align: -webkit-auto;&quot;&gt;that should go fast!&lt;/span&gt;&lt;br style=&quot;background-color: rgba(255, 255, 255, 0.917969); color: #222222; font-family: arial, sans-serif; font-size: 13px; text-align: -webkit-auto;&quot; /&gt;&lt;br style=&quot;background-color: rgba(255, 255, 255, 0.917969); color: #222222; font-family: arial, sans-serif; font-size: 13px; text-align: -webkit-auto;&quot; /&gt;&lt;span class=&quot;Apple-style-span&quot; style=&quot;background-color: rgba(255, 255, 255, 0.917969); color: #222222; font-family: arial, sans-serif; font-size: 13px; text-align: -webkit-auto;&quot;&gt;I am happy, next step is to load all the node id index files from the&lt;/span&gt;&lt;br style=&quot;background-color: rgba(255, 255, 255, 0.917969); color: #222222; font-family: arial, sans-serif; font-size: 13px; text-align: -webkit-auto;&quot; /&gt;&lt;span class=&quot;Apple-style-span&quot; style=&quot;background-color: rgba(255, 255, 255, 0.917969); color: #222222; font-family: arial, sans-serif; font-size: 13px; text-align: -webkit-auto;&quot;&gt;_index.zip and create a master index, the idea is to create a redblack&lt;/span&gt;&lt;br style=&quot;background-color: rgba(255, 255, 255, 0.917969); color: #222222; font-family: arial, sans-serif; font-size: 13px; text-align: -webkit-auto;&quot; /&gt;&lt;span class=&quot;Apple-style-span&quot; style=&quot;background-color: rgba(255, 255, 255, 0.917969); color: #222222; font-family: arial, sans-serif; font-size: 13px; text-align: -webkit-auto;&quot;&gt;binary tree to store the entire search index, these index pages again&lt;/span&gt;&lt;br style=&quot;background-color: rgba(255, 255, 255, 0.917969); color: #222222; font-family: arial, sans-serif; font-size: 13px; text-align: -webkit-auto;&quot; /&gt;&lt;span class=&quot;Apple-style-span&quot; style=&quot;background-color: rgba(255, 255, 255, 0.917969); color: #222222; font-family: arial, sans-serif; font-size: 13px; text-align: -webkit-auto;&quot;&gt;will be split into buckets but will be json files to load the search&lt;/span&gt;&lt;br style=&quot;background-color: rgba(255, 255, 255, 0.917969); color: #222222; font-family: arial, sans-serif; font-size: 13px; text-align: -webkit-auto;&quot; /&gt;&lt;span class=&quot;Apple-style-span&quot; style=&quot;background-color: rgba(255, 255, 255, 0.917969); color: #222222; font-family: arial, sans-serif; font-size: 13px; text-align: -webkit-auto;&quot;&gt;tree on demand, that way the search can be done without a server, only&lt;/span&gt;&lt;br style=&quot;background-color: rgba(255, 255, 255, 0.917969); color: #222222; font-family: arial, sans-serif; font-size: 13px; text-align: -webkit-auto;&quot; /&gt;&lt;span class=&quot;Apple-style-span&quot; style=&quot;background-color: rgba(255, 255, 255, 0.917969); color: #222222; font-family: arial, sans-serif; font-size: 13px; text-align: -webkit-auto;&quot;&gt;with http clients and javascript!&lt;/span&gt;&lt;br style=&quot;background-color: rgba(255, 255, 255, 0.917969); color: #222222; font-family: arial, sans-serif; font-size: 13px; text-align: -webkit-auto;&quot; /&gt;&lt;br style=&quot;background-color: rgba(255, 255, 255, 0.917969); color: #222222; font-family: arial, sans-serif; font-size: 13px; text-align: -webkit-auto;&quot; /&gt;&lt;span class=&quot;Apple-style-span&quot; style=&quot;background-color: rgba(255, 255, 255, 0.917969); color: #222222; font-family: arial, sans-serif; font-size: 13px; text-align: -webkit-auto;&quot;&gt;I wonder if we can get some javascript client to&amp;nbsp;&lt;/span&gt;&lt;a href=&quot;http://archive.org/&quot; style=&quot;background-color: rgba(255, 255, 255, 0.917969); color: #1155cc; font-family: arial, sans-serif; font-size: 13px; text-align: -webkit-auto;&quot; target=&quot;_blank&quot;&gt;archive.org&lt;/a&gt;&lt;span class=&quot;Apple-style-span&quot; style=&quot;background-color: rgba(255, 255, 255, 0.917969); color: #222222; font-family: arial, sans-serif; font-size: 13px; text-align: -webkit-auto;&quot;&gt;&amp;nbsp;to work&lt;/span&gt;&lt;br style=&quot;background-color: rgba(255, 255, 255, 0.917969); color: #222222; font-family: arial, sans-serif; font-size: 13px; text-align: -webkit-auto;&quot; /&gt;&lt;span class=&quot;Apple-style-span&quot; style=&quot;background-color: rgba(255, 255, 255, 0.917969); color: #222222; font-family: arial, sans-serif; font-size: 13px; text-align: -webkit-auto;&quot;&gt;so users can upload files to thier own buckets containing the edits?&lt;/span&gt;&lt;br style=&quot;background-color: rgba(255, 255, 255, 0.917969); color: #222222; font-family: arial, sans-serif; font-size: 13px; text-align: -webkit-auto;&quot; /&gt;&lt;a href=&quot;https://github.com/blueimp/jQuery-File-Upload/wiki/Upload-directly-to-S3&quot; style=&quot;background-color: rgba(255, 255, 255, 0.917969); color: #1155cc; font-family: arial, sans-serif; font-size: 13px; text-align: -webkit-auto;&quot; target=&quot;_blank&quot;&gt;https://github.com/blueimp/&lt;wbr&gt;&lt;/wbr&gt;jQuery-File-Upload/wiki/&lt;wbr&gt;&lt;/wbr&gt;Upload-directly-to-S3&lt;/a&gt;&lt;br style=&quot;background-color: rgba(255, 255, 255, 0.917969); color: #222222; font-family: arial, sans-serif; font-size: 13px; text-align: -webkit-auto;&quot; /&gt;&lt;br style=&quot;background-color: rgba(255, 255, 255, 0.917969); color: #222222; font-family: arial, sans-serif; font-size: 13px; text-align: -webkit-auto;&quot; /&gt;&lt;span class=&quot;Apple-style-span&quot; style=&quot;background-color: rgba(255, 255, 255, 0.917969); color: #222222; font-family: arial, sans-serif; font-size: 13px; text-align: -webkit-auto;&quot;&gt;is is possible to add a file to a zip file or do we always have to&lt;/span&gt;&lt;br style=&quot;background-color: rgba(255, 255, 255, 0.917969); color: #222222; font-family: arial, sans-serif; font-size: 13px; text-align: -webkit-auto;&quot; /&gt;&lt;span class=&quot;Apple-style-span&quot; style=&quot;background-color: rgba(255, 255, 255, 0.917969); color: #222222; font-family: arial, sans-serif; font-size: 13px; text-align: -webkit-auto;&quot;&gt;upload the entire new file?&lt;/span&gt;&lt;/div&gt;</content><link rel='replies' type='application/atom+xml' href='http://osmopenlayers.blogspot.com/feeds/1193903894178777640/comments/default' title='Post Comments'/><link rel='replies' type='text/html' href='http://osmopenlayers.blogspot.com/2012/05/upload-finished.html#comment-form' title='1 Comments'/><link rel='edit' type='application/atom+xml' href='http://www.blogger.com/feeds/1825393237232252749/posts/default/1193903894178777640'/><link rel='self' type='application/atom+xml' href='http://www.blogger.com/feeds/1825393237232252749/posts/default/1193903894178777640'/><link rel='alternate' type='text/html' href='http://osmopenlayers.blogspot.com/2012/05/upload-finished.html' title='upload finished!!!!'/><author><name>H4ck3rm1k3</name><uri>http://www.blogger.com/profile/04484528013589914857</uri><email>noreply@blogger.com</email><gd:image rel='http://schemas.google.com/g/2005#thumbnail' width='16' height='16' src='https://img1.blogblog.com/img/b16-rounded.gif'/></author><thr:total>1</thr:total></entry><entry><id>tag:blogger.com,1999:blog-1825393237232252749.post-6163417635241106819</id><published>2012-05-17T02:50:00.000-07:00</published><updated>2012-05-17T12:38:48.103-07:00</updated><category scheme="http://www.blogger.com/atom/ns#" term="archive.org"/><category scheme="http://www.blogger.com/atom/ns#" term="fosm_maps"/><category scheme="http://www.blogger.com/atom/ns#" term="osm"/><title type='text'>Updated bucket format and indexing status</title><content type='html'>&lt;div dir=&quot;ltr&quot; style=&quot;text-align: left;&quot; trbidi=&quot;on&quot;&gt;
&lt;span class=&quot;Apple-style-span&quot; style=&quot;font-family: arial; font-size: x-small;&quot;&gt;&lt;br /&gt;&lt;/span&gt;&lt;br /&gt;
&lt;span class=&quot;Apple-style-span&quot; style=&quot;font-family: arial; font-size: x-small;&quot;&gt;here is my updated put script,&lt;/span&gt;&lt;br /&gt;
&lt;div style=&quot;font-family: arial; font-size: small; text-align: -webkit-auto;&quot;&gt;
&lt;a href=&quot;https://github.com/h4ck3rm1k3/s3cmd-modification/blob/master/putzip.sh&quot;&gt;https://github.com/h4ck3rm1k3/s3cmd-modification/blob/master/putzip.sh&lt;/a&gt;&lt;/div&gt;
&lt;div style=&quot;font-family: arial; font-size: small; text-align: -webkit-auto;&quot;&gt;
&lt;br /&gt;&lt;/div&gt;
&lt;div style=&quot;font-family: arial; font-size: small; text-align: -webkit-auto;&quot;&gt;
it creates a zip with -0, because the files are bzip2 already and then puts that with the no derive header.&lt;/div&gt;
&lt;div style=&quot;font-family: arial; font-size: small; text-align: -webkit-auto;&quot;&gt;
(&lt;span class=&quot;Apple-style-span&quot; style=&quot;background-color: white; color: #dd1144; font-family: &#39;Bitstream Vera Sans Mono&#39;, Courier, monospace; font-size: 12px; line-height: 16px; white-space: pre;&quot;&gt;--add-header=x-archive-queue-derive:0&lt;/span&gt;)&lt;/div&gt;
&lt;div style=&quot;font-family: arial; font-size: small; text-align: -webkit-auto;&quot;&gt;
Also i split the index and data files into two zips.&lt;/div&gt;
&lt;div style=&quot;font-family: arial; font-size: small; text-align: -webkit-auto;&quot;&gt;
&lt;br /&gt;&lt;/div&gt;
&lt;div style=&quot;font-family: arial; font-size: small; text-align: -webkit-auto;&quot;&gt;
I can access the individuals like this :&lt;/div&gt;
&lt;div style=&quot;font-family: arial; font-size: small; text-align: -webkit-auto;&quot;&gt;
&lt;a href=&quot;http://ia601203.us.archive.org/zipview.php?zip=/5/items/fosm-20120401130001-xaapj/xaapj.zip&amp;amp;file=pine02/index/199501.tbz&quot;&gt;http://ia601203.us.archive.org/zipview.php?zip=/5/items/fosm-20120401130001-xaapj/xaapj.zip&amp;amp;file=pine02/index/199501.tbz&lt;/a&gt;&lt;/div&gt;
&lt;div style=&quot;font-family: arial; font-size: small; text-align: -webkit-auto;&quot;&gt;
&lt;br /&gt;&lt;/div&gt;
&lt;div style=&quot;font-family: arial; font-size: small; text-align: -webkit-auto;&quot;&gt;
Or like this as a shortcut without the server name &amp;nbsp;(this takes more resources)&lt;/div&gt;
&lt;a href=&quot;http://archive.org/download/fosm-20120401130001-xaapj/xaapj.zip/pine02/index/199501.tbz&quot;&gt;http://archive.org/download/fosm-20120401130001-xaapj/xaapj.zip/pine02/index/199501.tbz&lt;/a&gt;&lt;br /&gt;
&lt;div style=&quot;text-align: -webkit-auto;&quot;&gt;
&lt;br /&gt;&lt;/div&gt;
&lt;div style=&quot;font-family: arial; font-size: small; text-align: -webkit-auto;&quot;&gt;
The upload, it is running now and very fast!&lt;/div&gt;
&lt;div style=&quot;font-family: arial; font-size: small; text-align: -webkit-auto;&quot;&gt;
&lt;br /&gt;&lt;/div&gt;
&lt;div style=&quot;font-family: arial; font-size: small; text-align: -webkit-auto;&quot;&gt;
You can see an example new bucket here :&lt;/div&gt;
&lt;div style=&quot;font-family: arial; font-size: small; text-align: -webkit-auto;&quot;&gt;
&lt;a href=&quot;http://archive.org/details/fosm-20120401130001-xaapj&quot;&gt;http://archive.org/details/fosm-20120401130001-xaapj&lt;/a&gt;&lt;/div&gt;
&lt;div style=&quot;font-family: arial; font-size: small; text-align: -webkit-auto;&quot;&gt;
&lt;br /&gt;&lt;/div&gt;
&lt;div style=&quot;font-family: arial; font-size: small; text-align: -webkit-auto;&quot;&gt;
The file&amp;nbsp;http://archive.org/download/fosm-20120401130001-xaapj/xaapj.txt contains a list of all the files,&lt;/div&gt;
&lt;div style=&quot;font-family: arial; font-size: small; text-align: -webkit-auto;&quot;&gt;
they are all located on /pine02/index/$filename in the zip, if they end in _i.tbz the land in the index.zip&amp;nbsp;&lt;/div&gt;
&lt;div style=&quot;font-family: arial; font-size: small; text-align: -webkit-auto;&quot;&gt;
http://archive.org/download/fosm-20120401130001-xaapj/xaapj_index.zip&lt;/div&gt;
&lt;div style=&quot;font-family: arial; font-size: small; text-align: -webkit-auto;&quot;&gt;
&lt;br /&gt;&lt;/div&gt;
&lt;div style=&quot;font-family: arial; font-size: small; text-align: -webkit-auto;&quot;&gt;
&amp;nbsp;otherwise the data zip http://archive.org/download/fosm-20120401130001-xaapj/xaapj.zip.&amp;nbsp;&lt;/div&gt;
&lt;div style=&quot;font-family: arial; font-size: small; text-align: -webkit-auto;&quot;&gt;
&lt;br /&gt;&lt;/div&gt;
&lt;div style=&quot;font-family: arial; font-size: small; text-align: -webkit-auto;&quot;&gt;
&lt;span class=&quot;Apple-style-span&quot; style=&quot;font-family: arial; font-size: x-small;&quot;&gt;The buckets in the old format of individual files are&amp;nbsp;&lt;/span&gt;xaaa-&amp;nbsp;xaapi and make up&amp;nbsp;&amp;nbsp; &amp;nbsp; 399 files.&lt;/div&gt;
&lt;div style=&quot;font-family: arial; font-size: small; text-align: -webkit-auto;&quot;&gt;
The files in the new format start with xaapi and there are&amp;nbsp;&amp;nbsp; 21 done and&amp;nbsp;1139 to go,&lt;/div&gt;
&lt;div style=&quot;font-family: arial; font-size: small; text-align: -webkit-auto;&quot;&gt;
&lt;br /&gt;&lt;/div&gt;
&lt;div style=&quot;font-family: arial; font-size: small; text-align: -webkit-auto;&quot;&gt;
thanks to the archive.org team for help and support!&lt;/div&gt;
&lt;div style=&quot;font-family: arial; font-size: small; text-align: -webkit-auto;&quot;&gt;
&lt;br /&gt;&lt;/div&gt;
&lt;div style=&quot;font-family: arial; font-size: small; text-align: -webkit-auto;&quot;&gt;
Also note that I found the last block of the indexer and was able to recover the data so this upload will contain the entire planet file, for some reason the final block was truncated during indexing, but it is fixed.&lt;/div&gt;
&lt;div style=&quot;font-family: arial; font-size: small; text-align: -webkit-auto;&quot;&gt;
it is here&amp;nbsp;&lt;a href=&quot;http://ia600202.us.archive.org/2/items/fosm-20120401130001-xachy/&quot;&gt;http://ia600202.us.archive.org/2/items/fosm-20120401130001-xachy/&lt;/a&gt;&lt;br /&gt;
in the zip file :&amp;nbsp;&lt;a href=&quot;http://ia600202.us.archive.org/2/items/fosm-20120401130001-xachy/lastbucket.zip&quot;&gt;http://ia600202.us.archive.org/2/items/fosm-20120401130001-xachy/lastbucket.zip&lt;/a&gt;&lt;/div&gt;
&lt;div style=&quot;font-family: arial; font-size: small; text-align: -webkit-auto;&quot;&gt;
mike&lt;/div&gt;
&lt;div style=&quot;text-align: -webkit-auto;&quot;&gt;
&lt;div&gt;
&lt;span class=&quot;Apple-style-span&quot; style=&quot;font-family: arial; font-size: x-small;&quot;&gt;&lt;br /&gt;&lt;/span&gt;&lt;/div&gt;
&lt;div style=&quot;font-family: arial; font-size: small;&quot;&gt;
&lt;br /&gt;&lt;/div&gt;
&lt;/div&gt;
&lt;/div&gt;</content><link rel='replies' type='application/atom+xml' href='http://osmopenlayers.blogspot.com/feeds/6163417635241106819/comments/default' title='Post Comments'/><link rel='replies' type='text/html' href='http://osmopenlayers.blogspot.com/2012/05/updated-bucket-format-and-indexing.html#comment-form' title='0 Comments'/><link rel='edit' type='application/atom+xml' href='http://www.blogger.com/feeds/1825393237232252749/posts/default/6163417635241106819'/><link rel='self' type='application/atom+xml' href='http://www.blogger.com/feeds/1825393237232252749/posts/default/6163417635241106819'/><link rel='alternate' type='text/html' href='http://osmopenlayers.blogspot.com/2012/05/updated-bucket-format-and-indexing.html' title='Updated bucket format and indexing status'/><author><name>H4ck3rm1k3</name><uri>http://www.blogger.com/profile/04484528013589914857</uri><email>noreply@blogger.com</email><gd:image rel='http://schemas.google.com/g/2005#thumbnail' width='16' height='16' src='https://img1.blogblog.com/img/b16-rounded.gif'/></author><thr:total>0</thr:total></entry><entry><id>tag:blogger.com,1999:blog-1825393237232252749.post-6055100775719954737</id><published>2012-05-05T23:51:00.000-07:00</published><updated>2012-05-05T23:51:22.476-07:00</updated><title type='text'>Indexing of the blocks</title><content type='html'>&lt;div dir=&quot;ltr&quot; style=&quot;text-align: left;&quot; trbidi=&quot;on&quot;&gt;
I have done an experiment on the indexing of the blocks of data extract.&lt;br /&gt;
First of all, lets remember, we have a 350gb file, it was processed by my scanner, and split up into blocks of data. each block is put into a file, and 500 files go into a bucket. The bucket also contains the index files.&lt;br /&gt;
&lt;br /&gt;
The basic idea is that we have buckets of 500 index files from the previous processing of the planet file.&lt;br /&gt;
&lt;br /&gt;
We extract all those indexes from a bucket and create an index that says what id occurs in what block and at what position in that index (the object count). the position is not really useful right now because it is not the byte position in the bzip file, but we will keep it for now and update this later.&lt;br /&gt;
&lt;br /&gt;
The input is&amp;nbsp;&lt;img alt=&quot;[TXT]&quot; src=&quot;http://pine02.fosm.org/icons/text.gif&quot; /&gt;&lt;a href=&quot;http://pine02.fosm.org/index2/total.txt&quot;&gt;total.txt&lt;/a&gt;05-May-2012 22:19   19M ,it is a sorted list of node ids in the first bucket.&lt;br /&gt;
&lt;br /&gt;
The splitter script&amp;nbsp;&lt;img alt=&quot;[TXT]&quot; src=&quot;http://pine02.fosm.org/icons/text.gif&quot; /&gt;&lt;a href=&quot;http://pine02.fosm.org/index2/split.pl&quot;&gt;split.pl&lt;/a&gt;&amp;nbsp;is what creates the master index for that block.&lt;br /&gt;
&lt;a href=&quot;http://pine02.fosm.org/index2/split.pl&quot;&gt;http://pine02.fosm.org/index2/split.pl&lt;/a&gt;&lt;br /&gt;
&lt;br /&gt;
Each row of data contains something like this :&lt;div&gt;
NODE ID, Block Number, &amp;nbsp;Position&lt;br /&gt;&lt;blockquote class=&quot;tr_bq&quot;&gt;
25783809&lt;span class=&quot;Apple-tab-span&quot; style=&quot;white-space: pre;&quot;&gt; &lt;/span&gt;000254&lt;span class=&quot;Apple-tab-span&quot; style=&quot;white-space: pre;&quot;&gt; &lt;/span&gt;1009&lt;br /&gt;25783830&lt;span class=&quot;Apple-tab-span&quot; style=&quot;white-space: pre;&quot;&gt; &lt;/span&gt;000254&lt;span class=&quot;Apple-tab-span&quot; style=&quot;white-space: pre;&quot;&gt; &lt;/span&gt;1143&lt;br /&gt;25783842&lt;span class=&quot;Apple-tab-span&quot; style=&quot;white-space: pre;&quot;&gt; &lt;/span&gt;000254&lt;span class=&quot;Apple-tab-span&quot; style=&quot;white-space: pre;&quot;&gt; &lt;/span&gt;698&lt;/blockquote&gt;
&lt;div&gt;
&lt;br /&gt;&lt;/div&gt;
The index for that bucket is (bz2):&amp;nbsp;&lt;a href=&quot;http://pine02.fosm.org/index2/fosm-20120401130001-idx-xaaaa.txt.bz2&quot;&gt;fosm-20120401130001-idx-xaaaa.txt.bz2&lt;/a&gt;&amp;nbsp;&lt;/div&gt;
&lt;div&gt;
it contains all the files in there, so you can quickly search for what interval it is in.&lt;br /&gt;&lt;br /&gt;
Here is my experimental put script :&amp;nbsp;&lt;a href=&quot;http://pine02.fosm.org/index2/put.sh&quot;&gt;put.sh&lt;/a&gt;&lt;br /&gt;
&lt;br /&gt;
Here is an example block file:&amp;nbsp;&lt;a href=&quot;http://pine02.fosm.org/index2/index-25783809-25789073.txt.bz2&quot;&gt;index-25783809-25789073.txt.bz2&lt;/a&gt;&lt;br /&gt;
&lt;br /&gt;
Code is in the indexer branch on github,&lt;br /&gt;
&lt;a href=&quot;https://github.com/fosm/bzip-table-fosm/tree/indexer&quot;&gt;https://github.com/fosm/bzip-table-fosm/tree/indexer&lt;/a&gt;&lt;br /&gt;
&lt;br /&gt;
Note that I found out that the full planet file did not get processed, but we got to the relations so that Is good enough for me for now.&lt;br /&gt;
&lt;br /&gt;
thanks,&lt;br /&gt;
mike&lt;br /&gt;
&lt;br /&gt;&lt;/div&gt;
&lt;/div&gt;</content><link rel='replies' type='application/atom+xml' href='http://osmopenlayers.blogspot.com/feeds/6055100775719954737/comments/default' title='Post Comments'/><link rel='replies' type='text/html' href='http://osmopenlayers.blogspot.com/2012/05/indexing-of-blocks.html#comment-form' title='0 Comments'/><link rel='edit' type='application/atom+xml' href='http://www.blogger.com/feeds/1825393237232252749/posts/default/6055100775719954737'/><link rel='self' type='application/atom+xml' href='http://www.blogger.com/feeds/1825393237232252749/posts/default/6055100775719954737'/><link rel='alternate' type='text/html' href='http://osmopenlayers.blogspot.com/2012/05/indexing-of-blocks.html' title='Indexing of the blocks'/><author><name>H4ck3rm1k3</name><uri>http://www.blogger.com/profile/04484528013589914857</uri><email>noreply@blogger.com</email><gd:image rel='http://schemas.google.com/g/2005#thumbnail' width='16' height='16' src='https://img1.blogblog.com/img/b16-rounded.gif'/></author><thr:total>0</thr:total></entry><entry><id>tag:blogger.com,1999:blog-1825393237232252749.post-2568200307675225011</id><published>2012-05-03T12:25:00.001-07:00</published><updated>2012-05-03T15:12:12.359-07:00</updated><title type='text'>s3 buckets for fosm in progress</title><content type='html'>&lt;div dir=&quot;ltr&quot; style=&quot;text-align: left;&quot; trbidi=&quot;on&quot;&gt;
&lt;br /&gt;
I have now completed the first processing and am uploading the results to archive.org&lt;br /&gt;
in the s3.&lt;br /&gt;
I am using &amp;nbsp;&lt;a href=&quot;http://s3tools.org/s3cmd&quot;&gt;http://s3tools.org/s3cmd&lt;/a&gt;&amp;nbsp;see also&amp;nbsp;&lt;a href=&quot;http://archive.org/help/abouts3.txt&quot;&gt;http://archive.org/help/abouts3.txt&lt;/a&gt;&lt;br /&gt;
&lt;br /&gt;
Here are the first blocks :&lt;br /&gt;
&lt;a href=&quot;http://archive.org/details/fosm-20120401130001-xaaaa&quot;&gt;http://archive.org/details/fosm-20120401130001-xaaaa&lt;/a&gt;&amp;nbsp;with the backend storage :&lt;br /&gt;
&lt;a href=&quot;http://ia601209.us.archive.org/16/items/fosm-20120401130001-xaaaa/&quot;&gt;http://ia601209.us.archive.org/16/items/fosm-20120401130001-xaaaa/&lt;/a&gt;&lt;br /&gt;
&lt;br /&gt;
each file is grouped into a bucket named&amp;nbsp;&lt;a href=&quot;http://archive.org/details/fosm-20120401130001-xaaaa&quot;&gt;fosm-20120401130001-xaaaa&lt;/a&gt;&lt;br /&gt;
there are 1559 buckets, from xaaaa to xachp, they are uploading now.&lt;br /&gt;
&lt;br /&gt;
Here are the ones so far :&lt;br /&gt;
&lt;a href=&quot;http://archive.org/details/fosm-20120401130001-xaaaa&quot;&gt;http://archive.org/details/fosm-20120401130001-xaaaa&lt;/a&gt;&lt;br /&gt;
&lt;a href=&quot;http://archive.org/details/fosm-20120401130001-xaaab&quot;&gt;http://archive.org/details/fosm-20120401130001-xaaab&lt;/a&gt;&lt;br /&gt;
&lt;a href=&quot;http://archive.org/details/fosm-20120401130001-xaaac&quot;&gt;http://archive.org/details/fosm-20120401130001-xaaac&lt;/a&gt;&lt;br /&gt;
&lt;a href=&quot;http://archive.org/details/fosm-20120401130001-xaaad&quot;&gt;http://archive.org/details/fosm-20120401130001-xaaad&lt;/a&gt;&lt;br /&gt;
&lt;a href=&quot;http://archive.org/details/fosm-20120401130001-xaaae&quot;&gt;http://archive.org/details/fosm-20120401130001-xaaae&lt;/a&gt;&lt;br /&gt;
&lt;a href=&quot;http://archive.org/details/fosm-20120401130001-xaaaf&quot;&gt;http://archive.org/details/fosm-20120401130001-xaaaf&lt;/a&gt;&lt;br /&gt;
&lt;a href=&quot;http://archive.org/details/fosm-20120401130001-xaaag&quot;&gt;http://archive.org/details/fosm-20120401130001-xaaag&lt;/a&gt;&lt;br /&gt;
&lt;a href=&quot;http://archive.org/details/fosm-20120401130001-xaaah&quot;&gt;http://archive.org/details/fosm-20120401130001-xaaah&lt;/a&gt;&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
Here is the uploader script, it takes the output of ls -b | split &lt;br /&gt;
&lt;blockquote&gt;
#!/bin/sh&lt;br /&gt;
BASE_URL=http://archive.org/details/&lt;br /&gt;
for bfile in `ls x*`&lt;br /&gt;
do&lt;br /&gt;
&amp;nbsp; &amp;nbsp; BASE_HEADER=fosm-20120401130001-${bfile} #something that should be unique&lt;br /&gt;
&amp;nbsp; &amp;nbsp; ./s3cmd mb s3://$BASE_HEADER&lt;br /&gt;
&amp;nbsp; &amp;nbsp; echo Sleeping...#sometimes it takes a moment to be processed on their end&lt;br /&gt;
&amp;nbsp; &amp;nbsp; while [ ! ./s3cmd ls | grep $BASE_HEADER ]&lt;br /&gt;
&amp;nbsp; &amp;nbsp; do&lt;br /&gt;
&lt;span class=&quot;Apple-tab-span&quot; style=&quot;white-space: pre;&quot;&gt; &lt;/span&gt;sleep 1&lt;br /&gt;
&amp;nbsp; &amp;nbsp; done&lt;br /&gt;
&amp;nbsp; &lt;br /&gt;
&amp;nbsp; &amp;nbsp; for file in `cat $bfile`&lt;br /&gt;
&amp;nbsp; &amp;nbsp; do&lt;br /&gt;
&lt;span class=&quot;Apple-tab-span&quot; style=&quot;white-space: pre;&quot;&gt; &lt;/span&gt;echo put $file&lt;br /&gt;
&lt;span class=&quot;Apple-tab-span&quot; style=&quot;white-space: pre;&quot;&gt; &lt;/span&gt;cmd=&quot;./s3cmd put /pine02/index/$file s3://$BASE_HEADER/$file&quot;&lt;br /&gt;
&lt;span class=&quot;Apple-tab-span&quot; style=&quot;white-space: pre;&quot;&gt; &lt;/span&gt;echo going to $cmd&lt;br /&gt;
&lt;span class=&quot;Apple-tab-span&quot; style=&quot;white-space: pre;&quot;&gt; &lt;/span&gt;while true&lt;br /&gt;
&lt;span class=&quot;Apple-tab-span&quot; style=&quot;white-space: pre;&quot;&gt; &lt;/span&gt;do&lt;br /&gt;
&lt;span class=&quot;Apple-tab-span&quot; style=&quot;white-space: pre;&quot;&gt; &lt;/span&gt; &amp;nbsp; &amp;nbsp;echo start;&lt;br /&gt;
&lt;span class=&quot;Apple-tab-span&quot; style=&quot;white-space: pre;&quot;&gt; &lt;/span&gt; &amp;nbsp; &amp;nbsp;$cmd;&lt;br /&gt;
&lt;span class=&quot;Apple-tab-span&quot; style=&quot;white-space: pre;&quot;&gt; &lt;/span&gt; &amp;nbsp; &lt;br /&gt;
&lt;span class=&quot;Apple-tab-span&quot; style=&quot;white-space: pre;&quot;&gt; &lt;/span&gt; &amp;nbsp; &amp;nbsp;if [ $? -eq 0 ]&lt;br /&gt;
&lt;span class=&quot;Apple-tab-span&quot; style=&quot;white-space: pre;&quot;&gt; &lt;/span&gt; &amp;nbsp; &amp;nbsp;then&lt;br /&gt;
&lt;span class=&quot;Apple-tab-span&quot; style=&quot;white-space: pre;&quot;&gt;  &lt;/span&gt;break&lt;br /&gt;
&lt;span class=&quot;Apple-tab-span&quot; style=&quot;white-space: pre;&quot;&gt; &lt;/span&gt; &amp;nbsp; &amp;nbsp;fi&lt;br /&gt;
&lt;span class=&quot;Apple-tab-span&quot; style=&quot;white-space: pre;&quot;&gt; &lt;/span&gt; &amp;nbsp; &lt;br /&gt;
&lt;span class=&quot;Apple-tab-span&quot; style=&quot;white-space: pre;&quot;&gt; &lt;/span&gt; &amp;nbsp; &amp;nbsp;echo failed $cmd;&lt;br /&gt;
&lt;span class=&quot;Apple-tab-span&quot; style=&quot;white-space: pre;&quot;&gt; &lt;/span&gt; &amp;nbsp; &amp;nbsp;sleep 1;&lt;br /&gt;
&lt;span class=&quot;Apple-tab-span&quot; style=&quot;white-space: pre;&quot;&gt; &lt;/span&gt;done&lt;br /&gt;
&amp;nbsp; &amp;nbsp; done&lt;br /&gt;
done&lt;br /&gt;
echo $BASE_URL$BASE_HEADER&lt;/blockquote&gt;
&lt;div&gt;
&lt;br /&gt;&lt;/div&gt;
&lt;/div&gt;</content><link rel='replies' type='application/atom+xml' href='http://osmopenlayers.blogspot.com/feeds/2568200307675225011/comments/default' title='Post Comments'/><link rel='replies' type='text/html' href='http://osmopenlayers.blogspot.com/2012/05/s3-buckets-for-fosm-in-progress.html#comment-form' title='0 Comments'/><link rel='edit' type='application/atom+xml' href='http://www.blogger.com/feeds/1825393237232252749/posts/default/2568200307675225011'/><link rel='self' type='application/atom+xml' href='http://www.blogger.com/feeds/1825393237232252749/posts/default/2568200307675225011'/><link rel='alternate' type='text/html' href='http://osmopenlayers.blogspot.com/2012/05/s3-buckets-for-fosm-in-progress.html' title='s3 buckets for fosm in progress'/><author><name>H4ck3rm1k3</name><uri>http://www.blogger.com/profile/04484528013589914857</uri><email>noreply@blogger.com</email><gd:image rel='http://schemas.google.com/g/2005#thumbnail' width='16' height='16' src='https://img1.blogblog.com/img/b16-rounded.gif'/></author><thr:total>0</thr:total></entry><entry><id>tag:blogger.com,1999:blog-1825393237232252749.post-7410498657044174333</id><published>2012-05-01T02:27:00.002-07:00</published><updated>2012-05-01T02:27:45.126-07:00</updated><title type='text'>FOSM indexing update</title><content type='html'>&lt;div dir=&quot;ltr&quot; style=&quot;text-align: left;&quot; trbidi=&quot;on&quot;&gt;
I have decided to rework my indexer routine to use multithreading&lt;br /&gt;
and do less work in the first pass. The original routine created vectors of data for all the attributes but was pretty slow. I have used the new&amp;nbsp;c++0x threads, so no&amp;nbsp;dependencies&amp;nbsp;on boost, but you need the new gcc 4.6 compiler.&lt;br /&gt;
&lt;br /&gt;
The new algorithm is focused on making blocks of bzip data that are easy to process,&lt;br /&gt;
so first of all the data from the original bzip file is read out into a block. this block is parsed with a simple ragel parser that just extracts the complete node, ways and relations, expecting that a closing &amp;lt;/node&amp;gt; etc is in place (fosm format). It is not tested on other osm variants formats right now. &amp;nbsp;Each completed node object is put into the datafile. All ids seen are indexed in a binary file of long longs (64 bit). The Data is split into a header, body and footer. All incomplete nodes are written into the header or footer, so you will need to read the footer of the previous block and the header of the next block to put them together. I have decided that I wont do that in this first pass, but leave it up to a further step.&lt;br /&gt;
&lt;br /&gt;
The only thing you get from this pass is tar files from each block of data, and a index file of the ids occurring in there. I guess I could have included the min/max lat and long but I have left them out for now.&lt;br /&gt;
&lt;br /&gt;
So when this process is finished we will have small work packages of data you can easily&lt;br /&gt;
process. Each line of the body file contains one full node object so you can easily parse it later.&lt;br /&gt;
That means you will be able to process a block at a time.&lt;br /&gt;
&lt;br /&gt;
Datafiles are being written here as we speak :&lt;br /&gt;
&lt;a href=&quot;http://pine02.fosm.org/index/&quot;&gt;http://pine02.fosm.org/index/&lt;/a&gt;&lt;br /&gt;
&lt;br /&gt;
code is in the&amp;nbsp;&lt;a href=&quot;https://github.com/fosm/bzip-table-fosm/tree/experimentalspitting&quot;&gt;experimentalspitting&lt;/a&gt;&amp;nbsp;branch :&lt;br /&gt;
&lt;a href=&quot;https://github.com/fosm/bzip-table-fosm/tree/experimentalspitting&quot;&gt;https://github.com/fosm/bzip-table-fosm/tree/experimentalspitting&lt;/a&gt;&lt;br /&gt;
&lt;br /&gt;
I will let this run and see how it goes, the performance seems to be pretty good.&lt;/div&gt;</content><link rel='replies' type='application/atom+xml' href='http://osmopenlayers.blogspot.com/feeds/7410498657044174333/comments/default' title='Post Comments'/><link rel='replies' type='text/html' href='http://osmopenlayers.blogspot.com/2012/05/fosm-indexing-update.html#comment-form' title='0 Comments'/><link rel='edit' type='application/atom+xml' href='http://www.blogger.com/feeds/1825393237232252749/posts/default/7410498657044174333'/><link rel='self' type='application/atom+xml' href='http://www.blogger.com/feeds/1825393237232252749/posts/default/7410498657044174333'/><link rel='alternate' type='text/html' href='http://osmopenlayers.blogspot.com/2012/05/fosm-indexing-update.html' title='FOSM indexing update'/><author><name>H4ck3rm1k3</name><uri>http://www.blogger.com/profile/04484528013589914857</uri><email>noreply@blogger.com</email><gd:image rel='http://schemas.google.com/g/2005#thumbnail' width='16' height='16' src='https://img1.blogblog.com/img/b16-rounded.gif'/></author><thr:total>0</thr:total></entry><entry><id>tag:blogger.com,1999:blog-1825393237232252749.post-8167131024424027816</id><published>2012-04-20T04:19:00.000-07:00</published><updated>2012-04-20T04:19:24.398-07:00</updated><title type='text'>Norwegen CC-BY-SA data</title><content type='html'>&lt;div dir=&quot;ltr&quot; style=&quot;text-align: left;&quot; trbidi=&quot;on&quot;&gt;
thanks to Gnonthgol for the tip, norway has released map data under the creative commons license.&lt;br /&gt;
&lt;br /&gt;
You will find the data here:&lt;br /&gt;
&lt;a href=&quot;http://www.statkart.no/nor/Land/Kart_og_produkter/Gratis_illustrasjonskart/&quot;&gt;http://www.statkart.no/nor/Land/Kart_og_produkter/Gratis_illustrasjonskart/&lt;/a&gt;&lt;br /&gt;
&lt;br /&gt;
Data files I downloaded from :&lt;br /&gt;
&lt;br /&gt;
&lt;a href=&quot;http://www.statkart.no/?module=Files;action=File.getFile;ID=45841&quot;&gt;http://www.statkart.no/?module=Files;action=File.getFile;ID=45841&lt;/a&gt;&lt;br /&gt;
&lt;a href=&quot;http://www.statkart.no/?module=Files;action=File.getFile;ID=45839&quot;&gt;http://www.statkart.no/?module=Files;action=File.getFile;ID=45839&lt;/a&gt;&lt;br /&gt;
&lt;a href=&quot;http://www.statkart.no/?module=Files;action=File.getFile;ID=45840&quot;&gt;http://www.statkart.no/?module=Files;action=File.getFile;ID=45840&lt;/a&gt;&lt;br /&gt;
&lt;a href=&quot;http://www.statkart.no/?module=Files;action=File.getFile;ID=41973&quot;&gt;http://www.statkart.no/?module=Files;action=File.getFile;ID=41973&lt;/a&gt;&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
They are unpacked here:&lt;br /&gt;
&lt;a href=&quot;http://pine02.fosm.org/no/&quot;&gt;http://pine02.fosm.org/no/&lt;/a&gt;&lt;br /&gt;
&lt;br /&gt;
more to come.&lt;br /&gt;
&lt;br /&gt;
mike&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;&lt;/div&gt;</content><link rel='replies' type='application/atom+xml' href='http://osmopenlayers.blogspot.com/feeds/8167131024424027816/comments/default' title='Post Comments'/><link rel='replies' type='text/html' href='http://osmopenlayers.blogspot.com/2012/04/norwegen-cc-by-sa-data.html#comment-form' title='0 Comments'/><link rel='edit' type='application/atom+xml' href='http://www.blogger.com/feeds/1825393237232252749/posts/default/8167131024424027816'/><link rel='self' type='application/atom+xml' href='http://www.blogger.com/feeds/1825393237232252749/posts/default/8167131024424027816'/><link rel='alternate' type='text/html' href='http://osmopenlayers.blogspot.com/2012/04/norwegen-cc-by-sa-data.html' title='Norwegen CC-BY-SA data'/><author><name>H4ck3rm1k3</name><uri>http://www.blogger.com/profile/04484528013589914857</uri><email>noreply@blogger.com</email><gd:image rel='http://schemas.google.com/g/2005#thumbnail' width='16' height='16' src='https://img1.blogblog.com/img/b16-rounded.gif'/></author><thr:total>0</thr:total></entry><entry><id>tag:blogger.com,1999:blog-1825393237232252749.post-7078275802235554092</id><published>2012-04-15T13:24:00.000-07:00</published><updated>2012-04-15T14:27:41.556-07:00</updated><title type='text'>metis is running as graph partitioner for OSM</title><content type='html'>&lt;div dir=&quot;ltr&quot; style=&quot;text-align: left;&quot; trbidi=&quot;on&quot;&gt;
&lt;a href=&quot;https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEi-9GJoZ0E-i4UYTpsV1mPiqAmL2K489yYtpwL_YWlNiby3uEaaBYzLJDTzxW0bDf_a2UNx_CuVKTt4L3PjhyF0_2MT1oswSUAEUA8vWvPcYAnotajypcJ2o5S_PDAji9sqaA3qzQg6GmMq/s1600/total.png&quot; imageanchor=&quot;1&quot; style=&quot;margin-left: 1em; margin-right: 1em; text-align: center;&quot;&gt;&lt;img border=&quot;0&quot; height=&quot;640&quot; src=&quot;https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEi-9GJoZ0E-i4UYTpsV1mPiqAmL2K489yYtpwL_YWlNiby3uEaaBYzLJDTzxW0bDf_a2UNx_CuVKTt4L3PjhyF0_2MT1oswSUAEUA8vWvPcYAnotajypcJ2o5S_PDAji9sqaA3qzQg6GmMq/s640/total.png&quot; width=&quot;640&quot; /&gt;&lt;/a&gt;&lt;br /&gt;
&lt;a href=&quot;http://glaros.dtc.umn.edu/gkhome/metis/metis/overview&quot;&gt;metis&lt;/a&gt; is a graph partitioning tool.&amp;nbsp;What it emits after 3 seconds on my laptop is a list of partitions for each node.&lt;br /&gt;
&lt;br /&gt;
I finally got metis running for some osm data, and I can show you the results.&lt;br /&gt;
&lt;br /&gt;
My fork here :&lt;a href=&quot;https://github.com/h4ck3rm1k3/metis-graph-partitioner&quot;&gt;https://github.com/h4ck3rm1k3/metis-graph-partitioner&lt;/a&gt;&lt;br /&gt;
&lt;br /&gt;
Code to emit the graph as input :&lt;br /&gt;
&lt;a href=&quot;https://github.com/h4ck3rm1k3/OSM-Binary-Format/blob/master/metisexport.cpp&quot;&gt;https://github.com/h4ck3rm1k3/OSM-Binary-Format/blob/master/metisexport.cpp&lt;/a&gt;&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;blockquote class=&quot;tr_bq&quot;&gt;
METIS 5.0 Copyright 1998-11, Regents of the University of Minnesota&lt;br /&gt;
&amp;nbsp;(HEAD: , Built on: Apr 15 2012, 19:24:23)&lt;br /&gt;
&amp;nbsp;size of idx_t: 32bits, real_t: 32bits, idx_t *: 32bits&lt;br /&gt;
Graph Information -----------------------------------------------------------&lt;br /&gt;
&amp;nbsp;Name: /home/mdupont/experiments/osm/kosovo/metis2.grf, #Vertices: 884307, #Edges: 889406, #Parts: 40&lt;br /&gt;
Options ---------------------------------------------------------------------&lt;br /&gt;
&amp;nbsp;ptype=kway, objtype=cut, ctype=shem, rtype=greedy, iptype=metisrb&lt;br /&gt;
&amp;nbsp;dbglvl=0, ufactor=1.030, minconn=NO, contig=NO, nooutput=NO&lt;br /&gt;
&amp;nbsp;seed=-1, niter=10, ncuts=1&lt;br /&gt;
Direct k-way Partitioning ---------------------------------------------------&lt;br /&gt;
&amp;nbsp;- Edgecut: 537, communication volume: 1073.&lt;br /&gt;
&amp;nbsp;- Balance:&lt;br /&gt;
&amp;nbsp; &amp;nbsp; &amp;nbsp;constraint #0: &amp;nbsp;1.024 out of 0.000&lt;br /&gt;
&amp;nbsp;- Most overweight partition:&lt;br /&gt;
&amp;nbsp; &amp;nbsp; &amp;nbsp;pid: 3, actual: 22648, desired: 22107, ratio: 1.02.&lt;br /&gt;
&amp;nbsp;- Subdomain connectivity: max: 10, min: 0, avg: 3.85&lt;br /&gt;
&amp;nbsp;- The original graph had 26373 connected components and the resulting&lt;br /&gt;
&amp;nbsp; &amp;nbsp;partitioning after removing the cut edges has 26412 components.&lt;br /&gt;
Timing Information ----------------------------------------------------------&lt;br /&gt;
&amp;nbsp; I/O: &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp;&lt;span class=&quot;Apple-tab-span&quot; style=&quot;white-space: pre;&quot;&gt;  &lt;/span&gt; &amp;nbsp; 0.816 sec&lt;br /&gt;
&amp;nbsp; Partitioning: &lt;span class=&quot;Apple-tab-span&quot; style=&quot;white-space: pre;&quot;&gt;  &lt;/span&gt; &amp;nbsp; 1.240 sec &amp;nbsp; (METIS time)&lt;br /&gt;
&amp;nbsp; Reporting: &amp;nbsp; &amp;nbsp;&lt;span class=&quot;Apple-tab-span&quot; style=&quot;white-space: pre;&quot;&gt;  &lt;/span&gt; &amp;nbsp; 0.584 sec&lt;br /&gt;
Memory Information ----------------------------------------------------------&lt;br /&gt;
&amp;nbsp; Max memory used:&lt;span class=&quot;Apple-tab-span&quot; style=&quot;white-space: pre;&quot;&gt;  &lt;/span&gt; &amp;nbsp;67.457 MB&lt;/blockquote&gt;
&lt;div&gt;
&lt;br /&gt;&lt;/div&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;div&gt;
The output is a simple component index, one for each line that represents the node index,&amp;nbsp;&lt;/div&gt;
&lt;div&gt;
I have visualized the output data with mapnik. See the attached images.&lt;br /&gt;
&lt;br /&gt;
The rendering with mapnik goes pretty fast on these small files, but takes longer if you do them all together in one.&lt;br /&gt;
&lt;br /&gt;
The following image is a composite of 40 layers on top of each other&lt;br /&gt;
&lt;br /&gt;&lt;/div&gt;
&lt;div class=&quot;separator&quot; style=&quot;clear: both; text-align: center;&quot;&gt;
&lt;/div&gt;
&lt;div style=&quot;background-color: lightgrey; position: relative; text-align: center;&quot;&gt;
&lt;img border=&quot;1&quot; src=&quot;https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEiZ5zGSQUBI6wJT-Wj9LaBWC0wyQa7CPm2UdzIehe0b_DvDZ2Ps_NgiEsNWo-IPnRzuk0MOCpS0xyXokJBvOQUVJyNkflTUePd0B8ni8zlQKmG7G6XoHnyG-4-MD_V8mndefKNuByR8ukPA/s200/layer_1.png&quot; style=&quot;left: 0px; position: absolute; text-align: center; top: 0px;&quot; /&gt;&lt;img border=&quot;1&quot; src=&quot;https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEisXAJsQFRRJA-6Y6F0L2LqW7deQ4hMoPhEzd5UjY169lCNPCVHkl1Hg_o-0H6WXo_rqUNdreVeP4hb2zSgLHBBkuzmFm-E1edmThev2BKT3bttAInnLZhI79tio3xdomQCUJw6Y_RjZauU/s200/layer_10.png&quot; style=&quot;left: 0px; position: absolute; text-align: center; top: 0px;&quot; /&gt;&lt;img border=&quot;1&quot; height=&quot;200&quot; src=&quot;https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEil1ZDetJ__s0Z_Y7_HB_SUpMK8QXeufO5zN8FX_4zSEOYnQVmKzysPyJDatJ1pQ8v5Fp78eTV-W4I5DMqS3AzUCRXIBeoAddsS5BqdyG52u3KtQMQVaCNS37UqlsbkLwUHgl__97JUajOU/s200/layer_9.png&quot; style=&quot;left: 0px; position: absolute; text-align: center; top: 0px;&quot; width=&quot;200&quot; /&gt;&lt;img border=&quot;1&quot; height=&quot;200&quot; src=&quot;https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEgy_Myqc79pGCPy93ZZip5P2oqof0R2UFrnUhmQuMvjmb5kS5uj-Y6YHHnFUTuiKtoaUH_zZ-nvdx0SaeUzNf7AL53VkQjBpONKggfgC3pPQViSDQ57GMth53e5y2AlKoQqbOaIu6XSq1xL/s200/layer_26.png&quot; style=&quot;left: 0px; position: absolute; text-align: center; top: 0px;&quot; width=&quot;200&quot; /&gt;&lt;img border=&quot;1&quot; height=&quot;200&quot; src=&quot;https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEg9v-MFeDpGGykeG_1WVyrwWGbn6Ofkv1RDYTgQDKqSo_hRG8IaD74m51lm36H5zJOOVOo6-04S1kytGnZZnpyBbqHljxUn4c0-RhcOJm72FNRTOKgQQxUWrulmuhblMyP6BMQANFNdhnWK/s200/layer_5.png&quot; style=&quot;left: 0px; position: absolute; text-align: center; top: 0px;&quot; width=&quot;200&quot; /&gt;&lt;img border=&quot;1&quot; height=&quot;200&quot; src=&quot;https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEigXhMjP3ZAhhHSH2U7UNyi9p0hm-naO0P0DtL9eLAzGdPwDDbQLvxHZ8cQyZIaVKp9O3XDIqVM4LFzgRjYeVc_cj1-FD4xe9mV0gacQIU6CGRSk8cva3mjs-khkdUw4174aqqXNesXi35Q/s200/layer_29.png&quot; style=&quot;left: 0px; position: absolute; text-align: center; top: 0px;&quot; width=&quot;200&quot; /&gt;&lt;img border=&quot;1&quot; height=&quot;200&quot; src=&quot;https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEgri6TDuloI2wX-6tMbDWyP6hIFQl_duUKru9CKw5Qg_DOgv77z3uJaj7Cl2YP8nvlcDglJtDGWjIBMQByFhdgX5-jua0Mz13WF29bkYU69ArrqG82tuAjRXLCsOakR0X8G1qZ1tVm7z9-a/s200/layer_20.png&quot; style=&quot;left: 0px; position: absolute; text-align: center; top: 0px;&quot; width=&quot;200&quot; /&gt;&lt;img border=&quot;1&quot; height=&quot;200&quot; src=&quot;https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEi6lK5Dzv_D_IDmR6B_lGw2VMNt6MhQr6lkcJJzTawrid3zVUOUk7mlLLOUJpqyuq6-JiyvYCyVZ-02C3U-IKX4Yr32jxxzyXywDgtf7dCjqMzq98sbDQ71cdowCa1wSRA1BcrYT8fPgCDG/s200/layer_33.png&quot; style=&quot;left: 0px; position: absolute; text-align: center; top: 0px;&quot; width=&quot;200&quot; /&gt;&lt;img border=&quot;1&quot; height=&quot;200&quot; src=&quot;https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEgit7jdx65E66MuYnBufVF78HkrPHFVToJmNDhvM2FmsAVNGJl1bLw23_LFQAoBfN624PzOn5kpgsmVTvKe_sYB3_ItX8t262DWhZovICGcqyd0hnf9h9vI0A_HdG1rRgLuKaFRwce69OHM/s200/layer_17.png&quot; style=&quot;left: 0px; position: absolute; text-align: center; top: 0px;&quot; width=&quot;200&quot; /&gt;&lt;img border=&quot;1&quot; height=&quot;200&quot; src=&quot;https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEg491ru8SyCBh_A2yK0NUFCNdbPpojnm7wIaboFiRlFxz5PEsFfXRGUHfR_3BN-O_tQ38YNPk0dkichXgulKIEVF-_z_2iOmWVRd8Z-YhcL8T0gRsoS9RiVcmGdcQ93Q6u87alJVBiYAuz6/s200/layer_32.png&quot; style=&quot;left: 0px; position: absolute; text-align: center; top: 0px;&quot; width=&quot;200&quot; /&gt;&lt;img border=&quot;1&quot; height=&quot;200&quot; src=&quot;https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEjlHTrMKNgjwQu70760M_nuAYxRUO6w9YRI-cOYmufqp2Gi6zivHsrMUbABBzt0e_l8j66F98ys8yWUk9CBRnmwZZCtRNNzeMki7EL8Rj0o9XWQtSTVXoaYyxKKAH5vhVXZUMVPoT9D_hA6/s200/layer_28.png&quot; style=&quot;left: 0px; position: absolute; text-align: center; top: 0px;&quot; width=&quot;200&quot; /&gt;&lt;img border=&quot;1&quot; height=&quot;200&quot; src=&quot;https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEi1OrTkmYYOsCQzzd5YIwREY0ixZKtXWKWIVG5ZYokMIptGuFoxWr0ifpOfuBSMomkC1lJDuE6tAF_2eiK9BG4WG67XvQmfUS-Mhq7V6f-_zTbLj-1CiS3eE6xatbvIyk3YjdQRx-fNFiIL/s200/layer_16.png&quot; style=&quot;left: 0px; position: absolute; text-align: center; top: 0px;&quot; width=&quot;200&quot; /&gt;&lt;img border=&quot;1&quot; height=&quot;200&quot; src=&quot;https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEhTgNDOMMt1Cvh5OJ0CvupLHfucIBodbbJODNCLlRjwiIPMYiUfY7oHb32ByqJQr2QgtBvlZGkN427w7rla2Q7ndhsO7AZ7FeZ6UumiNkhp6q4twH-EyED4tIFKJ7BXgV5xPEzfQx5H3Cj4/s200/layer_18.png&quot; style=&quot;left: 0px; position: absolute; text-align: center; top: 0px;&quot; width=&quot;200&quot; /&gt;&lt;img border=&quot;1&quot; height=&quot;200&quot; src=&quot;https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEipx2WNpVxTEEoMnfwEZVL8yDk9R3xUhYNc48Luwtz74ClGFxfUSySK-27YXYFJcsfqKIQRAHGBC-LmKHoVMCabrM-j7UtLFV1JRP28-SQVC5jiw8UCze2HO8eAVB_Rmv4E5XXJkw4K61mV/s200/layer_14.png&quot; style=&quot;left: 0px; position: absolute; text-align: center; top: 0px;&quot; width=&quot;200&quot; /&gt;&lt;img border=&quot;1&quot; height=&quot;200&quot; src=&quot;https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEjjT22w92-TCio4849HX8nCZNtA94jdg566xafzxBnU3_5Bhldf5ngJMfQR_INXUPZLQJkiN0boMA082p1jghG9kPji6RUBX1BPC7Iz34xVePNV2cokeFfNrLy1wrmocBfBCw7emz5qAYkE/s200/layer_39.png&quot; style=&quot;left: 0px; position: absolute; text-align: center; top: 0px;&quot; width=&quot;200&quot; /&gt;&lt;img border=&quot;1&quot; height=&quot;200&quot; src=&quot;https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEgz08BlOSZRENMWtoxKwQkw7cpfOlOCEVfERYN94xe8VOhzypBwp9pVi20Qpv3eQwtFjT43dL-Nzo4DogdQFIW_B5uCgiwnP8XPVpzBxt8HYROy9TQHvKCfQls9tyqltlVRFkS1WWgCzjMN/s200/layer_15.png&quot; style=&quot;left: 0px; position: absolute; text-align: center; top: 0px;&quot; width=&quot;200&quot; /&gt;&lt;img border=&quot;1&quot; height=&quot;200&quot; src=&quot;https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEhfkbWQgnr1q1PHCasFtT2s_GzFv4ynAkgg2tk0cUzjyn8ZJoRcOZm6JAMEarMHCky21sLLertJuwwIJQ7MlSB5IjvgxbUP4_cI_BIfUqCHOvsVyf_dTtJTXGfgFktxu4YnDUVOZqeGnp46/s200/layer_4.png&quot; style=&quot;left: 0px; position: absolute; text-align: center; top: 0px;&quot; width=&quot;200&quot; /&gt;&lt;img border=&quot;1&quot; height=&quot;200&quot; src=&quot;https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEjQ117FfScFQi5xvxgWrLap1kG2_ki2b1C5FBKKNGXccJ-u32yuhrMQZzE4pPocCpOXAr04LtI8_hYStMrzirv8LBQzpV6ziEASWiV7_Ks5V6jJIEDeFQO0ugZ7oF3lFE9JIy1xK49aRHPT/s200/layer_2.png&quot; style=&quot;left: 0px; position: absolute; text-align: center; top: 0px;&quot; width=&quot;200&quot; /&gt;&lt;img border=&quot;1&quot; height=&quot;200&quot; src=&quot;https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEgqD-jtpCzCo0qXQks24mKoZIpChmzGfBnBPd6mufhg9JACrBcBnM4MJgLwtjZHlZKwC7mNcnuBYLzJn3AQQtLg4rxEl7n5ROoC0FCEmagps2mDRynKhNHyMufMR9dBl5GZ0cMzMgvTCYO6/s200/layer_37.png&quot; style=&quot;left: 0px; position: absolute; text-align: center; top: 0px;&quot; width=&quot;200&quot; /&gt;&lt;img border=&quot;1&quot; height=&quot;200&quot; src=&quot;https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEgA4pcrjOyuxybPZ9fvSIUpshNrZu0se-QONfXMEY2bryIYVjUPHrYg4ImH6WSSjkOYAntGsU4j5Cqm44p9eQRbi8ZiFmry_gazaYz8cSpvAGPpYOcPdu0wcRXdJze94Q6Hpn3kfRlf6fjp/s200/layer_7.png&quot; style=&quot;left: 0px; position: absolute; text-align: center; top: 0px;&quot; width=&quot;200&quot; /&gt;&lt;img border=&quot;1&quot; height=&quot;200&quot; src=&quot;https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEj9EmYmybFqlAkSPjW3CJVIxdqhvgQLp192NNaReE7vxOVIDK6yiWX5zJzTF2AblrvVV9d67yIawhdtfuu5AEPfYgTFoGLHQbf09-J718Zp78p6NBsj-4Zn8lHoDaBImavfRKOqQurSOa2n/s200/layer_12.png&quot; style=&quot;left: 0px; position: absolute; text-align: center; top: 0px;&quot; width=&quot;200&quot; /&gt;&lt;img border=&quot;1&quot; height=&quot;200&quot; src=&quot;https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEh8xa3ltJqhLs2inAYYaarsPI4YdYPNwNN7nHJ5AGqbqfVvFiiimmc17stIhlS65wkNPUbcvI54JCZa0oUMPSgrDPLO1Fj0AlrpIWXEUw4xuBo9oPRdmaGkjzUYmFmgx1K1nWn0I0RBqq1a/s200/layer_36.png&quot; style=&quot;left: 0px; position: absolute; text-align: center; top: 0px;&quot; width=&quot;200&quot; /&gt;&lt;img border=&quot;1&quot; height=&quot;200&quot; src=&quot;https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEiKJuuYvJHOyrfT8lmC4C36a6sDVdc_GDPqUApMU8HNU4R4Ax5SYSm5g22-KvNfxdWGPHZnnCzHw_kqcneZ3bEFlBWezvv_66uiB12Zq_FlwXCIzto7J-xUCpaUDKO4opSPdpV3YRQIzt_M/s200/layer_23.png&quot; style=&quot;left: 0px; position: absolute; text-align: center; top: 0px;&quot; width=&quot;200&quot; /&gt;&lt;img border=&quot;1&quot; height=&quot;200&quot; src=&quot;https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEjlURp2zGbzyLwbrpvDqZuaJFQFcK5FcYd5cRuwNETt-5HDE6j_LE8y0rxyqSRsDe3Sr532XlSjekny-a9QW7BhD5QnqNV_RMLkbwlSM6ZOjQWF1aO4zwCL3sLoa9OukQEy1AU8EFyL-ck9/s200/layer_38.png&quot; style=&quot;left: 0px; position: absolute; text-align: center; top: 0px;&quot; width=&quot;200&quot; /&gt;&lt;img border=&quot;1&quot; height=&quot;200&quot; src=&quot;https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEhc5NmJhksLK2pARE_hyZ09mjbAnOcf4LqC23l-iUH5EdRq751DGps31Ga51wu92O-0bpiO8Ca3jCngLSet6LhFQhSGw-_95lvdCYbsYcy_WfOuN6AYP3dAiFE3QXXOKJ1ldaFsTqSBIrau/s200/layer_8.png&quot; style=&quot;left: 0px; position: absolute; text-align: center; top: 0px;&quot; width=&quot;200&quot; /&gt;&lt;img border=&quot;1&quot; height=&quot;200&quot; src=&quot;https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEgiHl6_05Vm0oqhUPrR1wob9MTMlkTWCGEnfN-V4TBDg2mKm3aGZ7xoUQJxgVPHscGJdu0hXRTzDvC8rhAhFXHuAT-AkjqxZeo_YoI50OiLDAtS-M_zKdQvkn5CSQ7jYl2jYZw2bAFX5lSA/s200/layer_30.png&quot; style=&quot;left: 0px; position: absolute; text-align: center; top: 0px;&quot; width=&quot;200&quot; /&gt;&lt;img border=&quot;1&quot; height=&quot;200&quot; src=&quot;https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEiSrpOz4hRE4lbZDqU0jo34m39GJ4vl0qB4L1hNPleoNnl0wZAMUyqziezu3IQmUEu2gtXq2rJLRV_6Klz35D7vrYrAQuTtm-W4KWn4uZJa9e8DbMzIBO3isIa_dMYUrAZKaoW0lQ_PdB9c/s200/layer_21.png&quot; style=&quot;left: 0px; position: absolute; text-align: center; top: 0px;&quot; width=&quot;200&quot; /&gt;&lt;img border=&quot;1&quot; height=&quot;200&quot; src=&quot;https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEjn4alI1Cf3kJ5uPBruGC_iMghEfk2zfVOOatThE9AQPDOVB5olm9VnnzpuUquBqO6YbEBjpZsxyEiALc6S7q0YEUXGn6PEUo0tqlS0Eg27Eg9NN90Uh8FaBq7FlniwcoD9BN6_WlHAlyBq/s200/layer_13.png&quot; style=&quot;left: 0px; position: absolute; text-align: center; top: 0px;&quot; width=&quot;200&quot; /&gt;&lt;img border=&quot;1&quot; src=&quot;https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEgmhmxiXwmnS8QeUypLTVzHeBkq3GkbFJT3j3gI579CmmHZSKb9yF02HC7wyrb6wudU7xYmeqt1aPz0KWQcE2aKj7Gl9fWjJK4WNi2_cHfoYkq7pIL3Ru5QcvCPQcb2XrDhmv-05O2LsFYB/s200/layer_11.png&quot; style=&quot;left: 0px; position: absolute; text-align: center; top: 0px;&quot; /&gt;&lt;img border=&quot;1&quot; height=&quot;200&quot; src=&quot;https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEiETAs_YGZgW4EeYMa-MKHfuySWQeubpHvWbta3trNHAS_ZMFmxgtL3fXDVFzAtCsUpVgXeAnVzYNSioUNrJwp-k9zOUQJFSNH3IJ5kpReOhquT7uCQPeLCbs9Aqw_rTsQrSKz6VfNQsp9h/s200/layer_24.png&quot; style=&quot;left: 0px; position: absolute; text-align: center; top: 0px;&quot; width=&quot;200&quot; /&gt;&lt;img border=&quot;1&quot; height=&quot;200&quot; src=&quot;https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEjhXwzc2IeGOLMNYyCTbxxnebaFSEvH4C_NS9b6cnLVhb8Rt02XOrqFry2vMb_8GJiTPXx5wdqy0rXt5jl_4wZfor2jnV1CdP2mW57uYDvhNiIzINVRCI0ISNNy0mgEw1EDd-wzL8qzui70/s200/layer_35.png&quot; style=&quot;left: 0px; position: absolute; text-align: center; top: 0px;&quot; width=&quot;200&quot; /&gt;&lt;img border=&quot;1&quot; height=&quot;200&quot; src=&quot;https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEhOPlyvBE33K0812DajQEz0oVcnxj3ctGwRbTNQAhI7G0iQ9PJJ7e0IpHIrKAeVl23qmfvLds-apogHxtClyTyy5caHsw39-xkLH6CNVg9AMR60H8yOYBAhvwJOFHOOZTUrlimx3KJApecn/s200/layer_25.png&quot; style=&quot;left: 0px; position: absolute; text-align: center; top: 0px;&quot; width=&quot;200&quot; /&gt;&lt;img border=&quot;1&quot; height=&quot;200&quot; src=&quot;https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEiwKir1cqVjyZ_Kr7rhyssKnx5UhSYaJ5lmMbB0YvNhwaJmZR-sUwrR_2e1L0RzVCr2EskOoLVPmRhIOLu7awnqJMR9OgaYDPgSpCRSV4V2na6YhAycUJCm1b0A7ZYeQEpZ5exrNNGThKTP/s200/layer_19.png&quot; style=&quot;left: 0px; position: absolute; text-align: center; top: 0px;&quot; width=&quot;200&quot; /&gt;&lt;img border=&quot;1&quot; height=&quot;200&quot; src=&quot;https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEi910oPY_6lfiylmdqpftHQKvfcS7jIUQ8xteuIVaFJBRCAgWi4hvgKNFomrFJDBqZepJ2C3tpTgT9-tG_hLrFY5OK3OufLSiwm4_6JbT4hGeX9Jp5xyOZvSrK3WnaVGx2JxsaVABTHy2sX/s200/layer_6.png&quot; style=&quot;left: 0px; position: absolute; text-align: center; top: 0px;&quot; width=&quot;200&quot; /&gt;&lt;img border=&quot;1&quot; height=&quot;200&quot; src=&quot;https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEgdnjwcNCg_gh7AlebsafrONbFBlHg-D8GfQlMDaF5PrxouziM_J8v8bdPiToDDrVjAhqd388g2EqYUIt6DeEgZ-MbcsG-ehNgP4CHIpmPNH9cbcotHBYE2ig6tDIf_INcUxCT_pfD1SLqi/s200/layer_31.png&quot; style=&quot;left: 0px; position: absolute; text-align: center; top: 0px;&quot; width=&quot;200&quot; /&gt;&lt;img border=&quot;1&quot; height=&quot;200&quot; src=&quot;https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEhdFBur-HAZnAxICm2yLzkIHmM9Np1tY2ldwbjOQEWUJeOr4d88pfiHfgsSx_11rzC7F4QWCvE5LhnW_szTLDhUcNZETk8tDXR6KY66xU22RswA0E1uRQSTWbKw-C940iklIW8FTMEvjCTz/s200/layer_3.png&quot; style=&quot;left: 0px; position: absolute; text-align: center; top: 0px;&quot; width=&quot;200&quot; /&gt;&lt;img border=&quot;1&quot; height=&quot;200&quot; src=&quot;https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEj5v8VlFAS0h5-_9HZTHFNXuAOzKmiEyoav1i13LeDRUKZJbWUzcYgbzkos3NyJxyccojN-Q6KZym4C9MOxFjTMPqWFEK_EZZlqJFX0534o-8ulH_21PQfy_YTHIbA4AvtyERpp-mSJrPkA/s200/layer_22.png&quot; style=&quot;left: 0px; position: absolute; text-align: center; top: 0px;&quot; width=&quot;200&quot; /&gt;&lt;img border=&quot;1&quot; height=&quot;200&quot; src=&quot;https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEhOhT3h6GLNDQSeoLUjnra6bnryOuQ_qyPxnzrLQ9jMBjM1uyuUTVC6hsfkI4gWqtx0-TurjS0FK0ORNK2rec_-4kP0BAoVoHOpPZfit5iVRX_Ux0Q7drXYEvHjS3JxF1NsDpndEaz2zPLu/s200/layer_27.png&quot; style=&quot;left: 0px; position: absolute; text-align: center; top: 0px;&quot; width=&quot;200&quot; /&gt;&lt;img border=&quot;1&quot; height=&quot;200&quot; src=&quot;https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEgtyxaIQ-D4XjP41HiPcp5ISXbYDVvU3G8yazCGdwxKciJNVDoJP32xRt9BSEzj91aMADoYheTUZX7lfwAIBATC0F5qBChbbAbG1X0VUFS3LwulJ2GJA24CUoefNtv6HmWj0uAAou9H2wDw/s200/layer_34.png&quot; style=&quot;left: 0px; position: absolute; text-align: center; top: 0px;&quot; width=&quot;200&quot; /&gt;&lt;img border=&quot;1&quot; src=&quot;https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEiZ5zGSQUBI6wJT-Wj9LaBWC0wyQa7CPm2UdzIehe0b_DvDZ2Ps_NgiEsNWo-IPnRzuk0MOCpS0xyXokJBvOQUVJyNkflTUePd0B8ni8zlQKmG7G6XoHnyG-4-MD_V8mndefKNuByR8ukPA/s200/layer_1.png&quot; style=&quot;left: 0px; position: absolute; text-align: center; top: 0px;&quot; /&gt;&lt;img border=&quot;1&quot; src=&quot;https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEisXAJsQFRRJA-6Y6F0L2LqW7deQ4hMoPhEzd5UjY169lCNPCVHkl1Hg_o-0H6WXo_rqUNdreVeP4hb2zSgLHBBkuzmFm-E1edmThev2BKT3bttAInnLZhI79tio3xdomQCUJw6Y_RjZauU/s200/layer_10.png&quot; style=&quot;left: 0px; position: absolute; text-align: center; top: 0px;&quot; /&gt;&lt;img border=&quot;1&quot; height=&quot;200&quot; src=&quot;https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEil1ZDetJ__s0Z_Y7_HB_SUpMK8QXeufO5zN8FX_4zSEOYnQVmKzysPyJDatJ1pQ8v5Fp78eTV-W4I5DMqS3AzUCRXIBeoAddsS5BqdyG52u3KtQMQVaCNS37UqlsbkLwUHgl__97JUajOU/s200/layer_9.png&quot; style=&quot;left: 0px; position: absolute; text-align: center; top: 0px;&quot; width=&quot;200&quot; /&gt;&lt;img border=&quot;1&quot; height=&quot;200&quot; src=&quot;https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEgy_Myqc79pGCPy93ZZip5P2oqof0R2UFrnUhmQuMvjmb5kS5uj-Y6YHHnFUTuiKtoaUH_zZ-nvdx0SaeUzNf7AL53VkQjBpONKggfgC3pPQViSDQ57GMth53e5y2AlKoQqbOaIu6XSq1xL/s200/layer_26.png&quot; style=&quot;left: 0px; position: absolute; text-align: center; top: 0px;&quot; width=&quot;200&quot; /&gt;&lt;img border=&quot;1&quot; height=&quot;200&quot; src=&quot;https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEg9v-MFeDpGGykeG_1WVyrwWGbn6Ofkv1RDYTgQDKqSo_hRG8IaD74m51lm36H5zJOOVOo6-04S1kytGnZZnpyBbqHljxUn4c0-RhcOJm72FNRTOKgQQxUWrulmuhblMyP6BMQANFNdhnWK/s200/layer_5.png&quot; style=&quot;left: 0px; position: absolute; text-align: center; top: 0px;&quot; width=&quot;200&quot; /&gt;&lt;img border=&quot;1&quot; height=&quot;200&quot; src=&quot;https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEigXhMjP3ZAhhHSH2U7UNyi9p0hm-naO0P0DtL9eLAzGdPwDDbQLvxHZ8cQyZIaVKp9O3XDIqVM4LFzgRjYeVc_cj1-FD4xe9mV0gacQIU6CGRSk8cva3mjs-khkdUw4174aqqXNesXi35Q/s200/layer_29.png&quot; style=&quot;left: 0px; position: absolute; text-align: center; top: 0px;&quot; width=&quot;200&quot; /&gt;&lt;img border=&quot;1&quot; height=&quot;200&quot; src=&quot;https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEgri6TDuloI2wX-6tMbDWyP6hIFQl_duUKru9CKw5Qg_DOgv77z3uJaj7Cl2YP8nvlcDglJtDGWjIBMQByFhdgX5-jua0Mz13WF29bkYU69ArrqG82tuAjRXLCsOakR0X8G1qZ1tVm7z9-a/s200/layer_20.png&quot; style=&quot;left: 0px; position: absolute; text-align: center; top: 0px;&quot; width=&quot;200&quot; /&gt;&lt;img border=&quot;1&quot; height=&quot;200&quot; src=&quot;https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEi6lK5Dzv_D_IDmR6B_lGw2VMNt6MhQr6lkcJJzTawrid3zVUOUk7mlLLOUJpqyuq6-JiyvYCyVZ-02C3U-IKX4Yr32jxxzyXywDgtf7dCjqMzq98sbDQ71cdowCa1wSRA1BcrYT8fPgCDG/s200/layer_33.png&quot; style=&quot;left: 0px; position: absolute; text-align: center; top: 0px;&quot; width=&quot;200&quot; /&gt;&lt;img border=&quot;1&quot; height=&quot;200&quot; src=&quot;https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEgit7jdx65E66MuYnBufVF78HkrPHFVToJmNDhvM2FmsAVNGJl1bLw23_LFQAoBfN624PzOn5kpgsmVTvKe_sYB3_ItX8t262DWhZovICGcqyd0hnf9h9vI0A_HdG1rRgLuKaFRwce69OHM/s200/layer_17.png&quot; style=&quot;left: 0px; position: absolute; text-align: center; top: 0px;&quot; width=&quot;200&quot; /&gt;&lt;img border=&quot;1&quot; height=&quot;200&quot; src=&quot;https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEg491ru8SyCBh_A2yK0NUFCNdbPpojnm7wIaboFiRlFxz5PEsFfXRGUHfR_3BN-O_tQ38YNPk0dkichXgulKIEVF-_z_2iOmWVRd8Z-YhcL8T0gRsoS9RiVcmGdcQ93Q6u87alJVBiYAuz6/s200/layer_32.png&quot; style=&quot;left: 0px; position: absolute; text-align: center; top: 0px;&quot; width=&quot;200&quot; /&gt;&lt;img border=&quot;1&quot; height=&quot;200&quot; src=&quot;https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEjlHTrMKNgjwQu70760M_nuAYxRUO6w9YRI-cOYmufqp2Gi6zivHsrMUbABBzt0e_l8j66F98ys8yWUk9CBRnmwZZCtRNNzeMki7EL8Rj0o9XWQtSTVXoaYyxKKAH5vhVXZUMVPoT9D_hA6/s200/layer_28.png&quot; style=&quot;left: 0px; position: absolute; text-align: center; top: 0px;&quot; width=&quot;200&quot; /&gt;&lt;img border=&quot;1&quot; height=&quot;200&quot; src=&quot;https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEi1OrTkmYYOsCQzzd5YIwREY0ixZKtXWKWIVG5ZYokMIptGuFoxWr0ifpOfuBSMomkC1lJDuE6tAF_2eiK9BG4WG67XvQmfUS-Mhq7V6f-_zTbLj-1CiS3eE6xatbvIyk3YjdQRx-fNFiIL/s200/layer_16.png&quot; style=&quot;left: 0px; position: absolute; text-align: center; top: 0px;&quot; width=&quot;200&quot; /&gt;&lt;img border=&quot;1&quot; height=&quot;200&quot; src=&quot;https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEhTgNDOMMt1Cvh5OJ0CvupLHfucIBodbbJODNCLlRjwiIPMYiUfY7oHb32ByqJQr2QgtBvlZGkN427w7rla2Q7ndhsO7AZ7FeZ6UumiNkhp6q4twH-EyED4tIFKJ7BXgV5xPEzfQx5H3Cj4/s200/layer_18.png&quot; style=&quot;left: 0px; position: absolute; text-align: center; top: 0px;&quot; width=&quot;200&quot; /&gt;&lt;img border=&quot;1&quot; height=&quot;200&quot; src=&quot;https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEipx2WNpVxTEEoMnfwEZVL8yDk9R3xUhYNc48Luwtz74ClGFxfUSySK-27YXYFJcsfqKIQRAHGBC-LmKHoVMCabrM-j7UtLFV1JRP28-SQVC5jiw8UCze2HO8eAVB_Rmv4E5XXJkw4K61mV/s200/layer_14.png&quot; style=&quot;left: 0px; position: absolute; text-align: center; top: 0px;&quot; width=&quot;200&quot; /&gt;&lt;img border=&quot;1&quot; height=&quot;200&quot; src=&quot;https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEjjT22w92-TCio4849HX8nCZNtA94jdg566xafzxBnU3_5Bhldf5ngJMfQR_INXUPZLQJkiN0boMA082p1jghG9kPji6RUBX1BPC7Iz34xVePNV2cokeFfNrLy1wrmocBfBCw7emz5qAYkE/s200/layer_39.png&quot; style=&quot;left: 0px; position: absolute; text-align: center; top: 0px;&quot; width=&quot;200&quot; /&gt;&lt;img border=&quot;1&quot; height=&quot;200&quot; src=&quot;https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEgz08BlOSZRENMWtoxKwQkw7cpfOlOCEVfERYN94xe8VOhzypBwp9pVi20Qpv3eQwtFjT43dL-Nzo4DogdQFIW_B5uCgiwnP8XPVpzBxt8HYROy9TQHvKCfQls9tyqltlVRFkS1WWgCzjMN/s200/layer_15.png&quot; style=&quot;left: 0px; position: absolute; text-align: center; top: 0px;&quot; width=&quot;200&quot; /&gt;&lt;img border=&quot;1&quot; height=&quot;200&quot; src=&quot;https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEhfkbWQgnr1q1PHCasFtT2s_GzFv4ynAkgg2tk0cUzjyn8ZJoRcOZm6JAMEarMHCky21sLLertJuwwIJQ7MlSB5IjvgxbUP4_cI_BIfUqCHOvsVyf_dTtJTXGfgFktxu4YnDUVOZqeGnp46/s200/layer_4.png&quot; style=&quot;left: 0px; position: absolute; text-align: center; top: 0px;&quot; width=&quot;200&quot; /&gt;&lt;img border=&quot;1&quot; height=&quot;200&quot; src=&quot;https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEjQ117FfScFQi5xvxgWrLap1kG2_ki2b1C5FBKKNGXccJ-u32yuhrMQZzE4pPocCpOXAr04LtI8_hYStMrzirv8LBQzpV6ziEASWiV7_Ks5V6jJIEDeFQO0ugZ7oF3lFE9JIy1xK49aRHPT/s200/layer_2.png&quot; style=&quot;left: 0px; position: absolute; text-align: center; top: 0px;&quot; width=&quot;200&quot; /&gt;&lt;img border=&quot;1&quot; height=&quot;200&quot; src=&quot;https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEgqD-jtpCzCo0qXQks24mKoZIpChmzGfBnBPd6mufhg9JACrBcBnM4MJgLwtjZHlZKwC7mNcnuBYLzJn3AQQtLg4rxEl7n5ROoC0FCEmagps2mDRynKhNHyMufMR9dBl5GZ0cMzMgvTCYO6/s200/layer_37.png&quot; style=&quot;left: 0px; position: absolute; text-align: center; top: 0px;&quot; width=&quot;200&quot; /&gt;&lt;img border=&quot;1&quot; height=&quot;200&quot; src=&quot;https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEgA4pcrjOyuxybPZ9fvSIUpshNrZu0se-QONfXMEY2bryIYVjUPHrYg4ImH6WSSjkOYAntGsU4j5Cqm44p9eQRbi8ZiFmry_gazaYz8cSpvAGPpYOcPdu0wcRXdJze94Q6Hpn3kfRlf6fjp/s200/layer_7.png&quot; style=&quot;left: 0px; position: absolute; text-align: center; top: 0px;&quot; width=&quot;200&quot; /&gt;&lt;img border=&quot;1&quot; height=&quot;200&quot; src=&quot;https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEj9EmYmybFqlAkSPjW3CJVIxdqhvgQLp192NNaReE7vxOVIDK6yiWX5zJzTF2AblrvVV9d67yIawhdtfuu5AEPfYgTFoGLHQbf09-J718Zp78p6NBsj-4Zn8lHoDaBImavfRKOqQurSOa2n/s200/layer_12.png&quot; style=&quot;left: 0px; position: absolute; text-align: center; top: 0px;&quot; width=&quot;200&quot; /&gt;&lt;img border=&quot;1&quot; height=&quot;200&quot; src=&quot;https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEh8xa3ltJqhLs2inAYYaarsPI4YdYPNwNN7nHJ5AGqbqfVvFiiimmc17stIhlS65wkNPUbcvI54JCZa0oUMPSgrDPLO1Fj0AlrpIWXEUw4xuBo9oPRdmaGkjzUYmFmgx1K1nWn0I0RBqq1a/s200/layer_36.png&quot; style=&quot;left: 0px; position: absolute; text-align: center; top: 0px;&quot; width=&quot;200&quot; /&gt;&lt;img border=&quot;1&quot; height=&quot;200&quot; src=&quot;https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEiKJuuYvJHOyrfT8lmC4C36a6sDVdc_GDPqUApMU8HNU4R4Ax5SYSm5g22-KvNfxdWGPHZnnCzHw_kqcneZ3bEFlBWezvv_66uiB12Zq_FlwXCIzto7J-xUCpaUDKO4opSPdpV3YRQIzt_M/s200/layer_23.png&quot; style=&quot;left: 0px; position: absolute; text-align: center; top: 0px;&quot; width=&quot;200&quot; /&gt;&lt;img border=&quot;1&quot; height=&quot;200&quot; src=&quot;https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEjlURp2zGbzyLwbrpvDqZuaJFQFcK5FcYd5cRuwNETt-5HDE6j_LE8y0rxyqSRsDe3Sr532XlSjekny-a9QW7BhD5QnqNV_RMLkbwlSM6ZOjQWF1aO4zwCL3sLoa9OukQEy1AU8EFyL-ck9/s200/layer_38.png&quot; style=&quot;left: 0px; position: absolute; text-align: center; top: 0px;&quot; width=&quot;200&quot; /&gt;&lt;img border=&quot;1&quot; height=&quot;200&quot; src=&quot;https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEhc5NmJhksLK2pARE_hyZ09mjbAnOcf4LqC23l-iUH5EdRq751DGps31Ga51wu92O-0bpiO8Ca3jCngLSet6LhFQhSGw-_95lvdCYbsYcy_WfOuN6AYP3dAiFE3QXXOKJ1ldaFsTqSBIrau/s200/layer_8.png&quot; style=&quot;left: 0px; position: absolute; text-align: center; top: 0px;&quot; width=&quot;200&quot; /&gt;&lt;img border=&quot;1&quot; height=&quot;200&quot; src=&quot;https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEgiHl6_05Vm0oqhUPrR1wob9MTMlkTWCGEnfN-V4TBDg2mKm3aGZ7xoUQJxgVPHscGJdu0hXRTzDvC8rhAhFXHuAT-AkjqxZeo_YoI50OiLDAtS-M_zKdQvkn5CSQ7jYl2jYZw2bAFX5lSA/s200/layer_30.png&quot; style=&quot;left: 0px; position: absolute; text-align: center; top: 0px;&quot; width=&quot;200&quot; /&gt;&lt;img border=&quot;1&quot; height=&quot;200&quot; src=&quot;https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEiSrpOz4hRE4lbZDqU0jo34m39GJ4vl0qB4L1hNPleoNnl0wZAMUyqziezu3IQmUEu2gtXq2rJLRV_6Klz35D7vrYrAQuTtm-W4KWn4uZJa9e8DbMzIBO3isIa_dMYUrAZKaoW0lQ_PdB9c/s200/layer_21.png&quot; style=&quot;left: 0px; position: absolute; text-align: center; top: 0px;&quot; width=&quot;200&quot; /&gt;&lt;img border=&quot;1&quot; height=&quot;200&quot; src=&quot;https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEjn4alI1Cf3kJ5uPBruGC_iMghEfk2zfVOOatThE9AQPDOVB5olm9VnnzpuUquBqO6YbEBjpZsxyEiALc6S7q0YEUXGn6PEUo0tqlS0Eg27Eg9NN90Uh8FaBq7FlniwcoD9BN6_WlHAlyBq/s200/layer_13.png&quot; style=&quot;left: 0px; position: absolute; text-align: center; top: 0px;&quot; width=&quot;200&quot; /&gt;&lt;img border=&quot;1&quot; src=&quot;https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEgmhmxiXwmnS8QeUypLTVzHeBkq3GkbFJT3j3gI579CmmHZSKb9yF02HC7wyrb6wudU7xYmeqt1aPz0KWQcE2aKj7Gl9fWjJK4WNi2_cHfoYkq7pIL3Ru5QcvCPQcb2XrDhmv-05O2LsFYB/s200/layer_11.png&quot; style=&quot;left: 0px; position: absolute; text-align: center; top: 0px;&quot; /&gt;&lt;img border=&quot;1&quot; height=&quot;200&quot; src=&quot;https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEiETAs_YGZgW4EeYMa-MKHfuySWQeubpHvWbta3trNHAS_ZMFmxgtL3fXDVFzAtCsUpVgXeAnVzYNSioUNrJwp-k9zOUQJFSNH3IJ5kpReOhquT7uCQPeLCbs9Aqw_rTsQrSKz6VfNQsp9h/s200/layer_24.png&quot; style=&quot;left: 0px; position: absolute; text-align: center; top: 0px;&quot; width=&quot;200&quot; /&gt;&lt;img border=&quot;1&quot; height=&quot;200&quot; src=&quot;https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEjhXwzc2IeGOLMNYyCTbxxnebaFSEvH4C_NS9b6cnLVhb8Rt02XOrqFry2vMb_8GJiTPXx5wdqy0rXt5jl_4wZfor2jnV1CdP2mW57uYDvhNiIzINVRCI0ISNNy0mgEw1EDd-wzL8qzui70/s200/layer_35.png&quot; style=&quot;left: 0px; position: absolute; text-align: center; top: 0px;&quot; width=&quot;200&quot; /&gt;&lt;img border=&quot;1&quot; height=&quot;200&quot; src=&quot;https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEhOPlyvBE33K0812DajQEz0oVcnxj3ctGwRbTNQAhI7G0iQ9PJJ7e0IpHIrKAeVl23qmfvLds-apogHxtClyTyy5caHsw39-xkLH6CNVg9AMR60H8yOYBAhvwJOFHOOZTUrlimx3KJApecn/s200/layer_25.png&quot; style=&quot;left: 0px; position: absolute; text-align: center; top: 0px;&quot; width=&quot;200&quot; /&gt;&lt;img border=&quot;1&quot; height=&quot;200&quot; src=&quot;https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEiwKir1cqVjyZ_Kr7rhyssKnx5UhSYaJ5lmMbB0YvNhwaJmZR-sUwrR_2e1L0RzVCr2EskOoLVPmRhIOLu7awnqJMR9OgaYDPgSpCRSV4V2na6YhAycUJCm1b0A7ZYeQEpZ5exrNNGThKTP/s200/layer_19.png&quot; style=&quot;left: 0px; position: absolute; text-align: center; top: 0px;&quot; width=&quot;200&quot; /&gt;&lt;img border=&quot;1&quot; height=&quot;200&quot; src=&quot;https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEi910oPY_6lfiylmdqpftHQKvfcS7jIUQ8xteuIVaFJBRCAgWi4hvgKNFomrFJDBqZepJ2C3tpTgT9-tG_hLrFY5OK3OufLSiwm4_6JbT4hGeX9Jp5xyOZvSrK3WnaVGx2JxsaVABTHy2sX/s200/layer_6.png&quot; style=&quot;left: 0px; position: absolute; text-align: center; top: 0px;&quot; width=&quot;200&quot; /&gt;&lt;img border=&quot;1&quot; height=&quot;200&quot; src=&quot;https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEgdnjwcNCg_gh7AlebsafrONbFBlHg-D8GfQlMDaF5PrxouziM_J8v8bdPiToDDrVjAhqd388g2EqYUIt6DeEgZ-MbcsG-ehNgP4CHIpmPNH9cbcotHBYE2ig6tDIf_INcUxCT_pfD1SLqi/s200/layer_31.png&quot; style=&quot;left: 0px; position: absolute; text-align: center; top: 0px;&quot; width=&quot;200&quot; /&gt;&lt;img border=&quot;1&quot; height=&quot;200&quot; src=&quot;https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEhdFBur-HAZnAxICm2yLzkIHmM9Np1tY2ldwbjOQEWUJeOr4d88pfiHfgsSx_11rzC7F4QWCvE5LhnW_szTLDhUcNZETk8tDXR6KY66xU22RswA0E1uRQSTWbKw-C940iklIW8FTMEvjCTz/s200/layer_3.png&quot; style=&quot;left: 0px; position: absolute; text-align: center; top: 0px;&quot; width=&quot;200&quot; /&gt;&lt;img border=&quot;1&quot; height=&quot;200&quot; src=&quot;https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEj5v8VlFAS0h5-_9HZTHFNXuAOzKmiEyoav1i13LeDRUKZJbWUzcYgbzkos3NyJxyccojN-Q6KZym4C9MOxFjTMPqWFEK_EZZlqJFX0534o-8ulH_21PQfy_YTHIbA4AvtyERpp-mSJrPkA/s200/layer_22.png&quot; style=&quot;left: 0px; position: absolute; text-align: center; top: 0px;&quot; width=&quot;200&quot; /&gt;&lt;img border=&quot;1&quot; height=&quot;200&quot; src=&quot;https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEhOhT3h6GLNDQSeoLUjnra6bnryOuQ_qyPxnzrLQ9jMBjM1uyuUTVC6hsfkI4gWqtx0-TurjS0FK0ORNK2rec_-4kP0BAoVoHOpPZfit5iVRX_Ux0Q7drXYEvHjS3JxF1NsDpndEaz2zPLu/s200/layer_27.png&quot; style=&quot;left: 0px; position: absolute; text-align: center; top: 0px;&quot; width=&quot;200&quot; /&gt;&lt;img border=&quot;1&quot; height=&quot;200&quot; src=&quot;https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEgtyxaIQ-D4XjP41HiPcp5ISXbYDVvU3G8yazCGdwxKciJNVDoJP32xRt9BSEzj91aMADoYheTUZX7lfwAIBATC0F5qBChbbAbG1X0VUFS3LwulJ2GJA24CUoefNtv6HmWj0uAAou9H2wDw/s200/layer_34.png&quot; style=&quot;left: 0px; position: absolute; text-align: center; top: 0px;&quot; width=&quot;200&quot; /&gt;&lt;/div&gt;
&lt;div&gt;
Because the image does not get displayed well, here is a screenshot.&lt;br /&gt;
&lt;div class=&quot;separator&quot; style=&quot;clear: both; text-align: center;&quot;&gt;
&lt;br /&gt;&lt;/div&gt;
&lt;div class=&quot;separator&quot; style=&quot;clear: both; text-align: center;&quot;&gt;
&lt;br /&gt;&lt;/div&gt;
&lt;div class=&quot;separator&quot; style=&quot;clear: both; text-align: center;&quot;&gt;
&lt;br /&gt;&lt;/div&gt;
&lt;div class=&quot;separator&quot; style=&quot;clear: both; text-align: center;&quot;&gt;
&lt;br /&gt;&lt;/div&gt;
&lt;div class=&quot;separator&quot; style=&quot;clear: both; text-align: center;&quot;&gt;
&lt;br /&gt;&lt;/div&gt;
&lt;div class=&quot;separator&quot; style=&quot;clear: both; text-align: center;&quot;&gt;
&lt;br /&gt;&lt;/div&gt;
&lt;div class=&quot;separator&quot; style=&quot;clear: both; text-align: center;&quot;&gt;
&lt;br /&gt;&lt;/div&gt;
&lt;div class=&quot;separator&quot; style=&quot;clear: both; text-align: center;&quot;&gt;
&lt;br /&gt;&lt;/div&gt;
&lt;div class=&quot;separator&quot; style=&quot;clear: both; text-align: center;&quot;&gt;
&lt;br /&gt;&lt;/div&gt;
&lt;div class=&quot;separator&quot; style=&quot;clear: both; text-align: center;&quot;&gt;
&lt;br /&gt;&lt;/div&gt;
&lt;div class=&quot;separator&quot; style=&quot;clear: both; text-align: center;&quot;&gt;
&lt;br /&gt;&lt;/div&gt;
&lt;div class=&quot;separator&quot; style=&quot;clear: both; text-align: center;&quot;&gt;
You can see also the map in overlapping layers here&amp;nbsp;&lt;/div&gt;
&lt;div class=&quot;separator&quot; style=&quot;clear: both; text-align: center;&quot;&gt;
&lt;a href=&quot;http://pine02.fosm.org/examplemap/example.html&quot;&gt;http://pine02.fosm.org/examplemap/example.html&lt;/a&gt;&lt;/div&gt;
&lt;div class=&quot;separator&quot; style=&quot;clear: both; text-align: center;&quot;&gt;
&lt;br /&gt;&lt;/div&gt;
&lt;div class=&quot;separator&quot; style=&quot;clear: both; text-align: center;&quot;&gt;
&lt;a href=&quot;https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEi3__BLOGVaLw6tj7TZXiHF9zqwwksskTAqu1KIEX2j6gTOBI3Xqrfx4eMyjfRaGK9s15zTIabxqH3oItn1TLLepaDtc0h4iW7KQOUWq977bmmH3deff_T7Tik1JrS64eY35rXULqQE1ZJd/s1600/Screenshot+-+041512+-+22:26:18.png&quot; imageanchor=&quot;1&quot; style=&quot;margin-left: 1em; margin-right: 1em;&quot;&gt;&lt;img border=&quot;0&quot; height=&quot;316&quot; src=&quot;https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEi3__BLOGVaLw6tj7TZXiHF9zqwwksskTAqu1KIEX2j6gTOBI3Xqrfx4eMyjfRaGK9s15zTIabxqH3oItn1TLLepaDtc0h4iW7KQOUWq977bmmH3deff_T7Tik1JrS64eY35rXULqQE1ZJd/s320/Screenshot+-+041512+-+22:26:18.png&quot; width=&quot;320&quot; /&gt;&lt;/a&gt;&lt;/div&gt;
&lt;br /&gt;
Here is the result of&amp;nbsp;for x in layer_*.png; do echo $x; composite $x total.png total.png; done,&lt;br /&gt;
for the record, dont run this &quot;composite layer*.png total.png&quot; it crashed my computer:&lt;br /&gt;
&lt;div class=&quot;separator&quot; style=&quot;clear: both; text-align: center;&quot;&gt;
&lt;br /&gt;&lt;/div&gt;
&lt;br /&gt;
&lt;br /&gt;
Some of the partitioning is great, and some Is not good, there is alot of room for experimentation.&lt;br /&gt;
&lt;div class=&quot;separator&quot; style=&quot;clear: both; text-align: center;&quot;&gt;
&lt;br /&gt;&lt;/div&gt;
&lt;div class=&quot;separator&quot; style=&quot;clear: both; text-align: center;&quot;&gt;
This is one partition that is a problem good, it contains all the state boundries, but really we want to have each state on its own.&lt;/div&gt;
&lt;div class=&quot;separator&quot; style=&quot;clear: both; text-align: center;&quot;&gt;
&lt;a href=&quot;https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEil1ZDetJ__s0Z_Y7_HB_SUpMK8QXeufO5zN8FX_4zSEOYnQVmKzysPyJDatJ1pQ8v5Fp78eTV-W4I5DMqS3AzUCRXIBeoAddsS5BqdyG52u3KtQMQVaCNS37UqlsbkLwUHgl__97JUajOU/s1600/layer_9.png&quot; imageanchor=&quot;1&quot; style=&quot;background-color: white; margin-left: 1em; margin-right: 1em;&quot;&gt;&lt;img border=&quot;0&quot; height=&quot;320&quot; src=&quot;https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEil1ZDetJ__s0Z_Y7_HB_SUpMK8QXeufO5zN8FX_4zSEOYnQVmKzysPyJDatJ1pQ8v5Fp78eTV-W4I5DMqS3AzUCRXIBeoAddsS5BqdyG52u3KtQMQVaCNS37UqlsbkLwUHgl__97JUajOU/s320/layer_9.png&quot; width=&quot;320&quot; /&gt;&lt;/a&gt;&lt;/div&gt;
&lt;br /&gt;
This one is basically perfect &amp;nbsp;:&lt;br /&gt;
&lt;div class=&quot;separator&quot; style=&quot;clear: both; text-align: center;&quot;&gt;
&lt;a href=&quot;https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEhfkbWQgnr1q1PHCasFtT2s_GzFv4ynAkgg2tk0cUzjyn8ZJoRcOZm6JAMEarMHCky21sLLertJuwwIJQ7MlSB5IjvgxbUP4_cI_BIfUqCHOvsVyf_dTtJTXGfgFktxu4YnDUVOZqeGnp46/s1600/layer_4.png&quot; imageanchor=&quot;1&quot; style=&quot;margin-left: 1em; margin-right: 1em;&quot;&gt;&lt;img border=&quot;0&quot; height=&quot;320&quot; src=&quot;https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEhfkbWQgnr1q1PHCasFtT2s_GzFv4ynAkgg2tk0cUzjyn8ZJoRcOZm6JAMEarMHCky21sLLertJuwwIJQ7MlSB5IjvgxbUP4_cI_BIfUqCHOvsVyf_dTtJTXGfgFktxu4YnDUVOZqeGnp46/s320/layer_4.png&quot; width=&quot;320&quot; /&gt;&lt;/a&gt;&lt;/div&gt;
&lt;br /&gt;
&lt;br /&gt;
I am also experimenting with chaco&amp;nbsp;&lt;a href=&quot;http://www.sandia.gov/~bahendr/chaco.html&quot;&gt;http://www.sandia.gov/~bahendr/chaco.html&lt;/a&gt;&amp;nbsp;and looking into scotch&amp;nbsp;&lt;a href=&quot;http://www.labri.u-bordeaux.fr/perso/pelegrin/scotch/&quot;&gt;http://www.labri.u-bordeaux.fr/perso/pelegrin/scotch/&lt;/a&gt;.&lt;/div&gt;
&lt;div&gt;
&lt;br /&gt;&lt;/div&gt;
&lt;div&gt;
See also my post here:&lt;/div&gt;
&lt;div&gt;
&lt;a href=&quot;http://glaros.dtc.umn.edu/gkhome/node/848&quot;&gt;http://glaros.dtc.umn.edu/gkhome/node/848&lt;/a&gt;&lt;/div&gt;
&lt;div&gt;
&lt;br /&gt;&lt;/div&gt;
&lt;div&gt;
&lt;br /&gt;&lt;/div&gt;
&lt;div&gt;
I found a small problem with mapnik that If I render multiple datafiles in one pass it only keeps the first data loaded.&amp;nbsp;&lt;a href=&quot;https://bugs.launchpad.net/ubuntu/+source/mapnik/+bug/982548&quot;&gt;https://bugs.launchpad.net/ubuntu/+source/mapnik/+bug/982548&lt;/a&gt;&lt;/div&gt;
&lt;/div&gt;</content><link rel='replies' type='application/atom+xml' href='http://osmopenlayers.blogspot.com/feeds/7078275802235554092/comments/default' title='Post Comments'/><link rel='replies' type='text/html' href='http://osmopenlayers.blogspot.com/2012/04/metis-is-running-as-graph-partitioner.html#comment-form' title='0 Comments'/><link rel='edit' type='application/atom+xml' href='http://www.blogger.com/feeds/1825393237232252749/posts/default/7078275802235554092'/><link rel='self' type='application/atom+xml' href='http://www.blogger.com/feeds/1825393237232252749/posts/default/7078275802235554092'/><link rel='alternate' type='text/html' href='http://osmopenlayers.blogspot.com/2012/04/metis-is-running-as-graph-partitioner.html' title='metis is running as graph partitioner for OSM'/><author><name>H4ck3rm1k3</name><uri>http://www.blogger.com/profile/04484528013589914857</uri><email>noreply@blogger.com</email><gd:image rel='http://schemas.google.com/g/2005#thumbnail' width='16' height='16' src='https://img1.blogblog.com/img/b16-rounded.gif'/></author><media:thumbnail xmlns:media="http://search.yahoo.com/mrss/" url="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEi-9GJoZ0E-i4UYTpsV1mPiqAmL2K489yYtpwL_YWlNiby3uEaaBYzLJDTzxW0bDf_a2UNx_CuVKTt4L3PjhyF0_2MT1oswSUAEUA8vWvPcYAnotajypcJ2o5S_PDAji9sqaA3qzQg6GmMq/s72-c/total.png" height="72" width="72"/><thr:total>0</thr:total></entry><entry><id>tag:blogger.com,1999:blog-1825393237232252749.post-6530816730271267253</id><published>2012-04-15T05:13:00.002-07:00</published><updated>2012-04-15T05:13:47.109-07:00</updated><title type='text'>Current work on a new OSM file format</title><content type='html'>&lt;div dir=&quot;ltr&quot; style=&quot;text-align: left;&quot; trbidi=&quot;on&quot;&gt;
&lt;br /&gt;
&lt;br /&gt;
I have worked on some example programs to compact and optimized the osm data.&lt;br /&gt;
This is based on the ideas of hypertable/bigtable&amp;nbsp;&lt;a href=&quot;http://hypertable.org/&quot;&gt;http://hypertable.org/&lt;/a&gt;&amp;nbsp;in that each column gets stored into its own compact file. But my keys are just positional indexes right now and I am just working on &amp;nbsp;optimizing the file format and tools to work on small clusters.&lt;br /&gt;
&lt;br /&gt;
The processing so far reads the graphs produced by these perl scripts, which are not 100% yet, they only extract the basic data from osm data,&amp;nbsp;&lt;a href=&quot;https://github.com/h4ck3rm1k3/OSM-Binary-Format/blob/master/process.pl&quot;&gt;https://github.com/h4ck3rm1k3/OSM-Binary-Format/blob/master/process.pl&lt;/a&gt;&amp;nbsp;which dumps yaml files they are then converted to the binary format , by a series of scripts.&lt;br /&gt;
&lt;br /&gt;
Process node ids write the vector of node and way index files :&lt;br /&gt;
&lt;a href=&quot;https://github.com/h4ck3rm1k3/OSM-Binary-Format/blob/master/process_nodeids.pl&quot;&gt;https://github.com/h4ck3rm1k3/OSM-Binary-Format/blob/master/process_nodeids.pl&lt;/a&gt;&lt;br /&gt;
&lt;br /&gt;
&lt;blockquote class=&quot;tr_bq&quot;&gt;
ProcessVector(&quot;nodeindex.yml&quot;,&quot;nodeindex.bin&quot;);&lt;br /&gt;ProcessVector(&quot;wayindex.yml&quot;,&quot;wayindex.bin&quot;);&lt;/blockquote&gt;
&lt;br /&gt;
Process&amp;nbsp;process_latlon.pl&amp;nbsp;&lt;a href=&quot;https://github.com/h4ck3rm1k3/OSM-Binary-Format/blob/master/process_latlon.pl&quot;&gt;https://github.com/h4ck3rm1k3/OSM-Binary-Format/blob/master/process_latlon.pl&lt;/a&gt;&amp;nbsp;reads the lat lon and write them to thier own vector files.&lt;br /&gt;
&lt;br /&gt;
The graphs are processed in a complex way right now, and I will be reworking that to make it simple,&lt;br /&gt;
&lt;a href=&quot;https://github.com/h4ck3rm1k3/OSM-Binary-Format/blob/master/reprocesswaynodes.pl&quot;&gt;https://github.com/h4ck3rm1k3/OSM-Binary-Format/blob/master/reprocesswaynodes.pl&lt;/a&gt;&amp;nbsp;this is used to read the yaml into a c structure, which is compiled and emitted into a binary file.&lt;br /&gt;
&lt;br /&gt;
The c representation of the graph in static memory is based on each way being stored as an array, where the node indexes are stored as integers. &amp;nbsp;This is the fastest possible loading speed,&lt;br /&gt;
beating even loading from binary vector files directly. Here is an example of the generated c code :&lt;br /&gt;
&lt;blockquote class=&quot;tr_bq&quot;&gt;
&lt;br /&gt;int waynodes_7 []= {725,578,861725,861276,861258,783,861277,11985,0};&lt;/blockquote&gt;
The 0 represents the end of vector. The overhead of the assembly code shows that only the sizes are added to the binary.&lt;br /&gt;
&lt;br /&gt;
The total way vector looks like this :&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;blockquote class=&quot;tr_bq&quot;&gt;
int waycount = 79354;&lt;br /&gt;int * waynodes[] = {waynodes_0,&lt;br /&gt;waynodes_1,&lt;br /&gt;waynodes_2,&lt;br /&gt;waynodes_3, ...}&lt;/blockquote&gt;
&lt;br /&gt;
I stored the total length as well but I dont think I need it.&lt;br /&gt;
Now this format is great, but people dont want to use a compiler to update the osm data.&lt;br /&gt;
All of the c routines do not use malloc at all directly, only indirectly via boost and stl.&lt;br /&gt;
&lt;br /&gt;
Now this file is compiled together with a driver and you can load the data in milliseconds and execute, here is an example program :&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&amp;nbsp;&lt;a href=&quot;https://github.com/h4ck3rm1k3/OSM-Binary-Format/blob/master/ways.c&quot;&gt;https://github.com/h4ck3rm1k3/OSM-Binary-Format/blob/master/ways.c&lt;/a&gt;&lt;br /&gt;
&lt;blockquote class=&quot;tr_bq&quot;&gt;
#include &amp;lt;stdio.h&amp;gt;&lt;br /&gt;extern int * waynodes[];&lt;br /&gt;extern int &amp;nbsp;waycount;&lt;br /&gt;int main ()&lt;br /&gt;{&lt;br /&gt;&amp;nbsp; int i=0;&lt;br /&gt;&amp;nbsp; for (i =0; i &amp;lt; waycount; i++) &amp;nbsp; &amp;nbsp;{&lt;br /&gt;&amp;nbsp; &amp;nbsp; printf(&quot;way %d :&quot;,i);&lt;br /&gt;&amp;nbsp; &amp;nbsp; int j;&lt;br /&gt;&amp;nbsp; &amp;nbsp; for (j =0; waynodes[i][j]; j++) &amp;nbsp; &amp;nbsp;{&lt;br /&gt;&amp;nbsp; &amp;nbsp; &amp;nbsp; printf(&quot;%d,&quot;,waynodes[i][j]);&lt;br /&gt;&amp;nbsp; &amp;nbsp; }&lt;br /&gt;&amp;nbsp; &amp;nbsp; printf(&quot;\n&quot;);&lt;br /&gt;&amp;nbsp; }&lt;br /&gt;}&lt;/blockquote&gt;
&lt;br /&gt;
To write this to a binary file, I made this program so that the data does not have to be compiled in :&lt;br /&gt;
&lt;a href=&quot;https://github.com/h4ck3rm1k3/OSM-Binary-Format/blob/master/waysbin.c&quot;&gt;https://github.com/h4ck3rm1k3/OSM-Binary-Format/blob/master/waysbin.c&lt;/a&gt;&lt;br /&gt;
&lt;br /&gt;
The program is simple and it writes the data just like the layout in memory, but with prefixed sizes :&lt;br /&gt;
The first integer is&amp;nbsp;&lt;span style=&quot;background-color: white; color: #333333; font-family: &#39;Bitstream Vera Sans Mono&#39;, &#39;Courier New&#39;, monospace; font-size: 12px; line-height: 16px; text-align: -webkit-auto; white-space: pre;&quot;&gt;waycount &lt;/span&gt;each following line contains the way index, the count of indexes and the index data itself. This is what I consider to be an optimal file format for storing the way/node data from osm. The tags, versions and other attributes are not stored yet, but can be stored in separate files themselves.&lt;br /&gt;
&lt;br /&gt;
I will be reworking them to read osm/pbf files directly an emit the binary format, but it is not a priority right now.&lt;br /&gt;
&lt;br /&gt;
I have also tools to read this data into boost graphs and can run the boost graph lib algorithms on them, see the strong&amp;nbsp;&lt;a href=&quot;https://github.com/h4ck3rm1k3/OSM-Binary-Format/blob/master/strongcomponents.cpp&quot;&gt;https://github.com/h4ck3rm1k3/OSM-Binary-Format/blob/master/strongcomponents.cpp&lt;/a&gt;&amp;nbsp;and connected component&amp;nbsp;&lt;a href=&quot;https://github.com/h4ck3rm1k3/OSM-Binary-Format/blob/master/conncomponents.cpp&quot;&gt;https://github.com/h4ck3rm1k3/OSM-Binary-Format/blob/master/conncomponents.cpp&lt;/a&gt;&amp;nbsp;&amp;nbsp;tools for that. &lt;br /&gt;
&lt;br /&gt;
Then I have a tool to reproduce the osm data&amp;nbsp;&lt;a href=&quot;https://github.com/h4ck3rm1k3/OSM-Binary-Format/blob/master/readalldata.cpp&quot;&gt;https://github.com/h4ck3rm1k3/OSM-Binary-Format/blob/master/readalldata.cpp&lt;/a&gt;&amp;nbsp;from the component list, and there are issues with splitting ways across components, currently I assume that there is only one component per way, but that is not true for strong components.&lt;br /&gt;
&lt;br /&gt;
In this process I have created a C++ class for providing a simple and easy to compile interface to this data&amp;nbsp;&lt;a href=&quot;https://github.com/h4ck3rm1k3/OSM-Binary-Format/blob/master/FOSMBin.hpp&quot;&gt;https://github.com/h4ck3rm1k3/OSM-Binary-Format/blob/master/FOSMBin.hpp&lt;/a&gt;&lt;br /&gt;
&lt;div&gt;
&lt;br /&gt;&lt;/div&gt;
&lt;div&gt;
this is just work in progress and I am looking int partitioning the graphs and will be reporting on that soon.&lt;/div&gt;
&lt;div&gt;
&lt;br /&gt;&lt;/div&gt;
&lt;div&gt;
mike&lt;/div&gt;
&lt;/div&gt;</content><link rel='replies' type='application/atom+xml' href='http://osmopenlayers.blogspot.com/feeds/6530816730271267253/comments/default' title='Post Comments'/><link rel='replies' type='text/html' href='http://osmopenlayers.blogspot.com/2012/04/current-work-on-new-osm-file-format.html#comment-form' title='0 Comments'/><link rel='edit' type='application/atom+xml' href='http://www.blogger.com/feeds/1825393237232252749/posts/default/6530816730271267253'/><link rel='self' type='application/atom+xml' href='http://www.blogger.com/feeds/1825393237232252749/posts/default/6530816730271267253'/><link rel='alternate' type='text/html' href='http://osmopenlayers.blogspot.com/2012/04/current-work-on-new-osm-file-format.html' title='Current work on a new OSM file format'/><author><name>H4ck3rm1k3</name><uri>http://www.blogger.com/profile/04484528013589914857</uri><email>noreply@blogger.com</email><gd:image rel='http://schemas.google.com/g/2005#thumbnail' width='16' height='16' src='https://img1.blogblog.com/img/b16-rounded.gif'/></author><thr:total>0</thr:total></entry><entry><id>tag:blogger.com,1999:blog-1825393237232252749.post-1671507965350463297</id><published>2012-04-10T03:15:00.002-07:00</published><updated>2012-04-10T03:15:30.665-07:00</updated><title type='text'>Ideas on splitting up the world, examples</title><content type='html'>&lt;div dir=&quot;ltr&quot; style=&quot;text-align: left;&quot; trbidi=&quot;on&quot;&gt;
Some ideas that I had yesterday :&lt;br /&gt;
&lt;br /&gt;
1. Admin regions are relations or ways. We want to be able to determine which FOSM node blocks they occur in. The FOSM node blocks are sorted by location, so we will first need to index the blocks and determine which node ids occur in each block. Then we will look at the ways and relations that reference them. We should be able to enrich the nodes to contain enough information that they can be selected directly.&lt;br /&gt;
&lt;br /&gt;
The osm node ids are not very useful in this context, ideally we would use an id that allows us to select the block of data. Given the splitting of the world that we have created, we will do some examples of that.&lt;br /&gt;
&lt;br /&gt;
Lets look into this in detail :&lt;br /&gt;
&lt;a href=&quot;http://www.openstreetmap.org/index.html?mlat=42.666667&amp;amp;mlon=21.166667&amp;amp;zoom=12&amp;amp;layers=B000FTF&quot;&gt;http://www.openstreetmap.org/index.html?mlat=42.666667&amp;amp;mlon=21.166667&amp;amp;zoom=12&amp;amp;layers=B000FTF&lt;/a&gt;&lt;br /&gt;
&lt;br /&gt;
Prishtina is at&amp;nbsp;lat=42.666667 lon=21.166667, so we can round that down to 42.66, 21.17 and get basically a center of the map.&lt;br /&gt;
&lt;br /&gt;
Now according to my block index, what blocks are contained in there?&lt;br /&gt;
&lt;a href=&quot;http://pine02.fosm.org/FOSM-Api/OSM-API-Proxy/public/spatialite.cgi/contains/42.66/21.17&quot;&gt;http://pine02.fosm.org/FOSM-Api/OSM-API-Proxy/public/spatialite.cgi/contains/42.66/21.17&lt;/a&gt;&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;h1 style=&quot;text-align: -webkit-auto;&quot;&gt;
List of blocks in planet around lat :42.66 and lon :21.17&lt;/h1&gt;
&lt;table&gt;&lt;tbody&gt;
&lt;tr&gt;&lt;th&gt;bytepos integer&lt;/th&gt;&lt;th&gt;bitpos integer&lt;/th&gt;&lt;th&gt;blocksize integer&lt;/th&gt;&lt;th&gt;blocktotal integer&lt;/th&gt;&lt;th&gt;first_lat double&lt;/th&gt;&lt;th&gt;last_lat double&lt;/th&gt;&lt;th&gt;first_lon double&lt;/th&gt;&lt;th&gt;last_lon double&lt;/th&gt;&lt;th&gt;upper_left POINT&lt;/th&gt;&lt;th&gt;lower_right POINT&lt;/th&gt;&lt;th&gt;bbox POLYGON&lt;/th&gt;&lt;th&gt;area double&lt;/th&gt;&lt;th&gt;cpoint POINT&lt;/th&gt;&lt;/tr&gt;
&lt;tr&gt;&lt;td&gt;12582077836&lt;/td&gt;&lt;td&gt;100656622695&lt;/td&gt;&lt;td&gt;899902&lt;/td&gt;&lt;td&gt;209166217368&lt;/td&gt;&lt;td&gt;42.222356&lt;/td&gt;&lt;td&gt;42.805525&lt;/td&gt;&lt;td&gt;21.036589&lt;/td&gt;&lt;td&gt;21.212655&lt;/td&gt;&lt;td&gt; æ ²då] 5@á R)v E@²då] 5@á R)v E@| ²då] 5@á R)v E@þ&lt;/td&gt;&lt;td&gt; æ µTÞp65@&quot;uq gE@µTÞp65@&quot;uq gE@| µTÞp65@&quot;uq gE@þ&lt;/td&gt;&lt;td&gt; æ ²då] 5@á R)v E@µTÞp65@&quot;uq gE@|   ²då] 5@á R)v E@µTÞp65@á R)v E@µTÞp65@&quot;uq gE@²då] 5@&quot;uq gE@²då] 5@á R)v E@þ&lt;/td&gt;&lt;td&gt;0.102676233154002&lt;/td&gt;&lt;td&gt; æ ´\6:ç 5@ËcÍÈAE@´\6:ç 5@ËcÍÈAE@| ´\6:ç 5@ËcÍÈAE@þ&lt;/td&gt;&lt;/tr&gt;
&lt;tr&gt;&lt;td&gt;12583476557&lt;/td&gt;&lt;td&gt;100667812463&lt;/td&gt;&lt;td&gt;899894&lt;/td&gt;&lt;td&gt;209187815680&lt;/td&gt;&lt;td&gt;42.659746&lt;/td&gt;&lt;td&gt;42.668759&lt;/td&gt;&lt;td&gt;21.120258&lt;/td&gt;&lt;td&gt;21.180085&lt;/td&gt;&lt;td&gt; æ   q:É 5@ZÕrTE@  q:É 5@ZÕrTE@|   q:É 5@ZÕrTE@þ&lt;/td&gt;&lt;td&gt; æ  ñ  .5@íó åUE@ ñ  .5@íó åUE@|  ñ  .5@íó åUE@þ&lt;/td&gt;&lt;td&gt; æ   q:É 5@ZÕrTE@ ñ  .5@íó åUE@|     q:É 5@ZÕrTE@ ñ  .5@ZÕrTE@ ñ  .5@íó åUE@  q:É 5@íó åUE@  q:É 5@ZÕrTE@þ&lt;/td&gt;&lt;td&gt;0.000539220751000158&lt;/td&gt;&lt;td&gt; æ J±£q&amp;amp;5@¤äÕ9 UE@J±£q&amp;amp;5@¤äÕ9 UE@| J±£q&amp;amp;5@¤äÕ9 UE@þ&lt;/td&gt;&lt;/tr&gt;
&lt;tr&gt;&lt;td&gt;12583773012&lt;/td&gt;&lt;td&gt;100670184102&lt;/td&gt;&lt;td&gt;899927&lt;/td&gt;&lt;td&gt;209192315370&lt;/td&gt;&lt;td&gt;42.644727&lt;/td&gt;&lt;td&gt;42.667305&lt;/td&gt;&lt;td&gt;21.168528&lt;/td&gt;&lt;td&gt;21.248053&lt;/td&gt;&lt;td&gt; æ Õu¨¦$+5@ì jRE@Õu¨¦$+5@ì jRE@| Õu¨¦$+5@ì jRE@þ&lt;/td&gt;&lt;td&gt; æ ¸¬Âf?5@º @jUE@¸¬Âf?5@º @jUE@| ¸¬Âf?5@º @jUE@þ&lt;/td&gt;&lt;td&gt; æ Õu¨¦$+5@ì jRE@¸¬Âf?5@º @jUE@|   Õu¨¦$+5@ì jRE@¸¬Âf?5@ì jRE@¸¬Âf?5@º @jUE@Õu¨¦$+5@º @jUE@Õu¨¦$+5@ì jRE@þ&lt;/td&gt;&lt;td&gt;0.00179551544999962&lt;/td&gt;&lt;td&gt; æ EµR55@Ó UøSE@EµR55@Ó UøSE@| EµR55@Ó UøSE@þ&lt;br /&gt;&lt;br /&gt;&lt;/td&gt;&lt;/tr&gt;
&lt;/tbody&gt;&lt;/table&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
So we have three blocks that contain that point.&lt;br /&gt;
&lt;br /&gt;
&lt;span style=&quot;text-align: -webkit-auto;&quot;&gt;starting with 12582077836 and going to&amp;nbsp;&lt;/span&gt;&lt;span style=&quot;text-align: -webkit-auto;&quot;&gt;12583773012, so lets check what we can find out about that range.&amp;nbsp;&lt;/span&gt;&lt;br /&gt;
&lt;span style=&quot;text-align: -webkit-auto;&quot;&gt;&lt;br /&gt;&lt;/span&gt;&lt;br /&gt;
&lt;a href=&quot;http://pine02.fosm.org/FOSM-Api/OSM-API-Proxy/public/spatialite.cgi/position/12582077836/12583773012&quot;&gt;http://pine02.fosm.org/FOSM-Api/OSM-API-Proxy/public/spatialite.cgi/position/12582077836/12583773012&lt;/a&gt;&lt;br /&gt;
&lt;br /&gt;
we see a bunch of blocks, now lets put them on a map!&lt;br /&gt;
&lt;br /&gt;
&lt;a href=&quot;http://pine02.fosm.org/FOSM-Api/OSM-API-Proxy/public/spatialite.cgi/position/12582077836/12583773012/map&quot;&gt;http://pine02.fosm.org/FOSM-Api/OSM-API-Proxy/public/spatialite.cgi/position/12582077836/12583773012/map&lt;/a&gt;&lt;br /&gt;
&lt;br /&gt;
&lt;div class=&quot;separator&quot; style=&quot;clear: both; text-align: center;&quot;&gt;
&lt;a href=&quot;https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEiGlSxJy_HqAK_S-D4NrkndV4rGJnNrSRUOpGl8YMTd3tIramje3QdEIXSZD62H7xksMYqThrKV7CLnUGERnbbxeOHIehZTpsW1YWrumtCiTl2D4WY8lF-1LfN2qjHU_XXF1oTJ5SHIQQmP/s1600/Screenshot+-+041012+-+12:12:43.png&quot; imageanchor=&quot;1&quot; style=&quot;margin-left: 1em; margin-right: 1em;&quot;&gt;&lt;img border=&quot;0&quot; height=&quot;233&quot; src=&quot;https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEiGlSxJy_HqAK_S-D4NrkndV4rGJnNrSRUOpGl8YMTd3tIramje3QdEIXSZD62H7xksMYqThrKV7CLnUGERnbbxeOHIehZTpsW1YWrumtCiTl2D4WY8lF-1LfN2qjHU_XXF1oTJ5SHIQQmP/s320/Screenshot+-+041012+-+12:12:43.png&quot; width=&quot;320&quot; /&gt;&lt;/a&gt;&lt;/div&gt;
&lt;br /&gt;
&lt;br /&gt;
code updated on github&lt;br /&gt;
&lt;br /&gt;
To git@github.com:h4ck3rm1k3/FOSM-Api.git&lt;br /&gt;
&amp;nbsp; &amp;nbsp;4a857f5..b292098 &amp;nbsp;master -&amp;gt; master&lt;br /&gt;
&lt;div&gt;
&lt;br /&gt;&lt;/div&gt;
&lt;/div&gt;</content><link rel='replies' type='application/atom+xml' href='http://osmopenlayers.blogspot.com/feeds/1671507965350463297/comments/default' title='Post Comments'/><link rel='replies' type='text/html' href='http://osmopenlayers.blogspot.com/2012/04/ideas-on-splitting-up-world-examples.html#comment-form' title='0 Comments'/><link rel='edit' type='application/atom+xml' href='http://www.blogger.com/feeds/1825393237232252749/posts/default/1671507965350463297'/><link rel='self' type='application/atom+xml' href='http://www.blogger.com/feeds/1825393237232252749/posts/default/1671507965350463297'/><link rel='alternate' type='text/html' href='http://osmopenlayers.blogspot.com/2012/04/ideas-on-splitting-up-world-examples.html' title='Ideas on splitting up the world, examples'/><author><name>H4ck3rm1k3</name><uri>http://www.blogger.com/profile/04484528013589914857</uri><email>noreply@blogger.com</email><gd:image rel='http://schemas.google.com/g/2005#thumbnail' width='16' height='16' src='https://img1.blogblog.com/img/b16-rounded.gif'/></author><media:thumbnail xmlns:media="http://search.yahoo.com/mrss/" url="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEiGlSxJy_HqAK_S-D4NrkndV4rGJnNrSRUOpGl8YMTd3tIramje3QdEIXSZD62H7xksMYqThrKV7CLnUGERnbbxeOHIehZTpsW1YWrumtCiTl2D4WY8lF-1LfN2qjHU_XXF1oTJ5SHIQQmP/s72-c/Screenshot+-+041012+-+12:12:43.png" height="72" width="72"/><thr:total>0</thr:total></entry><entry><id>tag:blogger.com,1999:blog-1825393237232252749.post-9171380941708021171</id><published>2012-04-08T06:55:00.003-07:00</published><updated>2012-04-08T06:55:50.478-07:00</updated><title type='text'>Rtree Vizualizations</title><content type='html'>&lt;div dir=&quot;ltr&quot; style=&quot;text-align: left;&quot; trbidi=&quot;on&quot;&gt;
&lt;br /&gt;
The data is based on the rtree created by sqlite/spatialite based on the bbox spatial index created in the previous posts. Finally I have been able to get at the internal structures after some mistakes.&lt;br /&gt;
&lt;br /&gt;
So my new script will interpret the internal rtree structure&lt;br /&gt;
&lt;a href=&quot;https://github.com/h4ck3rm1k3/FOSM-Api/blob/master/OSM-API-Proxy/bin/findlevels.pl&quot;&gt;https://github.com/h4ck3rm1k3/FOSM-Api/blob/master/OSM-API-Proxy/bin/findlevels.pl&lt;/a&gt;&lt;br /&gt;
&lt;br /&gt;
and insert it into the database,&amp;nbsp;after that I post process the data like this :&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;ol style=&quot;text-align: left;&quot;&gt;
&lt;li&gt;alter table idx_earthindex_bbox_node_expanded add level int;&lt;/li&gt;
&lt;li&gt;alter table idx_earthindex_bbox_node_expanded add area double;&lt;/li&gt;
&lt;li&gt;create index idx_earthindex_bbox_node_expanded_level on idx_earthindex_bbox_node_expanded (level );&lt;/li&gt;
&lt;li&gt;create index idx_earthindex_bbox_node_expanded_parent on idx_earthindex_bbox_node_expanded (parentnode );&lt;/li&gt;
&lt;li&gt;create index idx_earthindex_bbox_node_expanded_childe on idx_earthindex_bbox_node_expanded (childnode );&lt;/li&gt;
&lt;li&gt;SELECT AddGeometryColumn(&#39;idx_earthindex_bbox_node_expanded&#39;,&#39;bbox&#39;, 4326, &#39;POLYGON&#39;, 2);&lt;/li&gt;
&lt;li&gt;update idx_earthindex_bbox_node_expanded set area = &amp;nbsp;ST_Area(bbox);&lt;/li&gt;
&lt;li&gt;update idx_earthindex_bbox_node_expanded set bbox = BuildMBR( min_lon, min_lat, max_lon, max_lat, 4326);&lt;/li&gt;
&lt;/ol&gt;
&lt;div&gt;
Created the levels of the database like this, there are only 4 levels of trees :&lt;/div&gt;
&lt;div&gt;
&lt;div&gt;
&lt;ul style=&quot;text-align: left;&quot;&gt;
&lt;li&gt;update idx_earthindex_bbox_node_expanded set level=1 where parentnode in (select&amp;nbsp;nodeno from idx_earthindex_bbox_parent where parentnode=1);&lt;/li&gt;
&lt;li&gt;update idx_earthindex_bbox_node_expanded set level=2 where parentnode in (select childnode from idx_earthindex_bbox_node_expanded where level =1) and level =0;&lt;/li&gt;
&lt;li&gt;update idx_earthindex_bbox_node_expanded set level=3 where parentnode in (select childnode from idx_earthindex_bbox_node_expanded where level =2) and level =0;&lt;/li&gt;
&lt;li&gt;update idx_earthindex_bbox_node_expanded set level=4 where parentnode in (select childnode from idx_earthindex_bbox_node_expanded where level =3) and level =0;&lt;/li&gt;
&lt;/ul&gt;
&lt;/div&gt;
&lt;/div&gt;
&lt;br /&gt;
See the levels reported here :&lt;br /&gt;
spatialite&amp;gt; select count(*), level from idx_earthindex_bbox_node_expanded group by level;&lt;br /&gt;
&lt;br /&gt;
&lt;div class=&quot;separator&quot; style=&quot;clear: both; text-align: center;&quot;&gt;
&lt;br /&gt;&lt;/div&gt;
&lt;ul style=&quot;text-align: left;&quot;&gt;
&lt;li&gt;16|1&lt;/li&gt;
&lt;li&gt;457|2&lt;/li&gt;
&lt;li&gt;11081|3&lt;/li&gt;
&lt;li&gt;272222|4&lt;/li&gt;
&lt;/ul&gt;
&lt;br /&gt;
&lt;br /&gt;
Export like this :&lt;br /&gt;
.dumpshp idx_earthindex_bbox_node_expanded bbox &quot;layer&quot; ascii&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
Sort like this :&lt;br /&gt;
sortshp rtreelayer rtreelayer_srt area desc&lt;br /&gt;
&lt;div&gt;
&lt;br /&gt;&lt;/div&gt;
&lt;br /&gt;
&lt;br /&gt;
And add them to the map files :&lt;br /&gt;
&lt;a href=&quot;http://pine02.fosm.org/planet/index.map&quot;&gt;http://pine02.fosm.org/planet/index.map&lt;/a&gt;&lt;br /&gt;
&lt;br /&gt;
here are the layers you can see here :&lt;br /&gt;
&lt;a href=&quot;http://pine02.fosm.org/planet/openlayers.html&quot;&gt;http://pine02.fosm.org/planet/openlayers.html&lt;/a&gt;&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;div class=&quot;separator&quot; style=&quot;clear: both; text-align: center;&quot;&gt;
Level 1 (rtreelayer1)&lt;/div&gt;
&lt;div class=&quot;separator&quot; style=&quot;clear: both; text-align: center;&quot;&gt;
&lt;a href=&quot;https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEgO99y4Drcjbpsvkwa0QsL6gWVeb8YggO4byMARwDkqtDYEAa6UycJKL-RcqSAIWVAaakxLl3XRRDfw3LxBAmljpFIZtyWYCY1kfl4Vh-vkZ3JOWkSep1_dHGXIpwXTWYOA8Jhzt1VTMxCp/s1600/Screenshot+-+040812+-+15:44:56.png&quot; imageanchor=&quot;1&quot; style=&quot;margin-left: 1em; margin-right: 1em;&quot;&gt;&lt;img border=&quot;0&quot; height=&quot;174&quot; src=&quot;https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEgO99y4Drcjbpsvkwa0QsL6gWVeb8YggO4byMARwDkqtDYEAa6UycJKL-RcqSAIWVAaakxLl3XRRDfw3LxBAmljpFIZtyWYCY1kfl4Vh-vkZ3JOWkSep1_dHGXIpwXTWYOA8Jhzt1VTMxCp/s320/Screenshot+-+040812+-+15:44:56.png&quot; width=&quot;320&quot; /&gt;&lt;/a&gt;&lt;/div&gt;
&lt;div class=&quot;separator&quot; style=&quot;clear: both; text-align: center;&quot;&gt;
&lt;/div&gt;
&lt;pre style=&quot;text-align: -webkit-auto; white-space: pre-wrap; word-wrap: break-word;&quot;&gt;

  LAYER # 
    NAME         rtreelayer_srt1
    DATA         rtreelayer_srt
    STATUS       ON
    TYPE         POLYGON
    OPACITY  100
 METADATA
    &quot;wms_srs&quot;             &quot;EPSG:4326&quot;
    &quot;wms_name&quot;            &quot;fosm rtree internal layers1&quot;
    &quot;wms_server_version&quot;  &quot;1.1.1&quot;
    &quot;wms_format&quot;          &quot;image/png&quot;
  END
    CLASS
      NAME       &quot;The level 1&quot;
      EXPRESSION (&#39;[level]&#39; eq &#39;1&#39;)
      STYLE
        COLOR        1 232 1
        OUTLINECOLOR 32 32 32
      END
    END
  END # 


&lt;/pre&gt;
&lt;pre style=&quot;text-align: -webkit-auto; white-space: pre-wrap; word-wrap: break-word;&quot;&gt;
&lt;/pre&gt;
&lt;br /&gt;
&lt;div class=&quot;separator&quot; style=&quot;clear: both; text-align: center;&quot;&gt;
Level 2&amp;nbsp;(rtreelayer2)&lt;/div&gt;
&lt;div class=&quot;separator&quot; style=&quot;clear: both; text-align: center;&quot;&gt;
&lt;a href=&quot;https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEhmLJhskWS-YgkAnmMxPvdDTwzloIv4JnHZNsW8AV6qTm0Yepu9cyWxwj5T1YtNkMyWYpVXwLh0ilWAjxHW4YeI1Uy7HFrq4bnM9YV0NSev-pGZdnW4xMnKteF19E9a7hhbDMupmb4vykar/s1600/Screenshot+at+2012-04-08+15:45:20.png&quot; imageanchor=&quot;1&quot; style=&quot;margin-left: 1em; margin-right: 1em;&quot;&gt;&lt;img border=&quot;0&quot; height=&quot;164&quot; src=&quot;https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEhmLJhskWS-YgkAnmMxPvdDTwzloIv4JnHZNsW8AV6qTm0Yepu9cyWxwj5T1YtNkMyWYpVXwLh0ilWAjxHW4YeI1Uy7HFrq4bnM9YV0NSev-pGZdnW4xMnKteF19E9a7hhbDMupmb4vykar/s320/Screenshot+at+2012-04-08+15:45:20.png&quot; width=&quot;320&quot; /&gt;&lt;/a&gt;&lt;/div&gt;
&lt;div class=&quot;separator&quot; style=&quot;clear: both; text-align: center;&quot;&gt;
&lt;br /&gt;&lt;/div&gt;
&lt;div class=&quot;separator&quot; style=&quot;clear: both; text-align: center;&quot;&gt;
&lt;/div&gt;
&lt;pre style=&quot;text-align: -webkit-auto; white-space: pre-wrap; word-wrap: break-word;&quot;&gt;

  LAYER # 
    NAME         rtreelayer_srt2
    DATA         rtreelayer_srt
    STATUS       ON
    TYPE         POLYGON
    OPACITY  100
 METADATA
    &quot;wms_srs&quot;             &quot;EPSG:4326&quot;
    &quot;wms_name&quot;            &quot;fosm rtree internal layers1&quot;
    &quot;wms_server_version&quot;  &quot;1.1.1&quot;
    &quot;wms_format&quot;          &quot;image/png&quot;
  END
    CLASS
      NAME       &quot;The level 2&quot;
      EXPRESSION (&#39;[level]&#39; eq &#39;2&#39;)
      STYLE
        COLOR        232 1 1
        OUTLINECOLOR 32 32 32
      END
    END
  END # 


&lt;/pre&gt;
&lt;br /&gt;
&lt;div class=&quot;separator&quot; style=&quot;clear: both; text-align: center;&quot;&gt;
Level 3&amp;nbsp;(rtreelayer3)&lt;/div&gt;
&lt;div class=&quot;separator&quot; style=&quot;clear: both; text-align: center;&quot;&gt;
&lt;a href=&quot;https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEiZKZY_QIig8lSXRkRuy9lKTsVU1OLMwY31k_p4MUmV-JVytbnQzpCSMmgsgF3C-ys8Kv3-ILbq8x7F4AjmHSfIncvcnrBKpyJFAeIaQDghMZJQ-K2N_vZh8_XFo1Q1hQklTBtabYMoVxXp/s1600/Screenshot+at+2012-04-08+15:45:42.png&quot; imageanchor=&quot;1&quot; style=&quot;margin-left: 1em; margin-right: 1em;&quot;&gt;&lt;img border=&quot;0&quot; height=&quot;164&quot; src=&quot;https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEiZKZY_QIig8lSXRkRuy9lKTsVU1OLMwY31k_p4MUmV-JVytbnQzpCSMmgsgF3C-ys8Kv3-ILbq8x7F4AjmHSfIncvcnrBKpyJFAeIaQDghMZJQ-K2N_vZh8_XFo1Q1hQklTBtabYMoVxXp/s320/Screenshot+at+2012-04-08+15:45:42.png&quot; width=&quot;320&quot; /&gt;&lt;/a&gt;&lt;/div&gt;
&lt;div class=&quot;separator&quot; style=&quot;clear: both; text-align: center;&quot;&gt;
&lt;/div&gt;
&lt;pre style=&quot;text-align: -webkit-auto; white-space: pre-wrap; word-wrap: break-word;&quot;&gt;  LAYER # 
    NAME         rtreelayer_srt3
    DATA         rtreelayer_srt
    STATUS       ON
    TYPE         POLYGON
    OPACITY  100
 METADATA
    &quot;wms_srs&quot;             &quot;EPSG:4326&quot;
    &quot;wms_name&quot;            &quot;fosm rtree internal layers3&quot;
    &quot;wms_server_version&quot;  &quot;1.1.1&quot;
    &quot;wms_format&quot;          &quot;image/png&quot;
  END
    CLASS
      NAME       &quot;The level 3&quot;
      EXPRESSION (&#39;[level]&#39; eq &#39;3&#39;)
      STYLE
        COLOR        1 1 232
        OUTLINECOLOR 32 32 32
      END
    END
  END # 


&lt;/pre&gt;
&lt;pre style=&quot;text-align: -webkit-auto; white-space: pre-wrap; word-wrap: break-word;&quot;&gt;
&lt;/pre&gt;
&lt;br /&gt;
&lt;div class=&quot;separator&quot; style=&quot;clear: both; text-align: center;&quot;&gt;
Level 4&amp;nbsp;(rtreelayer4)&lt;/div&gt;
&lt;div class=&quot;separator&quot; style=&quot;clear: both; text-align: center;&quot;&gt;
&lt;br /&gt;&lt;/div&gt;
&lt;div class=&quot;separator&quot; style=&quot;clear: both; text-align: center;&quot;&gt;
&lt;a href=&quot;https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEjM4Xjk6lM3ljGxhOOVsUXvOQWA-yIOtT_1qUDDWL8iPYO-E0QeYOGE9dvR0vesQ81-_UhB4oYx-d9RuOzjX4jVHPX2iWALEAa8U-495ofqHGSAk5LH9PHfupe_FkBn-CDp0SbUTtBSNMBo/s1600/Screenshot+at+2012-04-08+15:46:00.png&quot; imageanchor=&quot;1&quot; style=&quot;margin-left: 1em; margin-right: 1em;&quot;&gt;&lt;img border=&quot;0&quot; height=&quot;164&quot; src=&quot;https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEjM4Xjk6lM3ljGxhOOVsUXvOQWA-yIOtT_1qUDDWL8iPYO-E0QeYOGE9dvR0vesQ81-_UhB4oYx-d9RuOzjX4jVHPX2iWALEAa8U-495ofqHGSAk5LH9PHfupe_FkBn-CDp0SbUTtBSNMBo/s320/Screenshot+at+2012-04-08+15:46:00.png&quot; width=&quot;320&quot; /&gt;&lt;/a&gt;&lt;/div&gt;
&lt;div class=&quot;separator&quot; style=&quot;clear: both; text-align: center;&quot;&gt;
&lt;br /&gt;&lt;/div&gt;
&lt;div class=&quot;separator&quot; style=&quot;clear: both; text-align: center;&quot;&gt;
&lt;/div&gt;
&lt;div class=&quot;separator&quot; style=&quot;clear: both;&quot;&gt;
&lt;/div&gt;
&lt;pre style=&quot;text-align: -webkit-auto; white-space: pre-wrap; word-wrap: break-word;&quot;&gt; LAYER # 
    NAME         rtreelayer_srt4
    DATA         rtreelayer_srt
    STATUS       ON
    TYPE         POLYGON
    OPACITY  100
 METADATA
    &quot;wms_srs&quot;             &quot;EPSG:4326&quot;
    &quot;wms_name&quot;            &quot;fosm rtree internal layers4&quot;
    &quot;wms_server_version&quot;  &quot;1.1.1&quot;
    &quot;wms_format&quot;          &quot;image/png&quot;
  END
    CLASS
      NAME       &quot;The level 4&quot;
      EXPRESSION (&#39;[level]&#39; eq &#39;4&#39;)
      STYLE
        COLOR        232 232 232
        OUTLINECOLOR 32 32 32
      END
    END
  END # 
&lt;/pre&gt;
&lt;div&gt;
&lt;br /&gt;&lt;/div&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;div class=&quot;separator&quot; style=&quot;clear: both; text-align: center;&quot;&gt;
All the levels together &amp;nbsp;(rtreelayer)&lt;/div&gt;
&lt;div class=&quot;separator&quot; style=&quot;clear: both; text-align: center;&quot;&gt;
&lt;a href=&quot;https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEhm9o5q8gp9UyP-yhnvJZhxHthMfzNJjioV2oiM2JzCWNug2lsOfOPj1BpJ-zXvqUjdgbCr3atD97Q8UKchm8r6GPlw5S7OD2jM7smhS0rJ-HpSUgTBJGBtsA08vn5By5y4bPAPua3oqULJ/s1600/Screenshot+at+2012-04-08+15:48:22.png&quot; imageanchor=&quot;1&quot; style=&quot;margin-left: 1em; margin-right: 1em;&quot;&gt;&lt;img border=&quot;0&quot; height=&quot;160&quot; src=&quot;https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEhm9o5q8gp9UyP-yhnvJZhxHthMfzNJjioV2oiM2JzCWNug2lsOfOPj1BpJ-zXvqUjdgbCr3atD97Q8UKchm8r6GPlw5S7OD2jM7smhS0rJ-HpSUgTBJGBtsA08vn5By5y4bPAPua3oqULJ/s320/Screenshot+at+2012-04-08+15:48:22.png&quot; width=&quot;320&quot; /&gt;&lt;/a&gt;&lt;/div&gt;
&lt;div class=&quot;separator&quot; style=&quot;clear: both; text-align: center;&quot;&gt;
&lt;br /&gt;&lt;/div&gt;
&lt;div class=&quot;separator&quot; style=&quot;clear: both; text-align: center;&quot;&gt;
&lt;/div&gt;
&lt;pre style=&quot;text-align: -webkit-auto; white-space: pre-wrap; word-wrap: break-word;&quot;&gt;&lt;pre style=&quot;white-space: pre-wrap; word-wrap: break-word;&quot;&gt;  LAYER # 
    NAME         rtreelayer_srt
    DATA         rtreelayer_srt
    STATUS       ON
    TYPE         POLYGON
    OPACITY  100
 METADATA
    &quot;wms_srs&quot;             &quot;EPSG:4326&quot;
    &quot;wms_name&quot;            &quot;fosm rtree internal layers&quot;
    &quot;wms_server_version&quot;  &quot;1.1.1&quot;
    &quot;wms_format&quot;          &quot;image/png&quot;
  END

    CLASS
      NAME       &quot;The FOSM internal layers&quot;
      EXPRESSION (&#39;[level]&#39; eq &#39;4&#39;)
      STYLE
        COLOR        232 232 232
        OUTLINECOLOR 32 32 32
      END
    END

    CLASS
      NAME       &quot;The FOSM internal layers&quot;
      EXPRESSION (&#39;[level]&#39; eq &#39;3&#39;)
      STYLE
        COLOR        1 1 232
        OUTLINECOLOR 32 32 32
      END
    END


    CLASS
      NAME       &quot;The level 1&quot;
      EXPRESSION (&#39;[level]&#39; eq &#39;1&#39;)
      STYLE
#        COLOR        255 1 1
        COLOR        1 232 1
        OUTLINECOLOR 32 32 32
      END
    END


    CLASS
      NAME       &quot;The level 2&quot;
      EXPRESSION (&#39;[level]&#39; eq &#39;2&#39;)
      STYLE
#        COLOR        120 1 1
        COLOR        232 1 1
        OUTLINECOLOR 32 32 32
      END
    END


  END # 

&lt;/pre&gt;
&lt;/pre&gt;
&lt;br /&gt;
&lt;div class=&quot;separator&quot; style=&quot;clear: both; text-align: center;&quot;&gt;
&lt;br /&gt;&lt;/div&gt;
&lt;br /&gt;
&lt;/div&gt;</content><link rel='replies' type='application/atom+xml' href='http://osmopenlayers.blogspot.com/feeds/9171380941708021171/comments/default' title='Post Comments'/><link rel='replies' type='text/html' href='http://osmopenlayers.blogspot.com/2012/04/rtree-vizualizations.html#comment-form' title='0 Comments'/><link rel='edit' type='application/atom+xml' href='http://www.blogger.com/feeds/1825393237232252749/posts/default/9171380941708021171'/><link rel='self' type='application/atom+xml' href='http://www.blogger.com/feeds/1825393237232252749/posts/default/9171380941708021171'/><link rel='alternate' type='text/html' href='http://osmopenlayers.blogspot.com/2012/04/rtree-vizualizations.html' title='Rtree Vizualizations'/><author><name>H4ck3rm1k3</name><uri>http://www.blogger.com/profile/04484528013589914857</uri><email>noreply@blogger.com</email><gd:image rel='http://schemas.google.com/g/2005#thumbnail' width='16' height='16' src='https://img1.blogblog.com/img/b16-rounded.gif'/></author><media:thumbnail xmlns:media="http://search.yahoo.com/mrss/" url="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEgO99y4Drcjbpsvkwa0QsL6gWVeb8YggO4byMARwDkqtDYEAa6UycJKL-RcqSAIWVAaakxLl3XRRDfw3LxBAmljpFIZtyWYCY1kfl4Vh-vkZ3JOWkSep1_dHGXIpwXTWYOA8Jhzt1VTMxCp/s72-c/Screenshot+-+040812+-+15:44:56.png" height="72" width="72"/><thr:total>0</thr:total></entry><entry><id>tag:blogger.com,1999:blog-1825393237232252749.post-8477451635090319603</id><published>2012-04-07T02:55:00.000-07:00</published><updated>2012-04-08T03:52:23.219-07:00</updated><title type='text'>Rtree Details</title><content type='html'>&lt;div dir=&quot;ltr&quot; style=&quot;text-align: left;&quot; trbidi=&quot;on&quot;&gt;
&lt;br /&gt;
** This file contains code for implementations of the r-tree and r*-tree &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &lt;br /&gt;
** algorithms packaged as an SQLite virtual table module. &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &lt;br /&gt;
*/&lt;br /&gt;
&lt;br /&gt;
/* &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &lt;br /&gt;
** Database Format of R-Tree Tables &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &lt;br /&gt;
** -------------------------------- &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &lt;br /&gt;
** &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &lt;br /&gt;
** The data structure for a single virtual r-tree table is stored in three &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &lt;br /&gt;
** native SQLite tables declared as follows. In each case, the &#39;%&#39; character &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &lt;br /&gt;
** in the table name is replaced with the user-supplied name of the r-tree &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &lt;br /&gt;
** table. &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &lt;br /&gt;
** &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &lt;br /&gt;
** &amp;nbsp; CREATE TABLE %_node(nodeno INTEGER PRIMARY KEY, data BLOB) &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &lt;br /&gt;
** &amp;nbsp; CREATE TABLE %_parent(nodeno INTEGER PRIMARY KEY, parentnode INTEGER) &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &lt;br /&gt;
** &amp;nbsp; CREATE TABLE %_rowid(rowid INTEGER PRIMARY KEY, nodeno INTEGER) &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &lt;br /&gt;
** &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &lt;br /&gt;
** The data for each node of the r-tree structure is stored in the %_node &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &lt;br /&gt;
** table. For each node that is not the root node of the r-tree, there is &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &lt;br /&gt;
** an entry in the %_parent table associating the node with its parent. &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &lt;br /&gt;
** And for each row of data in the table, there is an entry in the %_rowid &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &lt;br /&gt;
** table that maps from the entries rowid to the id of the node that it &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &lt;br /&gt;
** is stored on. &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &lt;br /&gt;
** &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &lt;br /&gt;
** The root node of an r-tree always exists, even if the r-tree table is &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &lt;br /&gt;
** empty. The nodeno of the root node is always 1. All other nodes in the &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &lt;br /&gt;
** table must be the same size as the root node. The content of each node &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &lt;br /&gt;
** is formatted as follows: &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &lt;br /&gt;
** &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &lt;br /&gt;
** &amp;nbsp; 1. If the node is the root node (node 1), then the first 2 bytes &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &lt;br /&gt;
** &amp;nbsp; &amp;nbsp; &amp;nbsp;of the node contain the tree depth as a big-endian integer. &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &lt;br /&gt;
** &amp;nbsp; &amp;nbsp; &amp;nbsp;For non-root nodes, the first 2 bytes are left unused. &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &lt;br /&gt;
** &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &lt;br /&gt;
** &amp;nbsp; 2. The next 2 bytes contain the number of entries currently &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &lt;br /&gt;
** &amp;nbsp; &amp;nbsp; &amp;nbsp;stored in the node. &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &lt;br /&gt;
&lt;br /&gt;
** &amp;nbsp; 3. The remainder of the node contains the node entries. Each entry &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &lt;br /&gt;
** &amp;nbsp; &amp;nbsp; &amp;nbsp;consists of a single 8-byte integer followed by an even number &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &lt;br /&gt;
** &amp;nbsp; &amp;nbsp; &amp;nbsp;of 4-byte coordinates. For leaf nodes the integer is the rowid &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &lt;br /&gt;
** &amp;nbsp; &amp;nbsp; &amp;nbsp;of a record. For internal nodes it is the node number of a &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &lt;br /&gt;
** &amp;nbsp; &amp;nbsp; &amp;nbsp;child page. &lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
Here is an example on how to get the data from the rtree, the right way.&lt;br /&gt;
&lt;br /&gt;
spatialite&amp;gt; select rtreenode(2,data) from idx_earthindex_bbox_node2 where nodeno =1;&lt;br /&gt;
{1112 -179.990570 9.888617 -84.759567 45.016312} {2772 -113.750641 -90.064362 33.753155 56.236389} {3991 -25.053413 28.249371 0.076677 79.341087} {4249 -172.47493\&lt;br /&gt;
0 173.938553 -8.576650 35.464272} {6601 0.062751 141.455414 -22.668640 56.248100} {7628 5.688327 14.515760 42.218864 50.609940} {10681 0.029398 179.893692 44.9809\&lt;br /&gt;
49 81.594307} {11103 0.411283 7.018695 40.609161 52.373821} {11170 37.595543 179.986282 -85.049980 44.998173} {11957 -179.884659 -90.097748 42.194195 88.557030} {\&lt;br /&gt;
12343 -77.363358 -0.022274 31.115875 56.234348} {13042 -3.491974 -0.006940 41.616795 55.829208} {13992 -101.131172 -18.988844 36.941143 83.093262} {14618 -89.9981\&lt;br /&gt;
16 -75.466499 33.750549 39.286716} {15596 0.976114 11.247487 49.224586 53.429798} {16979 1.924479 47.640617 -34.814999 56.248886}&lt;br /&gt;
&lt;div&gt;
&lt;br /&gt;&lt;/div&gt;
&lt;br /&gt;
see :&lt;br /&gt;
&lt;a href=&quot;http://www.sqlite.org/src/artifact/4b84384449?ln=132&quot;&gt;http://www.sqlite.org/src/artifact/4b84384449?ln=132&lt;/a&gt;&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
Update : here is my first code to deal with this :&lt;br /&gt;
&lt;a href=&quot;https://github.com/h4ck3rm1k3/FOSM-Api/blob/master/OSM-API-Proxy/bin/findlevels.pl&quot;&gt;https://github.com/h4ck3rm1k3/FOSM-Api/blob/master/OSM-API-Proxy/bin/findlevels.pl&lt;/a&gt;&lt;br /&gt;
&lt;br /&gt;&lt;/div&gt;</content><link rel='replies' type='application/atom+xml' href='http://osmopenlayers.blogspot.com/feeds/8477451635090319603/comments/default' title='Post Comments'/><link rel='replies' type='text/html' href='http://osmopenlayers.blogspot.com/2012/04/rtree-details.html#comment-form' title='0 Comments'/><link rel='edit' type='application/atom+xml' href='http://www.blogger.com/feeds/1825393237232252749/posts/default/8477451635090319603'/><link rel='self' type='application/atom+xml' href='http://www.blogger.com/feeds/1825393237232252749/posts/default/8477451635090319603'/><link rel='alternate' type='text/html' href='http://osmopenlayers.blogspot.com/2012/04/rtree-details.html' title='Rtree Details'/><author><name>H4ck3rm1k3</name><uri>http://www.blogger.com/profile/04484528013589914857</uri><email>noreply@blogger.com</email><gd:image rel='http://schemas.google.com/g/2005#thumbnail' width='16' height='16' src='https://img1.blogblog.com/img/b16-rounded.gif'/></author><thr:total>0</thr:total></entry><entry><id>tag:blogger.com,1999:blog-1825393237232252749.post-797681076290895768</id><published>2012-04-07T01:44:00.001-07:00</published><updated>2012-04-07T01:44:15.124-07:00</updated><title type='text'>concentration of points</title><content type='html'>&lt;div dir=&quot;ltr&quot; style=&quot;text-align: left;&quot; trbidi=&quot;on&quot;&gt;
&lt;br /&gt;
Lets try a different experiment&lt;br /&gt;
&lt;br /&gt;
create table concentrations (float area);&lt;br /&gt;
&lt;div&gt;
&lt;div&gt;
spatialite&amp;gt; delete from concentrations;&lt;/div&gt;
&lt;div&gt;
spatialite&amp;gt; insert into concentrations (bbox) select buffer(bbox,0.01) from earthindex where area &amp;lt; 0.0001;&lt;/div&gt;
&lt;div&gt;
spatialite&amp;gt; .dumpshp concentrations &amp;nbsp;bbox &quot;concentrations&quot; ascii&lt;/div&gt;
&lt;div&gt;
&lt;br /&gt;&lt;/div&gt;
&lt;/div&gt;
&lt;div&gt;
&lt;br /&gt;&lt;/div&gt;
&lt;div&gt;
So you can see that the places where the nodes are concentrated (the blocks are small) are in very concentrated block in cities.&amp;nbsp;&lt;/div&gt;
&lt;div&gt;
&lt;br /&gt;&lt;/div&gt;
&lt;div&gt;
see&amp;nbsp;&lt;a href=&quot;http://pine02.fosm.org/planet/openlayers.html&quot;&gt;http://pine02.fosm.org/planet/openlayers.html&lt;/a&gt;&amp;nbsp;the concentration of points&lt;/div&gt;
&lt;div&gt;
&lt;br /&gt;&lt;/div&gt;
&lt;div&gt;
These blocks that are overlapping need to be now merged into some clumps, these clumps should be some directory I think that you can download.&lt;/div&gt;
&lt;div&gt;
&lt;br /&gt;&lt;/div&gt;
&lt;div class=&quot;separator&quot; style=&quot;clear: both; text-align: center;&quot;&gt;
&lt;/div&gt;
&lt;div class=&quot;separator&quot; style=&quot;clear: both; text-align: center;&quot;&gt;
&lt;a href=&quot;https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEg-lejnvvzvg2VSswP0ueBpAYmR2rAk0y_jvUTwqBlw4Mo3dVahCZQjOM9prsZEHiHrCR9dJ0p6O_X_jh6kDiuigOzUQThPuvQT1i3SzmpbS3OPPLlLJoa-zuB8JoOyZdxEXXsHRfHsfG2N/s1600/Screenshot+-+040712+-+10:42:32.png&quot; imageanchor=&quot;1&quot; style=&quot;margin-left: 1em; margin-right: 1em;&quot;&gt;&lt;img border=&quot;0&quot; height=&quot;199&quot; src=&quot;https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEg-lejnvvzvg2VSswP0ueBpAYmR2rAk0y_jvUTwqBlw4Mo3dVahCZQjOM9prsZEHiHrCR9dJ0p6O_X_jh6kDiuigOzUQThPuvQT1i3SzmpbS3OPPLlLJoa-zuB8JoOyZdxEXXsHRfHsfG2N/s320/Screenshot+-+040712+-+10:42:32.png&quot; width=&quot;320&quot; /&gt;&lt;/a&gt;&lt;/div&gt;
&lt;div&gt;
&lt;br /&gt;&lt;/div&gt;
&lt;div&gt;
&lt;br /&gt;&lt;/div&gt;
&lt;div&gt;
mike&lt;/div&gt;
&lt;/div&gt;</content><link rel='replies' type='application/atom+xml' href='http://osmopenlayers.blogspot.com/feeds/797681076290895768/comments/default' title='Post Comments'/><link rel='replies' type='text/html' href='http://osmopenlayers.blogspot.com/2012/04/concentration-of-points.html#comment-form' title='0 Comments'/><link rel='edit' type='application/atom+xml' href='http://www.blogger.com/feeds/1825393237232252749/posts/default/797681076290895768'/><link rel='self' type='application/atom+xml' href='http://www.blogger.com/feeds/1825393237232252749/posts/default/797681076290895768'/><link rel='alternate' type='text/html' href='http://osmopenlayers.blogspot.com/2012/04/concentration-of-points.html' title='concentration of points'/><author><name>H4ck3rm1k3</name><uri>http://www.blogger.com/profile/04484528013589914857</uri><email>noreply@blogger.com</email><gd:image rel='http://schemas.google.com/g/2005#thumbnail' width='16' height='16' src='https://img1.blogblog.com/img/b16-rounded.gif'/></author><media:thumbnail xmlns:media="http://search.yahoo.com/mrss/" url="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEg-lejnvvzvg2VSswP0ueBpAYmR2rAk0y_jvUTwqBlw4Mo3dVahCZQjOM9prsZEHiHrCR9dJ0p6O_X_jh6kDiuigOzUQThPuvQT1i3SzmpbS3OPPLlLJoa-zuB8JoOyZdxEXXsHRfHsfG2N/s72-c/Screenshot+-+040712+-+10:42:32.png" height="72" width="72"/><thr:total>0</thr:total></entry><entry><id>tag:blogger.com,1999:blog-1825393237232252749.post-8804044192829705242</id><published>2012-04-07T01:18:00.001-07:00</published><updated>2012-04-07T01:18:38.966-07:00</updated><title type='text'>rtree based on center points</title><content type='html'>&lt;div dir=&quot;ltr&quot; style=&quot;text-align: left;&quot; trbidi=&quot;on&quot;&gt;
&lt;br /&gt;
spatialite&amp;gt;SELECT AddGeometryColumn(&#39;earthindex&#39;, &#39;cpoint&#39;, 4326, &#39;POINT&#39;,2);&lt;br /&gt;
spatialite&amp;gt; update earthindex set cpoint=Centroid(bbox);&lt;br /&gt;
spatialite&amp;gt; select CreateSpatialIndex(&#39;earthindex&#39;, &#39;cpoint&#39;);&lt;br /&gt;
&lt;br /&gt;
This creates a column based on the center point.&lt;br /&gt;
&lt;br /&gt;
Now lets create a table to hold the rtree of the points :&lt;br /&gt;
CREATE TABLE earthindex_prt (pkid integer, min_lon double, max_lon double , min_lat double, max_lat double);&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
Recycle the bbox index :&lt;br /&gt;
insert into earthindex_prt select * from idx_earthindex_cpoint;&lt;br /&gt;
&lt;div&gt;
&lt;br /&gt;&lt;/div&gt;
&lt;div&gt;
add the geoindex of the index :&amp;nbsp;&lt;/div&gt;
&lt;br /&gt;
&lt;br /&gt;
SELECT AddGeometryColumn(&#39;earthindex_prt&#39;, &#39;bbox&#39;, 4326, &#39;POLYGON&#39;, 2);&lt;br /&gt;
&lt;div&gt;
&lt;br /&gt;&lt;/div&gt;
&lt;br /&gt;
Now to create the bbox field, this time it is more complex :&lt;br /&gt;
&lt;div&gt;
update earthindex_prt set bbox= (GeomFromText(AsText( BuildMBR( min_lon, min_lat, max_lon, max_lat)),4326)) ;&lt;/div&gt;
&lt;div&gt;
&lt;br /&gt;&lt;/div&gt;
&lt;div&gt;
this does not work :&lt;/div&gt;
&lt;div&gt;
&lt;div&gt;
spatialite&amp;gt; update earthindex_prt set bbox= &amp;nbsp;BuildMBR( min_lon, min_lat, max_lon, max_lat);&lt;/div&gt;
&lt;div&gt;
SQL error: &quot;earthindex_prt&quot;.&quot;bbox&quot; violates Geometry constraint [geom-type or SRID not allowed]&lt;/div&gt;
&lt;/div&gt;
&lt;div&gt;
&lt;br /&gt;&lt;/div&gt;
&lt;div&gt;
&lt;div&gt;
.dumpshp earthindex_prt bbox &quot;testprt&quot; ascii&lt;/div&gt;
&lt;/div&gt;
&lt;div&gt;
&lt;br /&gt;&lt;/div&gt;
&lt;div&gt;
This produces a table with&amp;nbsp;272222 rows,&lt;/div&gt;
&lt;div&gt;
&lt;br /&gt;&lt;/div&gt;
&lt;div&gt;
but the parent relationship table contains only 11k nodes..&lt;/div&gt;
&lt;div&gt;
&lt;div&gt;
spatialite&amp;gt; select count (*) from idx_earthindex_cpoint_parent&lt;/div&gt;
&lt;div&gt;
11562&lt;/div&gt;
&lt;/div&gt;
&lt;div&gt;
&lt;br /&gt;&lt;/div&gt;
&lt;div&gt;
now, what we see here is that the rtrees are not very useful in splitting up this data &amp;nbsp;(yet).&lt;/div&gt;
&lt;div&gt;
mike&lt;/div&gt;
&lt;div&gt;
&lt;br /&gt;&lt;/div&gt;
&lt;/div&gt;</content><link rel='replies' type='application/atom+xml' href='http://osmopenlayers.blogspot.com/feeds/8804044192829705242/comments/default' title='Post Comments'/><link rel='replies' type='text/html' href='http://osmopenlayers.blogspot.com/2012/04/rtree-based-on-center-points.html#comment-form' title='0 Comments'/><link rel='edit' type='application/atom+xml' href='http://www.blogger.com/feeds/1825393237232252749/posts/default/8804044192829705242'/><link rel='self' type='application/atom+xml' href='http://www.blogger.com/feeds/1825393237232252749/posts/default/8804044192829705242'/><link rel='alternate' type='text/html' href='http://osmopenlayers.blogspot.com/2012/04/rtree-based-on-center-points.html' title='rtree based on center points'/><author><name>H4ck3rm1k3</name><uri>http://www.blogger.com/profile/04484528013589914857</uri><email>noreply@blogger.com</email><gd:image rel='http://schemas.google.com/g/2005#thumbnail' width='16' height='16' src='https://img1.blogblog.com/img/b16-rounded.gif'/></author><thr:total>0</thr:total></entry><entry><id>tag:blogger.com,1999:blog-1825393237232252749.post-6137931191440898653</id><published>2012-04-02T07:58:00.000-07:00</published><updated>2012-04-07T03:17:45.422-07:00</updated><title type='text'>Recycling the spatialite rtree bbox</title><content type='html'>&lt;div dir=&quot;ltr&quot; style=&quot;text-align: left;&quot; trbidi=&quot;on&quot;&gt;
&lt;b&gt;&lt;span class=&quot;Apple-style-span&quot; style=&quot;color: red;&quot;&gt;UPDATE :&lt;/span&gt;&lt;/b&gt;&lt;br /&gt;
&lt;b&gt;&lt;span class=&quot;Apple-style-span&quot; style=&quot;color: red;&quot;&gt;this method described here does not display the rtrees internal structure, I made a mistake on this and will be publishing a better solution soon.&lt;/span&gt;&lt;/b&gt;&lt;br /&gt;
&lt;b&gt;&lt;span class=&quot;Apple-style-span&quot; style=&quot;color: red;&quot;&gt;mike&lt;/span&gt;&lt;/b&gt;&lt;br /&gt;
&lt;br /&gt;
When you create a geo index , it creates a special rtree table.&lt;br /&gt;
&lt;a href=&quot;http://www.gaia-gis.it/gaia-sins/spatialite-cookbook/html/rtree.html&quot;&gt;http://www.gaia-gis.it/gaia-sins/spatialite-cookbook/html/rtree.html&lt;/a&gt;&lt;br /&gt;
&lt;br /&gt;
Now what I am trying here is to reimport that table as a user table,&lt;br /&gt;
I hope to use the struture of the rtree to create the file system.&lt;br /&gt;
&lt;br /&gt;
&lt;blockquote class=&quot;tr_bq&quot;&gt;
&amp;nbsp;CREATE TABLE earthindex_rt (pkid integer, min_lon double, max_lon double , min_lat double, max_lat double);&lt;br /&gt;
&amp;nbsp;insert into earthindex_rt select * from idx_earthindex_bbox;&lt;br /&gt;
&amp;nbsp;SELECT AddGeometryColumn(&#39;earthindex_rt&#39;, &#39;bbox&#39;, 4326, &#39;POLYGON&#39;, 2);&lt;br /&gt;
&amp;nbsp;update earthindex_rt set bbox = BuildMBR( min_lon, min_lat, max_lon, max_lat);&lt;br /&gt;
alter table earthindex_rt add area double;&lt;/blockquote&gt;
&lt;blockquote class=&quot;tr_bq&quot;&gt;
&amp;nbsp;update earthindex_rt set area = &amp;nbsp;Area(bbox) ;&lt;/blockquote&gt;
&lt;blockquote class=&quot;tr_bq&quot;&gt;
.dumpshp earthindex_rt bbox &quot;testrt&quot; ascii&lt;/blockquote&gt;
&lt;blockquote class=&quot;tr_bq&quot;&gt;
&lt;/blockquote&gt;
Shell :&lt;br /&gt;
&amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp;sortshp testrt testrt_srt area desc&lt;br /&gt;
&lt;div&gt;
&lt;blockquote class=&quot;tr_bq&quot;&gt;
shptree testrt_srt&lt;/blockquote&gt;
&lt;br /&gt;
Now lets add it into the layers and test it :&lt;br /&gt;
&lt;a href=&quot;http://pine02.fosm.org/planet/openlayers.html&quot;&gt;http://pine02.fosm.org/planet/openlayers.html&lt;/a&gt;&amp;nbsp;see layer rtree blocks sorted&amp;nbsp;&lt;/div&gt;
&lt;div&gt;
&lt;br /&gt;&lt;/div&gt;
&lt;/div&gt;</content><link rel='replies' type='application/atom+xml' href='http://osmopenlayers.blogspot.com/feeds/6137931191440898653/comments/default' title='Post Comments'/><link rel='replies' type='text/html' href='http://osmopenlayers.blogspot.com/2012/04/recycling-spatialite-rtree-bbox.html#comment-form' title='0 Comments'/><link rel='edit' type='application/atom+xml' href='http://www.blogger.com/feeds/1825393237232252749/posts/default/6137931191440898653'/><link rel='self' type='application/atom+xml' href='http://www.blogger.com/feeds/1825393237232252749/posts/default/6137931191440898653'/><link rel='alternate' type='text/html' href='http://osmopenlayers.blogspot.com/2012/04/recycling-spatialite-rtree-bbox.html' title='Recycling the spatialite rtree bbox'/><author><name>H4ck3rm1k3</name><uri>http://www.blogger.com/profile/04484528013589914857</uri><email>noreply@blogger.com</email><gd:image rel='http://schemas.google.com/g/2005#thumbnail' width='16' height='16' src='https://img1.blogblog.com/img/b16-rounded.gif'/></author><thr:total>0</thr:total></entry><entry><id>tag:blogger.com,1999:blog-1825393237232252749.post-1613904056131754673</id><published>2012-04-02T05:10:00.000-07:00</published><updated>2012-04-02T05:10:01.708-07:00</updated><title type='text'>Sort the shape file</title><content type='html'>&lt;div dir=&quot;ltr&quot; style=&quot;text-align: left;&quot; trbidi=&quot;on&quot;&gt;
I have sorted the shapefile by area, so that the big blocks are rendered first:&lt;br /&gt;
&lt;a href=&quot;http://pine02.fosm.org/planet/openlayers.html&quot;&gt;http://pine02.fosm.org/planet/openlayers.html&lt;/a&gt;&lt;br /&gt;
&lt;br /&gt;
&lt;div class=&quot;separator&quot; style=&quot;clear: both; text-align: center;&quot;&gt;
&lt;a href=&quot;https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEivBErzxCefsH00VNFy7xniaiZrIAsQ0vsT5igdbKVwy7DPp_2O93pNStMfI668A88M4vgbg2gyOboziun8OTDB4YIQfbBGIuWKNFOX2iMSVG6J_nYv2snrFWiZekTmHqyG0Y32s88X2OTY/s1600/Screenshot+-+040212+-+14:09:17.png&quot; imageanchor=&quot;1&quot; style=&quot;margin-left: 1em; margin-right: 1em;&quot;&gt;&lt;img border=&quot;0&quot; height=&quot;180&quot; src=&quot;https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEivBErzxCefsH00VNFy7xniaiZrIAsQ0vsT5igdbKVwy7DPp_2O93pNStMfI668A88M4vgbg2gyOboziun8OTDB4YIQfbBGIuWKNFOX2iMSVG6J_nYv2snrFWiZekTmHqyG0Y32s88X2OTY/s320/Screenshot+-+040212+-+14:09:17.png&quot; width=&quot;320&quot; /&gt;&lt;/a&gt;&lt;/div&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
This sorts the shape file by area, and I added that column like this :&lt;br /&gt;
&lt;br /&gt;
&lt;blockquote class=&quot;tr_bq&quot;&gt;
update earthindex set bbox = BuildMBR( first_lon, first_lat, last_lon, last_lat , 4326);&lt;br /&gt;alter table earthindex add area double;&lt;br /&gt;update earthindex set area = &amp;nbsp;Area(bbox) ;&lt;br /&gt;delete from earthindex where first_lat=0&lt;br /&gt;.dumpshp earthindex bbox &quot;test&quot; ascii &amp;nbsp;;&lt;/blockquote&gt;
&lt;br /&gt;
&lt;div&gt;
&lt;div&gt;
And in the shell :&lt;br /&gt;
&amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp;sortshp test test_srt area desc&lt;br /&gt;
&amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp;shptree test_srt&lt;br /&gt;
&lt;/div&gt;
&lt;/div&gt;
&lt;div&gt;
&lt;br /&gt;&lt;/div&gt;
&lt;div&gt;
&lt;br /&gt;&lt;/div&gt;
&lt;/div&gt;</content><link rel='replies' type='application/atom+xml' href='http://osmopenlayers.blogspot.com/feeds/1613904056131754673/comments/default' title='Post Comments'/><link rel='replies' type='text/html' href='http://osmopenlayers.blogspot.com/2012/04/sort-shape-file.html#comment-form' title='0 Comments'/><link rel='edit' type='application/atom+xml' href='http://www.blogger.com/feeds/1825393237232252749/posts/default/1613904056131754673'/><link rel='self' type='application/atom+xml' href='http://www.blogger.com/feeds/1825393237232252749/posts/default/1613904056131754673'/><link rel='alternate' type='text/html' href='http://osmopenlayers.blogspot.com/2012/04/sort-shape-file.html' title='Sort the shape file'/><author><name>H4ck3rm1k3</name><uri>http://www.blogger.com/profile/04484528013589914857</uri><email>noreply@blogger.com</email><gd:image rel='http://schemas.google.com/g/2005#thumbnail' width='16' height='16' src='https://img1.blogblog.com/img/b16-rounded.gif'/></author><media:thumbnail xmlns:media="http://search.yahoo.com/mrss/" url="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEivBErzxCefsH00VNFy7xniaiZrIAsQ0vsT5igdbKVwy7DPp_2O93pNStMfI668A88M4vgbg2gyOboziun8OTDB4YIQfbBGIuWKNFOX2iMSVG6J_nYv2snrFWiZekTmHqyG0Y32s88X2OTY/s72-c/Screenshot+-+040212+-+14:09:17.png" height="72" width="72"/><thr:total>0</thr:total></entry></feed>