Computing

Web mapping for all!

Paul Cripps — Tue, 07 Oct 2008 14:04:46 +0100

Web mapping has now been made even easier by the advent of platforms such as Google My Maps where it is possible to create layers from scratch or easily overlay any KML (Keyhole Markup Language) file or GeoRSS feed over Google Maps, all done through an easy to use web interface.

A map of crime on the UK produced using the Maker! application at Geocommons.com A new site, Geocommons.com from FortiusOne, takes the concept of web mapping a step further by not only providing an online mapping application called Maker but also a spatial data library or warehouse complete with search tools called Finder. Together, Finder and Maker allow non-specialist users to quickly and easily load their own spatial data or find relevant data from the warehouse and then produce cartographically appealing maps in minutes. Data can be uploaded by registered users in simple table format for points or as shapefiles or KML for more complex geometry.

The Finder and data warehouse are an exciting development. For the first time, layers of geographic information can be uploaded and published using Creative Commons licensing. Tags are used to describe and find resources. A bit like Flickr, Scribd or YouTube but for spatial data rather than photos, documents or videos. Any data which is in the public domain is allowed to be uploaded with the onus firmly on the uploader to ensure any copyright or intellectual property conditions are met. With only this small caveat, any layer uploaded is instantly available to any registered user to create a map from. There are also enterprise options for business users to allow them to keep their data private, the aim here presumably being to make inroads into what has till now been the preserve of heavyweight desktop GIS applications.

The map Maker side of things provides the same kind of functionality as other online map creation tools but with the benefit of seamless integration with the Finder and everything being controlled through an intuitive graphical interface in the web browser. So any layer in the Finder can easily be added to a map and styled with only a few clicks with a choice of basemaps from Google Maps. In addition to simple maps showing locations of points of interest, lines or polygons with fairly basic symbology, Maker provides users with more advanced cartographic tools for producing thematic maps more akin to the sorts of thematic maps produced using desktop GIS but without the need for any in-depth background knowledge of GIS applications, programming, markup or anything complicated at all, everything being accomplished in the web browser interface. I managed to create a map showing levels of crime in the UK and one of antimony mining sites in only a few minutes (and the first thirty seconds of that was creating a user account!).

There are a couple of drawbacks however. The main problem in the UK which detracts from the ease of use is the lack of support for coordinate systems. As with the majority of online mapping tools, positions have to be recorded using global lat/lon coordinates. Whilst this makes it ideal for uploading data captured using GPS, many datasets here in the UK use a British National Grid projection, so publishing them using the Finder/Maker application requires that the coordinate system for the data must be transformed before the data is uploaded. As any GIS professional will tell you, this can be fraught with danger for novices and may require specialist software.

The fact that data in the Finder is only accessible to the Maker application or as a download is a bit restrictive; it would be nice to be able to access the layers as web-services to build into other applications. Or bring layers into Maker from other sources. Trying to do both the warehousing and mapping aspects may be great for performance but is not necessarily the best way forward; layer separation and keeping data separate from interface is way more flexible but I imagine completely impractical with todays infrastructure. Roll on web 3.0!

Of course, as with any such site based around user generated content, there will be some poor quality content and it will be necessary to be a bit discerning when choosing layers. I wasn't aware for example that the London borough of Brent has moved to the south-west, as indicated on the UK Crime map I produced using one of the layers from Finder. But in so far as providing a great set of tools for producing maps online quickly and easily and a very big warehouse in which we can put collections of geodata to be shared, it has to be a big well done to the folks at Geocommons.

Computing

Web mapping and archaeology

Paul Cripps — Tue, 07 Oct 2008 12:43:36 +0100

With the rise in popularity of online mapping sites such as Google Maps, Yahoo! Maps and Microsoft Live Maps, more and more people are creating maps and spatial ‘mashups'. The only thing holding many people back has been the need to work with the published APIs (Advanced Programming Interfaces) for such platforms, requiring some understanding of programming and HTML. Such platforms have enabled users to create maps showing all kinds of things: locations of photographs from Flickr, places visited, archaeological sites, etc, etc. Pretty much anything with a spatial component to it can be (and, in many cases, has been) mapped in this way; a really good example of the technology with some great archaeological content is the Online Archaeology map, created by Steve White.

Here at Wessex Archaeology, we are using these technologies to improve access to our geodata within the organisation. We have an installation of PostGIS to store core datasets, such as those provided by English Heritage, and a Geoserver to make these available as Web Mapping Service (WMS) layers. These are published on the intranet using an OpenLayers map which also draws in data from external sources such as Oxford Archaeology (project locations) and Getmapping (OS New Popular Edition). The same layers are also accessible to our desktop GIS applications. Being entirely open source solutions, the main investment in this approach has been the time taken to learn the various components; the learning curve being pretty steep!

This investment in technical skills now allows us to offer specialist services to help clients get the most out of open source web mapping solutions, specialist skills being essential to make the most of the technologies. This is where platforms which allow non-specialist users to get involved are rapidly becoming the next big thing; more on this later.

Computing

Lasers and Light

Tom Goskar — Mon, 06 Oct 2008 16:57:59 +0100

Wessex Archaeology were asked to contribute an animation to the new touring version of last year's successful Making History exhibition, organised by the Society of Antiquaries of London. Over the next year, Making History will visit Salisbury, Stoke on Trent, Sunderland, and Lincoln. The exhibition will change at each venue to incorporate aspects of each region's own unique heritage.

Our animation, on show in Salisbury and South Wiltshire Museum until 3rd January 2009 (and at the end of this post!), gave us the opportunity to show some more of our work with the wonderful Stonehenge LiDAR dataset, as well as 3D laser scans of the Amesbury Archer's bones, and some new data captured with the University of Southampton's Archaeology department of WWI and WWII graffiti carved into trees on Salisbury Plain.

Lasers and Light from Wessex Archaeology on Vimeo.

LiDAR uses laser survey equipment mounted in an aeroplane to record the surface of the land below in three dimensions. The animation focuses on a field system in the Stonehenge World Heritage Site. Barely visible on the ground and in aerial photography, the features of the field system are revealed when a low level light is applied to the virtual landscape, throwing the virtual landscape into relief. The light source circles the earthworks, so their extent can be seen from all angles

Lasers can also be used on a smaller scale to study objects in greater detail. Here the skull and some of the long bones from the Amesbury Archer have been scanned. The 3D model has sub-millimetre accuracy, and can be used to study and measure their physical aspects without the need to touch the original.

3D laser scanning has also been used to record graffiti on a tree trunk on Salisbury plain on which the names of soldiers stationed there during training for both World Wars. Since they were carved the tree has grown, the bark expanded and the names have become harder to read. This visualisation shows how 3D data may be able to enhance the carvings and read the names more clearly, preserving them for the future. It may be possible to correlate the information on some of the trees with military records including dates of deployment on Salisbury Plain and the fate of the soldiers who carved their names.

We are very grateful to the Environment Agency for permission to use the LiDAR dataset from Stonehenge, and to Gareth Beale and Graeme Earl from the Archaeological Computing Research Group at the University of Southampton for processing the tree graffiti data during a hectic run-up to a season of excavations in Italy.

Computing

LiDAR in Archaeology

Paul Cripps — Fri, 06 Jun 2008 01:00:00 +0100

LiDAR (Light Detection and Ranging) data is produced by attaching a laser-scanner to an aircraft. A cloud of measurement points across the landscape is produced as the laser-beam is fired at the ground and measured when it is reflected back to the aircraft.

Depending on how high the aircraft flies and how the raw data is processed, this typically results in a dataset of points spaced between 25cm and 2m apart, with a vertical tolerance of up to 20cm.

The highly detailed terrain models which can be produced from this data are incredibly useful for identifying archaeological features, even those which can barely be seen with the naked eye. In addition to the spatial component of the data, the intensity of the reflected laser beam is also recorded and this can be used to identify buried features where they cause changes in the vegetation cover or soil moisture content and hence the amount of absorption and reflectance of the laser beam.

Increasingly, this data is being used in our work. Wessex Archaeology has developed an effective methodology for the processing and analysis of such datasets. The biggest problem with these datasets is the volume of data, especially for large study areas. We have overcome this using the latest features in ArcGIS9, using appropriate data storage formats and processing routines capable of handling enormous datasets.

The latest project to make use of this approach to LiDAR data involved the processing of 19 strips of LiDAR data containing 133.5 million data points and covering an area of around 40 square km. This was processed to produce two multi-resolution Triangular Irregular Network (TIN) surfaces suitable for analysis, one for the elevation component and one for the intensity component.

These were used to produce derived analytical products such as hillshaded raster images and slope surfaces at the resolution of the source data (c.1m) ready for interpretation and digitisation of key features.

The advantage of processing this volume of data in one go is twofold. Firstly, any edge effects at the edges of the strips of data are minimised. Secondly, the amount of manual intervention is significantly reduced; had the data been processed in individual strips, it would have been necessary to undertake an additional stage of processing to clip and mosaic the datasets.

Much of this LiDAR data is being produced by the Environment Agency who are surveying areas of the country as part of their Flood Plain mapping programme. There is more information on LiDAR including how to obtain data and coverage maps on the Environment Agency website.

The image below shows an overview of the processed LiDAR data.

Example plot of LiDAR data

Computing

The Stonehenge Landscape in 3D

Tom Goskar — Thu, 15 Nov 2007 00:00:00 +0000

We have recently finished creating a short animation for the exhibition “Making History: Antiquaries In Britain, 1707–2007” at the Royal Academy in London. The three minute video demonstrates “Stonehenge revealed through digital technologies”.

It incorporates a fly-through of the Stonehenge landscape in 3D, based upon Environment Agency LIDAR (airborne 3D scanning) data, high resolution panoramas, and a new animation of the prehistoric dagger and axe carvings on Stone 53 at Stonehenge itself, from data collected by Archaeoptics Ltd.

During production of the animation, we turned the LIDAR data into a solid 3D model of whole landscape surrounding Stonehenge. Aerial tours of the most famous sites and monument groups were animated in HD (720i) resolution. What is exciting is that much of the upstanding archaeology, from well-preserved barrows to the subtle earthworks of prehistoric field systems, are clearly visible.

To do this, we had to work out how to use the data at 1:1 for our animations (for this kind of task it is often necessary to reduce the complexity of the data by half or quarter (1:2 or 1:4) due to enormous memory and processing requirements). This we achieved, and using lighting techniques we have been able to show the archaeology of the Stonehenge World Heritage Site as it has never been seen before.

This video focusses on the LIDAR data of the Stonehenge World Heritage site, including all footage as shown in the Royal Academy plus some of the footage that didn’t make the final cut. The version below is low resolution; to watch the footage in HD, head over to Vimeo.

A Virtual Stonehenge Landscape from Wessex Archaeology on Vimeo.

Computing

Surveying with SmartNet

Chris Brayne — Mon, 04 Sep 2006 01:00:00 +0100

We have been enthusiastic GPS users for a couple of years now but our latest acquisition of several Leica SmartNet enabled devices has changed the way we use the technology.

In the past when we needed to obtain accurate fixes for our survey work we have needed to log raw GPS data for several hours over one of our survey control points to process against the Ordnance Survey’s Active Station RINEX data. This sometimes meant that we had to be on site a whole day in advance of excavation teams. Smartnet uses the GSM/GPRS network to provide our rover units with real time correctional signals.

To begin with we upgraded our existing Leica1200 series GPS unit with a Smart Net GPRS unit. This allowed us to test the technology and check that we were getting the results we needed. A big concern was that we would have problems with GSM/GPRS cover - we tend to work in more remote locations than most land surveyors - so far though, Vodafone seem to have served us quite well.

In June we invested in a handful of Smartrovers - which were designed from the ground up to use the SmartNet technology and connect to standard mobile phones over Bluetooth. Again we were a little nervous - Bluetooth can be a temperamental technology - again we were very pleasantly surprised. The only time we have had serious problems with Bluetooth was when working near high tension cables.

We have now upgraded our old GPS500 rover unit to work with SmartNet. This is a very cost effective upgrade which gives the older equipment a very productive new lease of life.

Computing

Well, hello world!

Chris Brayne — Wed, 05 Apr 2006 01:00:00 +0100

We are the IT Section of Wessex Archaeology. We are a mixed team of technologists, archaeologists, managers and practitioners who work together to support the rather varied computing needs of a large archaeology practice and its even more varied clients. As well as the usual geeky obsessions, our interests include database and web development, mobile computing, multimedia, GIS and survey technology as well as theoretical issues.

The postings here are designed to allow us to share our thoughts about the work we do. We will, of course, boast horribly about our successes but we will also complain about our frustrations and let you in on some of our (more realistic) plans for the future. Perhaps we will even persuade you to help us out.

Computing