Mapping & Planning Support (MAPS) meets OpenStreetMap (OSM)

Mapping and Planning Support (MAPS) is a volunteer group based out of Canberra that provides Geographic Information Systems (GIS) support to emergency services during a “major” disaster. It was started in 2005 by Frank Blanchfield and Ian Batley who foresaw the need for a stand-by volunteer mapping team that could spring into action during a major natural disaster. MAPS was strongly supported by Adam Atkinson (RFS) and Steve Forbes (SES/RFS). By the time I joined MAPS in 2008 the team had already had several dozen deployments for a range of emergency activities: everything from fires, floods and flus. MAPS volunteers come from a multi-talented pool of professionals and they are the Australian equivalent of MapAction. There is a great presentation by Ian Batley on the volunteer technical community model of MAPS.

You can’t really talk about MAPS without making reference to the Black Saturday Bushfires. The Black Saturday firestorm of 13th February 2009 was Australia’s worst natural disaster. The fires were intense and ferocious and led to over a 170 fatalities and damaged over 3000 properties. Some towns were nearly wiped off the earth. Just two days after Black Saturday the first MAPS team was deployed on ground working with Victoria Police and other state and federal agencies to assist. That operation continued for 9 weeks. During the deployment MAPS assisted Victoria Police in the coordination of Search & Rescue efforts. Accomplishments included developing map products for carrying out search of over 3000 property parcels in a period of 2 weeks; developing workflows, data quality control routines and databases for capturing, storing, and analysing data collected by field search and rescue teams; developing mapping products to aid reporting of fatalities. Data captured included spatially referenced photographs, high resolution aerial imagery and real time data from GPS enabled handhelds and cameras. Software used included ArcPAD, ArcGIS, ArcSDE, SQLServer and MS-Access. I also wrote custom scripts (in ruby) to process over 9000 georeferenced photographs.

After the MAPS deployment to Victoria we started a working group to investigate the potential for using Open Source tools along with the proprietary applications that are currently used.

Then in January 2010 another natural disaster caught the world’s attention. I wanted to help. But this time I was several thousand miles away from the disaster. I have never been to Haiti, yet I was able to contribute towards the mapping of a country that had had it’s national mapping agency completely destroyed and sadly most of its staff killed. The work was done sitting in my home office working late at night to digitize aerial photograph, intermittent with some wiki gardening. This time I was not working under any formal organisation but rather with a loose community of open source and mapping enthusiasts. And due to my background of working with MAPS I was acutely aware of the value of mapping to first responders. Thanks to the OSM community this work was being used by responders in Haiti. After Haiti I gave a few presentations on how this data was collected, used and will play a key role in the future of Haiti. That talk is at slideshare.

After Haiti I realised that although MAPS can handle disasters in Australia and the Asia Pacific region – if they had formal links with the OpenStreetMap, CrisisCommons and CrisisMappers communities they could learn a lot from each other and the collaboration would help become much more versatile. As I was thinking about formalising this relationship the time for the MAPS Autumn Training also came along. This provided an ideal opportunity to introduce OSM to MAPS. And as it turned out other MAPS co-ordinators where also thinking the same thing. So last weekend we had a training day at the ACT State Emergency Services HQ and we included OpenStreetMap – a crowd sourced, open and free database of spatial data. AFIK this was the first time in the history of MAPS and Australian volunteer emergency community, in general, that a crowd sourced database was used. This is the first step by MAPS to engage with the OSM community and over the coming weeks the working group will be meeting regularly to start to pull together the tools and expertise needed to make OSM a regular source of data and information. My presentation slides and tutorial videos are below:

Here is a video showing how to print walking papers and collect data.

Walking Papers Tutorial – part 1 from shoaib burq on Vimeo.

Here is the video showing the use of walking papers to add data to OSM.

Walking-Papers Tutorial part 2 from shoaib burq on Vimeo.

Posted in openstreetmap | Leave a comment

Plotting a feed of USGS ShakeMaps

Screen shot of the ShakeMap feed

Since Haiti I have been doing a lot of reading on disaster response and recovery. Today I needed to load a GeoRSS feed from USGS. They publish the location of earthquakes as a GeoRSS feed. They also publish a product called ShakeMaps. This is a fantastic product since it provides a map of the actual “ground shaking” a not just the simplistic magnitude and epicentre. Creating a ShakeMap is a function of local geology, epicentre, magnitude and many other variables. You can read about it here. ShakeMap are thus much more useful from a disaster response and recovery point-of-view. For example if you have the necessary data on geology and population exposure you can run a model that simulates an earthquake over a region to predict the likely effect on the population.

Getting back to the GeoRSS – the ShakeMap feed allows us to integrate this into any web mapping application thus creating interesting mashups. E.g. overlaying it with socio-economic or population exposure or vulnerability data to show the simulation results I mention above.

Okay so I’ll show you how to set up a GeoRSS feed parser using Sinatra. Here is the ShakeMap as GeoRSS Feed. You will need ruby and sinatra installed.

Here is the code for the routes in sinatra:

require 'rubygems'
require 'sinatra'
require 'open-uri'
get '/' do
  haml :shakemaps
end
get '/proxy' do
  open params["url"]
end

When the client hits the our root url (/) we will render the OpenLayers map with the USGS ShakeMap. We may also want to let people add other feeds.

So in our shakemaps.rb the first route is to the root. This is pretty simple, when the root of the app is hit the server renders the shakemaps haml template. The haml template loads our javascript to render the OpenLayers map. This javascript also calls the shakemap GeoRSS feed via a proxy. The proxy is needed because OpenLayers which is a javascript library isn’t allowed cross-site-server calls. The proxy is where the second method in shakemaps.rb comes along. It looks for the parameter url at the end of the URI and simply opens it. This is the GeoRSS XML feed. Finally there is a form allowing us to point to other GeoRSS feeds.

Posted in interoperability | Leave a comment

Protected: Obfuscated map tileserver

This post is password protected. To view it please enter your password below:


Posted in RubyOnRails | Tagged , | Leave a comment

Openstreetmap Multan Progress

Last few years have been difficult for Pakistani citizens. However the ordinary citizen is so removed from the geopolitical forces driving the conflict in Pakistan that it is hard to imagine how an ordinary citizen may be able to contribute to resolving the conflict. In these circumstanses I was delighted to see the progress that the openstreetmap community in Multan have been making towards mapping their city using Openstreetmap. Here is a video from Aleks created from the GPS tracks that Kashif has been editing for the OSM community in Multan. Keep it up folks!

Mapping Multan from Aleks on Vimeo.

Tags: , ,

Posted in Uncategorized | Tagged , , | Leave a comment

Pakistan at the State of the Map, Amsterdam

OSM in Pakistan hasn’t been very active in the past. However the future is looking bright. This year during the state of the map in Amsterdam you will run into a university professor – but don’t let the absent minded-professor-look fool you. This is a man on a mission – as a professor at the largest university in Multan (Bahauddin Zakariya University) he has managed to generate a ground swell of students and faculty to start systematic mapping of Multan. He has just received a small (as in tiny) grant from his University to help kick-start the mapping of Multan.

There is a lot of work ahead and being in Amsterdam (thanks to the generous scholarship from Open Society Institute) he will be keeping his ears open to learn as much as possible from the seasoned OSMer – especially those from countries at a similar stage of mapping as Pakistan.

So get to know this face and if you see it introduce yourself and share ideas. He will be giving his lightening talk along with the other scholarship holders – add it to your calender here.

You can checkout the planned mapping parties in Multan, Pakistan. Also feel free to get in touch with Asif via email: mianasifrasul at gmail.com

Posted in Uncategorized | Tagged , | 1 Comment

FOSS4G 2009 Schedule Hack – Part 2

Note that this post is for folks who are new to ruby. I have to admit a lot of geospatial developers have not been using ruby due to the poor support for geo libraries in ruby – so it’s understandable. In this post I will show how to start parsing the FOSS4G 2009 Schedule. Lets start by gathering our tools. I am going to assume you have ruby installed. If you don’t have Ruby install, don’t fret there are now one-click installers – yes even for windows: http://www.ruby-lang.org/en/downloads/.

Reading YAML: The first thing we will need to do is to read the ‘official’ FOSS4G schedule YAML file that’s hosted at http://2009.foss4g.org/schedule.yml – as of writing this it contains data for workshops and tutorials. We will connect to the url using OpenURI module which is part of Ruby’s standard-lib. So lets try something simple, like reading the data into a Hash:

The data from the schedule is now loaded into the hash named data. If you are not familiar with ruby hashes checkout the class docs http://www.ruby-doc.org/core/classes/Hash.html also if you listen to the surreal voice in these videos you will fall in love with hashes forever – don’t say i didn’t warn you.

Ok moving on, lets poke around this data structure containing the FOSS4G schedule. Lets say I want to iterate over each tutorial and workshop then create an ical entry that we can share with our friends – so they know which sessions they may be interested in attending. Useful eh? – OK maybe not that much but it’s a start. The code for iteration would look something like this:

Next I’ll show you how to create an iCal entry and perhaps email it to your friends.

Posted in hacks | 1 Comment

FOSS4G 2009 Schedule – iPhone + ruby Sinatra hack

Path Finder-9

Web is a great ideas playground. This is the last week for the submission of Presentations for FOSS4G 2009 (http://2009.foss4g.org/presentations). So far we have had a great set of workshops and tutorials submitted. Mark Leslie (FOSS4G 2009 Workshops Chairman) did a fantastic job coordinating the call, receipt and collation of workshops and tutorials as well as managing the voting process (Checkout Mark’s post about the workshops/tutorials). This has resulted in an impressive line up of expert instructors and tutorials on cutting edge and relevant topics.

This information was provided in a document to me by Mark. For the FOSS4G 2009 conference we want this information as widely shared as possible.

So the first thing I did was to take the information that Mark give us and converted it into a YAML format. This meant coming up with a simple data model for the data.
I did this by creating the a file for events called schedule.yml and one for presenters: http://2009.foss4g.org/schedule.yml and http://2009.foss4g.org/presenters.yml.

They both reference each other. After some trial and error I came up with something that gave us a good description of the event, authors/presenters and time of event. It had to be intuitive and easy to parse:


Next I want to demonstrate how easy it is to create build something useful from these YAML file. Well I am an iPhone owner and also enjoy developing in ruby.

Path Finder

Enter Sinatra: My first thought was to build an iPhone website where people can browse the FOSS4G 2009 – and it stuck. I decided to use Sinatra an elegant, lightweight ruby web framework. The site is up and running at http://foss4g2009.heroku.com You can get the code using git from git@heroku.com:foss4g2009.git

In the next few posts I’ll walk through and show you how I built this site using sinatra + iui and used heroku to deploy it. The site currently features:

  • Browse workshops & tutorials
  • Share ical event file of an event via email
  • Download ical event file of an event via web

Hope it will encourage others to hack around with this data or suggest ideas for building something interesting for the FOSS4G 2009 conference.

Posted in hacks | Leave a comment

What is a SDSS and how is it different from a GIS?

IMAGE SOURCE: ABC

image source ABC

Lately I have been doing some work as a volunteer in the aftermath of the victorian bushfires. We have been using GIS a lot but there was always something missing during the emergency mapping and spatial analysis. This was a Spatial Decision Support System.

So what is a SDSS and how is it different from a GIS?

In order to understand SDSS and know the difference between GIS and SDSS it is important to understand what a GIS is. GIS is a piece of software that can perform generic spatial analysis and geoprocessing methods on geographic data. It requires an GIS Analyst or an expert to operate it. In contrast a Spatial Decision Support System is a domain or an industry specific software. It doesn’t require a GIS expert to operate but rather a domain expert. As the name suggests the software provides decision support but to do so makes use of spatial analysis, geo-statistics, geo-processing or other tools from spatial information sciences. To begin with a SDSS must be designed to answer some domain specific questions that have strong elements of geography.

This is best illustrated through an example: say, in coordinating the containment of a bush fire a sector coordinator needs to decide on where to deploy bulldozers to create a containment line or a barrier to the advancing fire-front. The job of the software is to provide the coordinator with a number of alternative answers that they can choose from based on their experience. In this instance the SDSS will take into consideration a number of information sources, perform a combination of spatial analysis and use sophisticated fire modeling to determine answers.

From the above example it is clear that a Spatial DSS must have access to relevant up-to-date spatial data, contain algorithms from spatial information science and domain-specifc models to answer domain-specific questions and a method for visualizing the answers. So for the sector coordinator the relevant data required would be topography, vegetation fuel maps, weather forecast, real-time weather measurements, verbal information from lookout towers and/or air surveillance, satellite reconnaissance, information from thermal cameras. All this would need to be geo-referenced and lie with in the spatial extent of her sector.

Next component is the algorithms that will convert raw data into useful knowledge. It is important to note that data and algorithms are closely linked since some of the data sources may be derivative products. For example vegetation fuel map may have been derived by applying a Normalized Difference Vegetation Index (NDVI) algorithm to multispectral remotely sensed satellite imagery.

Another example may have an algorithm to convert topography into slope. This slope may be used to rule out areas that are too steep for bulldozers to operate. This nicely leads us to the related component of domains-specific models. In this case the information from the slope, weather conditions (such as wind direction and humidity) as well as the vegetation fuel data may form inputs into a fire-model that predicts the future course of the fire. This information may then be combine with areas where bulldozers can operate to give deployment alternatives to the coordinator.

In a SDSS the above process would form a seamless chain of inputs and give an output. While in a GIS the above would be done by an expert spatial analyst who must be aware of all the pitfalls of combining different spatial data and deal with spatial coordinate systems. But above all a GIS will lack the modeling capability to predict the future course of the fire let alone understand what a bulldozer is. This brings us to another important difference between a GIS and SDSS. SDSS must deal with semantic information. In a SDSS spatial data cannot exist in isolation from its meaning.

Posted in industry | Tagged , , | 7 Comments

Documenting Drought (Beyond Reasonable Drought)

Today while riding by bike around Canberra I stopped over at the old parliament house to catchup with a friend. I was blown away by a stunning exhibition called “Beyond Reasonable Drought”. The exhibition documents in photos the effects of drought on the people, livestock and the land over the last few decades. The project looked to the Farm Security Administration (FSA) project from the great depression for inspiration. The FSA project is no doubt was one of the most impressive examples of photo-journalism.

In the Australian exhibition, as if the photos were not impressive enough upon checking out the website (http://www.oph.gov.au/brd/) for the exhibit I found all photos are geotagged.
http://tinyurl.com/drought-map-kml
http://tinyurl.com/drought-map-flickr

This information when overlaid on top of the major river basins in Australia provides an instant understanding of why the Darling/Murray basin is running out of water. If we take the clustering of the photographs as a surrogate for drought intensity then most of the photos are clustered in the southern end of the daring/murray basin in Victoria.

Google Earth
Uploaded with plasq’s Skitch!

On a related note I just finished a project with Mikel Maron to document the growing trend in the US amongst younger people to take up farming. This aims to capture profiles of young farmers by getting them to complete a survey and provide their location. Check it out here http://www.serveyourcountryfood.net/ (it was just launched and is currently in beta)

Posted in Australia, google earth | Tagged , , | 2 Comments

one GPS and fourty-something bikes

Kashif Rasul last year decided to buy himself one of those GeoChron GPS from SparkFun (they are really cool: field hardended and can take SD cards check it here) … after doing some mapping around Europe and Malaysia he decided to use it to initiate the first openstreetmap mapping party in Multan (which incidentally is one of the oldest known cities in the world – wikipedia-page). So he parted with his beloved GPS and it has started to pay off… Multan which till last week was completely blank on OSM has now got its first two roads…

To promote the idea of mapping parties Kashif’s dad who is a professor at a university in Multan organised a talk and mapping party. With just one GPS this first mapping party attracted over 45 people. This is huge! Here’s the email from Asif Rasul himself:

“How r u [Kashif]? I have given the presentation today about 45 people came. went fine. We will Inshallah start the regular work on week ends. Many student volunteered the job by motorcycle.”

Sweet! Below are the fantastic slides that Kashif and Aleks put together … they really hit the spot and make one wanna get out and map! i have to say thanks to Mikel Maron for being an inspiration (with his recent OSM related work in the Middle East) and letting us use some of his material for the slides. We also used some of Andrew Turners photos.

As you see in the slides we are currently constrained only by the number of GPS’s – no lack of motorbikes and riders here :) .. so if someone out there is looking to support a good cause then donate some GPSs for mapping a city which has a rich, unique and beautiful culture. Sadly publically available spatial data is scarce. There is a lot of work to be done and to keep the mapping momentum in Multan we really do need more GPS’s. I look forward to the day that this data can be used by the citizens of Multan for social development projects.

If you would like to get in touch about donating GPSs or are interested in osm in Pakistan feel free to leave a comment below or email us.

Posted in geodata | Tagged , , , , | Leave a comment