Gary's Bloggage » openstreetmap

The Missing Manual For OpenStreetMap?

Gary — Tue, 05 Apr 2011 17:40:30 +0000

The first computer I used at work was powerful for its day (though pitifully underpowered compared to the phone that’s sitting in my pocket at the moment) but was somewhat unfriendly by today’s standards. You sat down at a terminal (not a PC, they hadn’t been invented) and were presented with a command line prompt that said “Username:“, pass that barrier to entry and it said “Password:“. Armed with the right combination of username and password you would be rewarded with a flashing cursor preceded by a dollar sign as a prompt … $. If you wanted help you couldn’t browse the web (it hadn’t been invented) nor ask in a mailing list (the Internet was in its early days and you probably didn’t have access). Instead you consulted the big, heavy, ring bound, bright orange documentation set; these were the heady days of DEC and VAX/VMS.

The computer I’m writing this on still needs a username and password but is easy to use, graphical, intuitive and comes with multiple web sites, discussion and documentation sites and mailing lists to ask questions in. But to get the most of today’s computers you still need a book sometimes, which is why David Pogue’s Mac OS X: The Missing Manual is still one of the most well thumbed books I have, 8 years and multiple editions later. There’s a version for Windows too.

So what does this have to do with OpenStreetMap? Bear with me … there are parallels to be drawn.

OpenStreetMap is easy to use, graphical (on the website), comes with multiple discussion and documentation sites and well supported mailing lists; you can always find the answer to your question. But sometimes you don’t know what the question is. Sometimes you just want to read a book.

OpenStreetMap: Using and Enhancing The Free Map Of The World is that book … consider it the Missing Manual if you will.

Originally written in German by mailing list stalwarts Frederik Ramm and Jochen Topf in 2008 (names which will be familiar to anyone who’s spent any time on the OSM mailing lists), the book was translated into English with Steve Chilton (chair of the UK’s Society of Cartographers) towards the end of 2010. A translation would be impressive enough but the English version also comes with expanded sections and all of the content, examples and illustrations have been revisited, revised and updated.

Whether you’re an OSM expert or you just want to see how one of the largest voluntary, crowd sourced projects on the face of the Internet works this is a worthy and valuable addition to your bookshelf. While no OSM expert I considered myself fairly well versed in how to use OpenStreetMap. Reading the book was a salient lesson on just how much I didn’t know; the section on GPS was an education in itself.

The book also provides a well written and easy to understand explanation of what you can and what you can’t do with OSM’s wealth of geographic data and answers so many of the questions on data licensing that crop up again and again in conversations around OSM and on the mailing lists.

As a written work, the OpenStreetMap book works on multiple levels. You can dip into it, select the parts that interest you, get distracted by reading about stuff you didn’t think you’d want to know or you can read it from cover to cover.

If you want to contribute data to OpenStreetMap … this is the book for you
If you want to use OpenStreetMap data to create maps … this is the book for you
If you want to integrate OpenStreetMap data into a web site … this is the book for you
If you consider yourself as a fully paid up geo nerd who lives and breathes open data … this is the book for you. No … really

One final thought; the old adage about the Internet being an information hose pipe holds true where OpenStreetMap is concerned. The volume of information and data is simply staggering. You can find your way through all of this information by yourself. Or you can just read a well written, well thought out book instead. Even in today’s online world there’s still a place for the feeling you get from holding a book in your hands and leafing back and forwards through the pages. My copy of this book is still reasonably pristine, despite being hauled on and off planes and read from cover to cover. I can’t guarantee it’ll stay that way for long.

Written and posted from theRadisson Blu hotel, Berlin (52.519648, 13.40258)

Crowd Sourcing The London Underground Tube Strike

Gary — Sun, 03 Oct 2010 17:39:09 +0000

From as early as 9.00 PM tonight, the London Underground network will be hit by a strike called by the RMT and TSSA unions. Again.

For Londoners this will probably come as no surprise, but this time around, the BBC are crowd-sourcing a map of station closures, services affected and the knock on impact to other forms of London public transport, using publicly submitted reports and media in addition to reporters on the street. It seems natural enough that this will be visualised on a map and in tonight’s BBC London News, it was plainly evident that the BBC are using OpenStreetMap as the underlying map tiles for the visualisation.

You can see a snapshot of how the map looks, taken a few minutes ago; head over to the London Tube Strike Map for more updates as the strike starts to affect London.

Written and posted from home (51.427051, -0.333344)

What’s Wrong With OpenStreetMap? Have Your Say

Gary — Wed, 07 Jul 2010 15:01:58 +0000

At the end of this week, anyone with even a passing interest in OpenStreetMap will be descending on Girona to be at the annual mapfest that is the State Of The Map conference. Sadly I won’t be there this year, as I mentioned in a post earlier this year. But Chris Osborne will and he’s hosting a panel discussion under the intriguing title of What’s Wrong With OpenStreetMap, with all the attendant controversy that such a title might engender. Yesterday, he asked for points around which to build the inevitable conversation that will ensure, so here’s a list of points that I’d love to see debated.

Is OSM Finished? The terms complete or finished mean different things to different people. OSM certainly has global coverage but at what point do you say that the project is complete and that it’s refreshing and maintaining the data from this point on?

Is OSM Just About The Map? Building the OSM map has been an amazing achievement, but the current explosion of interest around location and geo has been as much about linking disparate geographical data sets as it has been about displaying a map. Should OSM look beyond just the map and become more about enhancing and expanding the reach and scope of the data?

To Fork Or Not To Fork? Healthy debate is an essential part of any collaborative process but from following some of the, err, heated discussions on the OSM mailing lists, healthy debate often descends into all out flame war, which doesn’t solve anything and merely showcases a clash of mutually opposed viewpoints and personal agendas. Forking a project has given a fresh lease of life to many collaborative open source projects; is this the future for OSM?

The Unfortunate License Question? Crowdsourcing open geographic data certainly works. It’s worked for OSM and even traditional map data vendors are seeing the benefit of this approach. But there is not and cannot be one single source of geographic truth; almost all successful uses of geographic data, both commercial and not for profit, aggregate data from a variety of sources to meet the particular needs of the project at hand. Yet despite a new OSM license, the terms and conditions are in some ways more restrictive than the traditional data vendor’s licenses. The irony of which is that the license under which Britain’s Ordnance Survey has released their open data allows aggregation and comingling far easier than that of OSM. Is the current OSM licence too restrictive to allow its use beyond the open source licensing community?

I look forward to seeing the Twitter steam and blog posts that come about after the panel has finished. Good luck Chris, hope you make it off of the stage in one piece!

Photo Credits: Peter Ito on Flickr.

Written and posted from home (51.427051, -0.333344)

When Maps and Data Collide They Produce … Art?

Gary — Tue, 01 Jun 2010 18:45:24 +0000

Last month I wrote that a map says as much about the fears, hopes, dreams and prejudices of its target audience as it does about the relationship of places on the surface of the Earth. With the benefit of hindsight I think I was only half way right.

Sometimes a map becomes more than just a spatial representation and becomes something else.

Sometimes a data visualisation becomes more than just the underlying data and almost takes on a life of its own.

When these two things meet or collide the results can be spectacularly compelling and produce, unintentionally … art? Look at the image below … filigree lace work? Crochet for the deranged of mind? Silk for the sociopath? Macrame for the mad? Sadly none of the above.

It’s instead an image from the Geotagger’s World Atlas but it’s still unintentionally beautiful.

The maps are ordered by the number of pictures taken in the central cluster of each one. This is a little unfair to aggressively polycentric cities like Tokyo and Los Angeles, which probably get lower placement than they really deserve because there are gaps where no one took any pictures. The central cluster of each map is not necessarily in the center of each image, because the image bounds are chosen to include as many geotagged locations as possible near the central cluster. All the maps are to the same scale, chosen to be just large enough for the central New York cluster to fit. The photo locations come from the public Flickr and Picasa search APIs.

I could look and stare at the all the images in Eric’s Flickr set for hours. Correction, I have stared at the images for hours.

Photo Credits: Eric Fischer on Flickr.

Written and posted from home (51.427051, -0.333344)

(Geo) Chicken and Egg (The Problem with Press Releases)

Gary — Sun, 18 Apr 2010 15:44:34 +0000

There’s a danger in looking at too many press releases; you can easily come to think that the view of the world that these pieces of writing portray are a fair and accurate representation of the real world.

Thus both myself and the ever readable James Fee were vastly amused to see Michael Arrington’s TechCrunch refer to CloudMade’s OpenStreetMap.

Many people describe CloudMade’s OpenStreetMap project as “Wikipedia for maps,” and they aren’t far off. The project allows anyone to add and edit map data around the globe, and the project is now a viable open and free source of mapping data for third party developers.

Now is probably a good point to mention that CloudMade was founded (by OpenStreetMap founder Steve Coast amongst others) in 2007 and OpenStreetMap launched in 2004. Geo chicken … meet Geo egg.

I look forward to reading about other TechCrunch exclusives including the discovery of RedHat’s Linux and British Airway’s airplanes.

Photo Credits: The Eggplant on Flickr.

Written and posted from home (51.427051, -0.333344)

The Changing Face of UK Geo Data … But Changing With a Bang or a Whimper?

Gary — Wed, 02 Dec 2009 21:02:45 +0000

This is not the blog post I set out to write. The one I set out to write was about Flickr, about machine-tags, about noticings and about transport data feeds. I had it all mapped out in my head during one of those wide awake in the middle of the night and your mind’s buzzing moments. But as I started to research the blog post that I had set out to write, it mutated.

So with the caveat that I’m well aware that I’m making a sweeping generalisation whilst simultaneously doing a large disservice to a lots of specialist UK data providers …

Until recently, if you wanted a source of geo data in the UK you had three choices.

Choice One. Go with one of the big global players, who primarily specialise in the personal navigation market. You could go with the chaps with the blue and white mapping cars, Navteq, who were acquired by Nokia in December 2007. Or your could go with the chaps with the orange and white mapping cars, TeleAtlas, who were acquired by TomTom in July 2008. The pros? Great global coverage, maybe lacking slightly outside of the traditional US heartland. The cons? It comes at a price and with a whole set of derived data and associated licensing restrictions.

Choice Two. Go with OpenStreetMap, the freely available, user generated, maintained and contributed wiki-map of the world. Launched in 2004 and contributed to and supported by invididuals, and by companies such as AND and Yahoo! OpenStreetMap is the antithesis of proprietary licensed geo data and offers an open licensed data set downloadable at a variety of granularities. The pros? Ever expanding coverage and freely and openly available. The cons? Dependent upon the OSM community and with limited coverage outside of urban areas when compared with competitors.

Choice Three. Go with The Ordnance Survey, the UK’s national mapping agency, which covers the country in totality at more levels, representations and data forms than most people would ever need. The pros? Amazing coverage with resolution down to a few metres. The cons? One of the most restrictive data licensing regimes, claiming ownership of derived data and with often heavy handed enforcement.

But then, to clumsily paraphrase a certain 70′s album … and then there were five.

Choice Four. Go with The Ordnance Survey. Yes, you read that right. Earlier this month the UK Government announced that many of the Ordnance Survey’s data products were to be made available as open data and for free download. Whilst it’s not the complete opening that the Guardian’s Free Our Data campaign has been, err, campaining for, it’s a start. It’s taken a while but as ex-OS and Google Geo Technologist Ed Parsons put it “Now why was that so difficult“?

Choice Five. Go with UKMap. This new UK geo data source, built from scratch the old fashioned, man on the street with pen, paper and GPS way, first surfaced early this year, launched at the British Computer Society in July 2009 and was at the Society of Cartographers Summer School in September 2009. Whilst not free, not open and not even with total UK coverage, UKMap is the first major player in the UK geo data market since OpenStreetMap launched in 2004.

So here’s the questions that have yet to be answered. Who does UKMap threaten? Is it a challenge to The Ordnance Survey’s lucrative government, local authority, surveying and emergency service market. Will UKMap open up some of their data to challenge OpenStreetMap’s position as the geo data source of choice for the geoweb developer community in the UK? Or will UKMap, The OS and OSM form an uneasy alliance for UK geo data? As 2009 comes to a close it’s too early to say but 2010 will allow each of these valuable data sources to reposition and prove themselves as the geo data market grows and reacts to change.

Posted via email from Gary’s Posterous

The (Geo) Data Dichotomy Dilemma

Gary — Mon, 16 Nov 2009 18:30:57 +0000

Before Web 2.0, before mashups, before FreeOurData.org.uk and other pleas, before the Internet itself, things used to be so much simpler for geo data. You were either an end user and accessed the data as a map or you were a GIS Professional and accessed the data via a (frequently very expensive and very specialised) Geographical Information System. But now we have geo data, lots of geo data, some of it free, some of it far from free, both in terms of usage and cost and a fundamental problem has replaced the paucity of data.

Everyone wants free, open, high quality geo data and no one wants to pay for it. But it’s not quite that simple.

The recent acquisitions of Tele Atlas and Navteq, the two big global geo data providers, by TomTom and Nokia respectively show the inherent value in owning data. But owning the data isn’t enough any more as the market for licensing the data is a shrinking one, despite the phenomenal growth of the satnav market, both in car and on mobile handsets. Why is the market shrinking? Because no one wants to pay for it, at least directly.

TomTom, primarily a hardware vendor, are differentiating into the software and data market, seems to be concentrating on the PND usage of the data, although we’ve yet to see how the outlay necessary to acquire Tele Atlas coupled with the overall economic downturn will effect their overall 2009 earnings. Their Q1 2009 report somewhat dryly notes that “market conditions were challenging” and that “we are making clear progress with the transformation of Tele Atlas into a focused business to business digital content and services production company“. There may be other aspirations at play here but for now at least, the company is keeping quiet.

Nokia, also primarily a hardware vendor in the form of mobile and cellular handsets, are also moving away from their roots and into a wider market, hopefully in an attempt to stop the encroachment of upstarts such as HTC, Apple and RIM into Nokia’s traditionally strong smartphone heartland. Again, Nokia has yet to make a public play into this arena but all the composite elements are in place to enable this to happen.

Taking the opposite route, Google, which started off as a software player are now moving to being a player in the data market by gathering high quality geo and mapping data under the smokescreen of gathering Street View. This has allowed them to gather sufficient data to supplant Tele Atlas as a data provider, at least in the Continental United States.

All three companies are either making or have the prospect of making determined plays in the location space but all three of them have ways of leveraging the value inherent in their data. Google has their unique users, their search index and a vast amount of advertising inventory; TomTom their satnav customers; Nokia their handset customers, albeit one level removed with the Mobile Network Operators as an uneasy partner and intermediary.

So what of the open data providers? It’s important to remember here that open doesn’t always mean free, it means the ability to create derived works and to use the data in ways that the originator may not have immediately foreseen. True, a lot of open data is free, but even then it’s the Free Software Foundation’s definition of the word.

“Free (software) is a matter of liberty, not price. To understand the concept, you should think of free as in free speech, not as in free beer.”

The poster child of open geo data is OpenStreetMap, the “free editable map of the world”. Founded in 2004 by Steve Coast, OSM has enjoyed phenomenal growth in users and in contributions of data that can be used anywhere and by anyone and which espouses the values of free as in speech and as in beer. As with all community or crowd sourced collaborative projects, OSM’s challenge is to sustain that growth and once complete coverage of a region is reached, in keeping that coverage fresh, current and valid. We’ll leave aside that fact that complete coverage is an extremely subjective concept and means many things to many people.

Traditionally strongest in urban regions, one of OSM’s other key challenges is to match the expectations of their user community who consume that data rather than those who create it. Both internationalisation of the data and expansion out of the urban conurbations will potentially prove challenging in the years to come. That’s not to say OSM isn’t a significant player in this space and the quality of the data, though varying and in some places duplicated, is for the majority of use cases, good enough. This was backed up by research undertaken by Muki Haklay of UCL which answered the perennial question of “how good is OSM data” with a pithy “good enough”.

Attempts to capitalise on and monetize the success and data corpus of OSM through the Venture Capital funded Cloudmade have yet to deliver on the promise and with the exception of a set of APIs, Cloudmade has announced the loss of their OpenStreetMap Community Ambassadors and the closure of their London office. All of which lends credence to the fact that simply owning the data isn’t enough.

So how to solve the dichotomy of geo data? Everyone wants it but no one’s willing to pay for it with the exception of the big players, the Googles, the Yahoos and the Microsofts of the world and control of the proprietary data sources has centralised into TomTom and Nokia, both of whom are well placed to capitalise on their data assets but who haven’t yet delivered on that promise.

Maybe the answer is twofold. Firstly develop an open attribution model whereby the provenance of an atom of data can be tagged and preserved; this would remove a lot of the prohibitions on creating derived works at the original data provenance could still be maintained. Secondly allow limited usage of proprietary data at varying levels of granularity, accuracy and currency, thus creating a freemium model for the data and stimulate developer involvement in donating data to the community as a whole.

It’s too early to see whether this will come to pass or whether an already tight hold on the data will become tighter still.

Posted via email from Gary’s Posterous