Email or username:

Password:

Forgot your password?
Alan Grant

Why mapping Points of Interest in #OpenStreetMap is hard:

The map shows shops, businesses, and some other amenities mapped on one street and square (Calle / Plaza de la Victoria) in Malaga.

I compared March 2020 with the current data, which I have been surveying and updating recently.

Only the pale blue dots have the same name and type of business at both dates. Even in this group there are quite a few changes to secondary tags (notably, dead websites).

/CTD

A map showing shops and other businesses along a single street as circles. The colour of the circle indicates what has happened between March 2020 and now. A few businesses are unchanged, but there are far more circles for points of interest that have disappeared, been newly added, changed name or change type.
18 comments
Alan Grant

Red circles are POIs that have disappeared completely.

Green circles have been added since 2020. This slightly exaggerates the rate of change as some of these were simply missing in 2020 data (especially some non-shop-like amenities like social/religious centres). But many are genuinely business opened since 2020.

Orange circles are changes in the type of POI (e.g. a clothes shop replaced by a hairdresser). Yellow are name changes, sometimes just typo fixes but usually a change of owner.

/CTD

Alan Grant

While obviously not very scientific given that it mixes changes in OSM mapping with changes in the real world, I think this gives a fair impression of how much work is involved in keeping POIs up to date. I THOUGHT I had been doing that here, but my recent survey showed I had missed a lot of changes.

However, it's possible that this particular street has been exceptionally unstable. I am continuing to survey a couple of streets directly north of here, so I will have a better idea of that soon.

SK53

@alan That looks a high rate of change, although the Covid period has undoubtedly accelerated turnover of retail outlets. From work in Nottingham and Derby I think I estimated 20% turnover of businesses per year (2013-9) based on name and primary tag alone (would be significantly higher if all tags included). We used to retain some of the old names in tags (very useful for matching old photos, local memory, archived open data etc.), but a newer mapper 'cleaned' them up. 1/3

SK53

@alan These are critical metrics in order to understand what is involved in maintaining #OpenStreetMap data. In the 2013-9 period we could manage maintenance through 1 hour mapping events before our pub meeting roughly ensuring systematic annual coverage of city centre POIs. It's harder to cover suburban POis in the same way.

We could do with an explicit way of capturing "I've seen this POI, and it's still there" without bumping the version with a check_date tag a la @streetcomplete. 2/3

SK53

@alan Remote mapping activities such as Maproulette challenges, typo fixing bots and tagfiddling, can artificially inflate the actual rate of change, and often add no new information. These can be difficult to identify if one is trying to analyse the underlying rate of change 3/3

Alan Grant

@SK53 Yes I can imagine that would be a problem for scaling up an analysis like this. My sample here is small enough, and I know the area well enough, that I was able to look at the changes individually and see that none of them were due to remote mapping. There were some manual typo fixes but that's inevitable, there is no way to check the name of a shop especially if it's not a brand (and most of these shops are not).

Alan Grant

@SK53 I think I have more or less reconciled myself to check_date, Everydoor also uses it.

I had my doubts originally as it feels a little odd to have this kind of metadata in the tags. But I have found it has significant practical benefits when trying to systematically survey an area. I now realise that in the past I had been repeatedly visually confirming some shops while ignoring others. Even the side of the street I tend to walk down turned out to be more biased than I thought!

Alan Grant

@SK53 @streetcomplete Yes, I hope that once I get the current data (for an area a bit larger than I have shown here) into a fairly complete position I will be able to better monitor the rate of change in the future. Here the 2020 data was not as complete as I originally thought.

One other complication I found was deciding which "amenity=" values to include to capture e.g. bars and restaurants but not drown the analysis in benches and parking spaces.

Alan Grant

One trend that has struck me (not just on this street but in this general area of the city) is the growth in the number of hairdressers, barbers, and beauty salons mapped since 2020.

Again, this might be partly because I previously overlooked some of these (they are often small and easy to miss when they are closed). But I think many are genuinely new. Yesterday I noticed one of them had helpfully confirmed this by displaying "Est. 2023" over the door!

Alan Grant

This is getting absurd, this evening I found 5 previously unmapped hairdressers / barbers / beauty salons in about 200m of street.

This is my life now, walking very slowly with Everydoor open on my mobile, peering up at the shop signs for hairdressers. I'm struggling to remember why I ever thought "map every POI in my barrio" was a good idea.

Alan Grant

Some hard numbers to back up my growing impression that "there are a lot of hairdressers around here".

There are now 180 shops mapped in my area of interest (defined simply as objects with a shop tag in OSM). Of those, 38 are hairdressers, barbers, or beauty salons - about 21%.

To save you all rushing off to look at Taginfo: the worldwide equivalent is a little under 8%.

(Green markers are hairdressers, grey markers are all other types of shop).

#OpenStreetMap

Map of shops in a city neighbourhoods, distinguishing between hairdressers and all other types of shop. Hairdressers account for about 1 in 5 of the shops mapped.
vespucci

@alan we have country wide ~10% including beauty studios so 30 % doesn't seem off in urban environments and matches my experience locally (lots are single proprietor operations which don't scale really relatively to other shops etc).

Alan Grant

@vespucci_editor Yes I think almost all in my sample are sole traders too, and squeezed into physically very small premises in many cases.

One thing I've also realised, and that is especially relevant to hairdressers, is that there are far more businesses on small side streets than I used to think. It's partly because I tend to pass by at night when all shops on a side street may be shuttered, whereas shops on main thoroughfares are more likely to be open.

SK53

@alan @vespucci_editor Also back in 2018 mapping of hairdressers in the UK 🇬🇧 was, if anything accelerating: sk53-osm.blogspot.com/2018/07/. Second only to convenience stores then, but fast catching up now (26k vs. 30k).

#OpenStreetMap #RetailMapping #hairdressers #AccumulationCurves.

Graphs showing number of shops mapped over time on OpenStreetMap in the UK to mid-2018. The graphs represent the most popular shop=* values at this time.
SK53

@alan Looks like we only have ~50% mapped in the UK 🇬🇧. Rule of thumb from Nottingham figures suggest 1 hairdresser per thousand people, which gives an estimate of roughly 60k (assuming under 5s don't use them), which is close to figures here nhbf.co.uk/documents/industry-

SK53 replied to SK53

@alan the other approach is bavk-of-the-envelope. If we assume 60 million customers getting hair done 4 times a year and taking 20 minutes, we get 80 million person hours or roughly 50,000 FTEs. Obviously very conservative values, but given most salons are sole traders it gives a reasonable approximation.

I'm now going to have to get my hair cut so I can interrogate my hairdresser about her customer mix.

SK53 replied to SK53

In summary: ways to estimate country totals for POIs:

* Official statistics (e.g. VAT registered businesses)
* Govt #OpenData (e.g., UK Food Hygiene)
* Trade bodies & trade journals
* Extrapolation from well-mapped places on #OpenStreetMap
* Ball park estimates from first principles with a bit of introspection.

MT @alan

In summary: ways to estimate country totals for POIs:

* Official statistics (e.g. VAT registered businesses)
* Govt #OpenData (e.g., UK Food Hygiene)
* Trade bodies & trade journals
* Extrapolation from well-mapped places on #OpenStreetMap
* Ball park estimates from first principles with a bit of introspection.

Go Up