OpenStreetMap Viewer

[davidar]

Continued from ipfs-inactive/archives#11

Goal: create an OSM viewer with all of the assets (tiles) hosted on IPFS

[davidar]

https://ipfs.io/ipfs/QmNUFNQXWVzbhePhj6bscW6TPu5azraCpbejbNY9zyfFjo/

A higher-resolution map is ready to go, but blocked on ipfs/kubo#1924

CC: @jbenet @whyrusleeping

[davidar]

Thanks again to @osm2vectortiles @lukasmartinelli for making this possible :)

[lukasmartinelli]

https://ipfs.io/ipfs/QmNUFNQXWVzbhePhj6bscW6TPu5azraCpbejbNY9zyfFjo/

Really cool. Do you generate the vector tiles yourself or use osm2vectortiles downloads v1.0 or v2.0?
We could even use that as CDN in our showcases.

This is also only data for upper zoom levels? As I zoom in in Europe > zoom level 11 I miss data.

[davidar]

Really cool. Do you generate the vector tiles yourself or use osm2vectortiles downloads v1.0 or v2.0?

@lukasmartinelli I extracted them from the osm2vectortiles v1.0 download. What changes have been made in v2.0?

We could even use that as CDN in our showcases.

That would be cool :)

This is also only data for upper zoom levels? As I zoom in in Europe > zoom level 11 I miss data.

Currently it only goes up to level 9, but once ipfs/kubo#1924 is fixed I'll add the remaining zoom levels (10-14)

[Kubuxu]

Currently the viever doesn't work on local gateways as it tires to access global gateway, which is blocked by no-CORS. I reported CORS issue ipfs/infra#166 and created patch to enable those options by default ipfs/kubo#2778.

The best way of accessing data on IPFS using XHR is rooted relative link: /ipfs/Qm...AAA. Then if site is opened on global gateway, the global gateway will be used, and vice versa.

[lukasmartinelli]

@lukasmartinelli I extracted them from the osm2vectortiles v1.0 download. What changes have been made in v2.0?

Okay perfect. We are also just finished with v2.0, we will release a changelog.
http://osm2vectortiles.org/downloads/

In short: has much better quality, smaller filesize and biggest of all can now be updated in a weekly interval.

Really happy to have IPFS host this 😁 Thanks @davidar for your work.

[davidar]

@Kubuxu Fixed! https://ipfs.io/ipfs/QmNfwFPQqJARCQz87i1V3uAEF2t6WxAffTfA678Ad1JZiv/?/ipfs/QmUefFZttPf9xq4KTkk94rBbZEVrBsTreDi4JA8KYhQFX6/

[btrask]

This sounds very promising!

I would like to suggest a few features for preventing tracking and maximizing user privacy:

• Provide an easy way to pin map data for large geographic areas (like cities), so that queries can be made privately on the user's own machine
• Compress the map data as much as possible so that it's practical to store on e.g. mobile devices (not sure how large the OSM data is currently, if it's small this may not be an issue)
• Structure the data so that efficient differential updates are possible (again OSM may take care of this for you, or not)
• Have an optional warning before trackable remote requests are made (e.g. if the map isn't stored locally, don't just blindly fetch it, since that could leak information)

Thanks @davidar for letting me know about this project!

[davidar]

@lukasmartinelli Updated to osm2vectortiles v2.0 (z0-z8): https://ipfs.io/ipfs/QmTAEbxXKoBWDzNduLS9WmAoNkcuHgQbc3fm9oGBe3FfR4/?/ipfs/Qmf3KBYSv9H4xADgKqpvwWrXkiMh5BfZohFXCaaFh7u4nb/

• Provide an easy way to pin map data for large geographic areas (like cities), so that queries can be made privately on the user's own machine

@btrask Good idea. I'd have to think about the best way to do this.

• Compress the map data as much as possible so that it's practical to store on e.g. mobile devices (not sure how large the OSM data is currently, if it's small this may not be an issue)

It's about 50GB in total, but substantially less for lower levels of detail. Having said that, I don't think it's possible (or at least not recommended) to run an ipfs node on mobile devices yet.

• Structure the data so that efficient differential updates are possible (again OSM may take care of this for you, or not)

IPFS deduplicates tiles, so update efficiency would depend on how many tiles are changed.

• Have an optional warning before trackable remote requests are made (e.g. if the map isn't stored locally, don't just blindly fetch it, since that could leak information)

Yeah, the issue of tracking/privacy in the context of ipfs has been brought up before. In this case you could just use ipfs offline, but that would cause remote requests to silently fail rather than issue a visible warning, so probably isn't the best solution. @jbenet Thoughts?

It's about 50GB in total, but substantially less for lower levels of detail. Having said that, I don't think it's possible (or at least not recommended) to run an ipfs node on mobile devices yet.

It is! https://github.com/ligi/IPFSDroid -- it runs a go-ipfs node though, which needs lots more work regarding resource usage.

[davidar]

@lgierth Does it? The readme must be outdated

yes! -- ligi got it to work the other day, just in time for the Berlin meetup :)