Crowd-sourced StreetView start-up – Mapillary turns images into 3D points clouds

By Aleks Buczkowski


Mapillary is a service for crowdsourcing map photos. Using smartphones or action cams users collect images that are combined into a collective street level photo view. This is why Mapillary is often referred to as OpenStreetMap-like StreetView.

Until today Mapillary users have taken over 40 million photos. “Each of these are stitched together with computer vision – a type of artificial intelligence that extracts information from images. For every single photo uploaded, we can automatically match features to the ones in photos from the same geographic vicinity so that we can compute how the images relate to each other and how to navigate from one to the other. This is how users navigate between photos in the Mapillary app and web browser” we can read on Mapillary’s blog.

Now the company has developed a technology which takes their image data one step further. They started to use image recognition to improve positioning quality which was an issue especially in cities with tall buildings. The technique used for that purpose computes the relative camera positions and a 3D reconstruction of the environment based on images of the same area. A side effect this process is really amazing. It allows Mapillary to generate 3D point cloud models based on images.

“We couldn’t keep this to ourselves so now users can explore our underlying 3D data by simply clicking the ‘show point clouds’ option in the sidebar in your web browser. We’ve also added full support for panoramas, which enables users to move seamlessly between regular photos and panoramas in 3D, giving them a smooth and other-worldly viewing experience.”

This feature is very promising as laser point clouds are a part of 3D maps for autonomous cars. It could complement places were for some reasons Lidar data could not be captured by mapping companies like Google, TomTom or HERE.

source: Mapillary and Geoawesomeness