Skip to content

peterashwell/streetview-crawler

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

18 Commits
 
 
 
 
 
 

Repository files navigation

  • loading and crawling panoramas
  • manually generate link for image part using lat/lng + elevation
  • dump panoramas found to text file
  • apply to region in darlinghurst
  • get car orientation information
  • do big crawl in darlinghurst

Loading and crawling panoramas

  • use streetview api to fetch linked panoaramas
  • key data type is the StreetViewPanoramaData object, hard to find info about
  • interested in heading of vehicle - StreetViewPanorama.getPhotographerPov()

Manually generate link for image part using lat/lng + elevation

First attempt:

Dump panoramas found to text file

Get car orientation information

  • This is actually available in the StreetViewPanoramaData object under .tiles.centerHeading
  • Updated crawler to fetch this and save it in the output

Do big crawl in darlinghurst

  • Try scrapy and fiddle with timings to avoid getting blocked
  • Record failures

About

Streetview crawler

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

 
 
 

Contributors