Crawl files on upload

[dogversioning]

If we need data to be available from sites same day, we may want to change the way we do crawling by default.

We could, on a new aggregate type showing up for the first time, create a crawler targeted at that specific file, run it, and then remove the crawler. This post outlines some of the general idea.