[Feat] Remove repetitive content on /crawl

[calebpeffer]

Sometimes, customers want to remove any boilerplate on pages.

One potential strategy on the crawl endpoint is to remove any content that is present on all pages. For example, if there is a navigation bar at the top of the page, that would be cleaned from the content. because it would be present on each page.