**Is your feature request related to a problem? Please describe.** Support an providing a list of URL exclusion patterns to omit from crawling