Katana style scope control for URLFinder

[fail-open]

Please describe your feature request:

Please port over the field scope control functionality from katana to urlfinder (dn, rdn, fqdn). It would help give a lot more control over the results.

SCOPE:
   -us, -url-scope string[]       in scope url regex to be followed by urlfinder
   -uos, -url-out-scope string[]  out of scope url regex to be excluded by urlfinder
   -fs, -field-scope string         pre-defined scope field (dn,rdn,fqdn) or custom regex (e.g., '(company-staging.io|company.com)') (default "rdn")
   -ns, -no-scope                   disables host based default scope
   -do, -display-out-scope          display external endpoint from scoped urls

Describe the use case of this feature:

It would be helpful to be able to pass in a domain and request either all results for all of the subdomains, or just the fqdn specified.

[freelancermijan]

Yes, This option will helps lot. please add this option.

[zy9ard3]

@ehsandeep @dogancanbakir

Please consider adding the below features as well for more flexible output and to control junk results

FILTER:
   -mr, -match-regex string[]       regex or list of regex to match on output url (cli, file)
   -fr, -filter-regex string[]      regex or list of regex to filter on output url (cli, file)
   -f, -field string                field to display in output (url,path,fqdn,rdn,rurl,qurl,qpath,file,ufile,key,value,kv,dir,udir)
   -em, -extension-match string[]   match output for given extension (eg, -em php,html,js)
   -ef, -extension-filter string[]  filter output for given extension (eg, -ef png,css)