Little tip - To crawl multiple subdomains or root domains that are unlinked, switch to list mode (Mode > List), then disable the 'limit crawl depth' setting (Config > Spider > Limits) & upload them to crawl together.

5 likes 0 replies