Describe the bug
The crawler continues to show that it is adding the domain that is crawled, this does not appear to be sending a request and looks to be a logging issue but we should investigate, clarify and remediate as requried.
To Reproduce
Steps to reproduce the behavior:
- Crawl a domain
Expected behavior
/ is crawled once
Screenshots
