Skip to content

Crawler reports multiple adding of domain #44

@steveworley

Description

@steveworley

Describe the bug
The crawler continues to show that it is adding the domain that is crawled, this does not appear to be sending a request and looks to be a logging issue but we should investigate, clarify and remediate as requried.

To Reproduce
Steps to reproduce the behavior:

  1. Crawl a domain

Expected behavior
/ is crawled once

Screenshots

image

Metadata

Metadata

Assignees

Labels

No labels
No labels

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions