This repository was archived by the owner on Dec 17, 2025. It is now read-only.
This repository was archived by the owner on Dec 17, 2025. It is now read-only.
Ensure only valid http[s] links are clicked #3
Description
The crawler currently also attempts to click whatsapp:// and similar proprietary protocol links. We should ensure that only valid http[s] links are attempted.