Querying the RSS feed multiple times results in 504

[decentral1se]

The RSS feed seems to lock up after multiple queries. This has happened multiple times today as a XMPP/RSS notification bot (!) was built to relay updates. I will try to come up with a reproduction for this, leaving this here for now so I don't forget.

[cblgh]

heh yeah, so there's actually a measure in place to prevent unruly robots / disrespectful rss bots from draining the server. look into limiter.go. i think we should expose & make configurable the limits and its opinions 👍

---

separate from this there's actually a concurrency issue (accessing the map in a naughty way) in there somewhere that has happened once and is on my todo to debug.

[decentral1se]

warawara has worked around the current limit implementation to prove itself not unruly 😂

Configurable sounds good!

If I see any naughty map access crashes, will post here.

[cblgh]

It can be used for other RSS feeds but the odd choices are here because it is
essentially made to be used with the cerca forum, which public feed only 
display the latest posts, only one per thread, most recent at the top.

ahah shiet 🔥