Jul 7
Blacklist specific bots from indexing
Some generic scrapers are hitting our feed too often. We need a way to filter out specific user agents in the settings.
Reviewing
last week
A blocklist toggle would be a huge help to keep bandwidth costs down.
Agreed, we see a lot of junk traffic from unknown crawlers during the night cycle.