Simon Willison’s TILs
Atom feed for cloudflare
I got an unexpected traffic spike to https://russian-ira-facebook-ads.datasettes.com/ - which runs on Cloud Run - and decided to use robots.txt to block crawlers. …
robots.txt