Tootfinder

Opt-in global Mastodon full text search. Join the index!

@felwert@fedihum.org
2026-05-12 08:01:27

Fedi, I need your input! Since the web is dead and googling "which user agent to use for responsible web scraping" mostly returns AI-generated garbage promoting how to spoof the user agent for non-responsible web scraping: What are your best practices? Any guide you would recommend? #FediHelp #WebScraping