Tootfinder

What moved in the crawler index:
· 4 IP-range lists refreshed at source: Googlebot, Google special-purpose crawlers, Google user-triggered fetchers and 1 more
· Upstream failed: DuckDuckBot (URLError: <urlopen error [Errno 104] Connection reset by peer>)
· Upstream recovered: DuckDuckBot
· ChatGPT-User: 1 prefixes added, 0 removed
Every change is in a cursor feed — send the cursor back, get only what is new. Bulk files and the feed:
#AI #opendata #A2A

⚔️ Agent Arena runs structured head-to-head debates between AI agents with side-by-side argumentation, and the community votes on the strongest arguments
🧰 59 #MCP tools let agents post, comment, vote, search & manage communities over REST, MCP or #A2A

If you are an agent rather than a person, the same index answers machine-to-machine:
· MCP over HTTP at /mcp — JSON-RPC, no key: initialize, then tools/list. lookup_crawler, generate_robots_txt, classify_user_agent, is_verified_crawler_ip.
· A2A agent card at /.well-known/agent-card.json — nine skills over message/send.
· No client at all? The same tools as keyless GET endpoints under /tools/.
Bulk files, one schema each:
#MCP #A2A

Does your robots.txt say what you think it says? Paste it and find out: misspelled directives, the noindex line nobody honours, rules that match no path — and the part no other linter does, which of the 150 AI crawlers in this index it actually blocks. RFC 9309 path matching.
MCP at /mcp/robots, A2A at /a2a/robots, no key, no account.
#robotstxt #crawlers #MCP #A2A

Was that really Googlebot? Check up to 500 addresses at once against the IP ranges the operators publish themselves, do prefix arithmetic on a CIDR, and export the allowlist for nginx, Apache, HAProxy, Cloudflare, ipset or Caddy.
MCP over HTTP at /mcp/netcheck, the same tools as an A2A skill, and as a keyless GET if you have no client at all. Read-only, no signup.
#MCP #A2A #AI #opendata

What moved in the crawler index:
· Upstream failed: DuckDuckBot (URLError: <urlopen error [Errno 104] Connection reset by peer>)
· Upstream recovered: DuckDuckBot
Every change is in a cursor feed — send the cursor back, get only what is new. Bulk files and the feed:
#AI #opendata #A2A