My Gemini Crawlers Meta Info Page

I have the (bad?) habit of diving into my server log files every once in a while to know what’s going on. This is not needed for a purely static site like mine. I know that I will see robots crawling my sites at will, but at least I’d like to know which ones and how.

After scouring the documenation of different Geminispace crawlers, I tried to piece together information about used IPs and more. Because the amount of information released differs, I created an overview page with all the available info and added some additional info, which I, as a user and server maintainer alike, would like to know about those crawlers.

Gemini Crawlers Meta Info

This page should be superseeded by the crawler’s own documentation and FAQs. Maybe, if we could decide on format, this could be living in a structured file at`/.well-known/crawler-info.txt` or so.