IP Address Range
193.183.0.162-174
User Agent
search.marginalia.nu
Crawl Interval
8-10 weeks1
robots.txt identifier
search.marginalia.nu
Email contact@marginalia-search.com in case the crawler is misbehaving, or for other related complaints or inquiries. The goal is to run an above-board, well behaving search engine crawler so any complaints are taken seriously.
If you wish to be indexed, follow the instructions in this github repository .
[1] Apart from the big refresh once every 8-10 weeks, the system also polls RSS feeds daily and does some live updates based on what it finds.