CalsiftBot, for site owners
If you found us in your server logs, this page explains who we are, what we fetch and how to reach us.
Who is crawling
Calsift is a small service that collects public event listings from universities and organizations and sends each subscriber the events that match their interests. Our crawler identifies itself as:
CalsiftBot/1.0 (+https://calsift.drmariojunqueira.com/bot)
A few sites only answer common clients, so some requests may carry a generic user agent instead. They come from the same service and follow the same limits.
What we fetch
- Public event calendars, feeds and APIs, plus the pages of the events they list.
- Nothing behind a login, no forms, and no personal data.
- We link every event back to your page; we do not republish full pages.
How often
Each listing is checked about every 6 hours. Requests to the same host are spaced at least 1 second apart.
We do not currently read robots.txt. If you would like us to slow down, skip a page or stop altogether, email us and we will change it.
Contact
Write to [email protected]. Please include the host name and, if you can, a log line with the time of the request.