Our crawler identifies itself as:
BuckThemSearchBot/1.0 (+https://search.buckthem.com/bot)
It obeys robots.txt — both Disallow rules and Crawl-delay — and never fetches a single host faster than once a second. It collects only publicly reachable pages, for the BuckThem Search index.
To keep it out of part of your site, add to robots.txt:
User-agent: BuckThemSearchBot
Disallow: /private/