CiveMateBot

User-Agent: CiveMateBot/1.0 (+https://civemate.com/bot; bot@civemate.com)

CiveMateBot is CiveMate's own crawler. It reads public event listing pages and public event APIs from venues, promoters and ticketing sites, and uses what it reads to populate activity pins on CiveMate's live cultural map — never anything behind a login, paywall, or robots.txt disallow.

If CiveMateBot has visited your site, this page is what it points to. If you'd rather it didn't, see Opt out below — we remove any site the same day we're asked.

What it fetches

Public event/listing pages: title, description, date/time, venue name, and a cover image, for the sole purpose of showing that activity on CiveMate's map.
Nothing behind authentication, a paywall, or a page your robots.txt disallows for it.
No personal data, no account data, no form submissions — read-only, GET requests only.

Identification

User-Agent header: CiveMateBot/1.0 (+https://civemate.com/bot; bot@civemate.com)
Static egress IP: 34.89.214.234 — the static external IP of the GCE instance CiveMate's backend infrastructure runs on today (europe-west3). This is the current best-known value; if it ever changes we will update this page first. Reverse-DNS and forward-confirm this IP before allow-listing it, the way you would for any crawler.
Respects: robots.txt, standard Retry-After/429 backoff, and per-host rate limits (below).

Cadence

No more than 1 request every 5 seconds to any single host.
Any given page is re-fetched at most once every 24 hours.
Backs off exponentially on any 4xx/5xx response and gives up on a host after repeated failures rather than retrying indefinitely.

Block it, or ask it to stop

To block CiveMateBot via robots.txt:

User-agent: CiveMateBot
Disallow: /

We check robots.txt before every crawl of a host, so this takes effect on our next scheduled visit. For same-day removal — including removing content already ingested — email bot@civemate.com with the URL(s) or domain in question. We will stop crawling and remove any already-ingested listings within 24 hours.

Email bot@civemate.com

Questions

Anything else about this crawler — including verifying a specific request really came from us — goes to the same address: bot@civemate.com.