About our crawler

How to stop it, right now

Add this to your robots.txt and it will never come back:

User-agent: BoardingStablesNearMeBot
Disallow: /

We read robots.txt before anything else, on every visit. No email needed, no form, no waiting for us to action a request.

If you would also like your facility removed from the directory itself, that is a separate thing — email [email protected] with the facility name and city, and we will take the listing down.

Who it is

• User-Agent: BoardingStablesNearMeBot/1.0 (+https://boardingstablesnearme.com/bot)
• Operated by: S.A.R.L. AUDOUIN REALISATIONS, France — see our legal information
• Contact: [email protected]

What it does

It reads the public pages of horse boarding facilities that are listed in this directory, to keep their details accurate — whether there is an indoor arena, how many stalls, what disciplines are taught, whether there is trail access.

We do this because the alternative is guessing, and a directory that guesses is worse than useless to the person reading it.

Exactly what it will and will not do

• Reads robots.txt first, and honours Crawl-delay if you set one.
• One request every two seconds to your site, never two at once.
• At most four pages per visit: your home page, and up to three pages whose link text or address suggests boarding, rates, facilities, services or lessons.
• HTML only. It does not download images, PDFs or video, and it does not run JavaScript.
• It never submits a form, never follows a search URL, and never tries to reach anything behind a login.
• If your server returns 429 or 503, it stops and leaves your site alone for that run.
• It stores the facts it finds and, for each one, a short quote of at most 200 characters so the fact can be checked against its source. It does not keep a copy of your pages — only those quotes and a checksum of the text.

How often

At most once a quarter, and a visit is a handful of requests. We intend to go further and re-read your home page alone first, skipping the rest when nothing has changed; that check is not in place yet, so we state the limit we actually keep today rather than the one we are aiming for.

Something looks wrong

If you are seeing traffic that claims to be us but does not match the description above — many requests per second, image downloads, form submissions, login attempts — it is not us. Anyone can put any string in a User-Agent. Send us the log lines at [email protected] and we will tell you plainly whether it was, and fix it if it was.