FitsRailBot
The crawler behind FitsRail search
FitsRail helps UK shoppers find clothes and sends them to the store to buy. FitsRailBot reads public product pages to keep that search up to date.
You run a store
What it reads
Product names, prices, sizes, colours, stock and product photos. Public pages only: no accounts, baskets or personal data.
What you get
Shoppers who search FitsRail see your product and click through to your product page to buy. We show your product photos next to the link. An AI model reads the product text and photos to describe each item for our search. Used only for FitsRail's product search, with a link to your store. We never sell it, pass it on, or let anyone else train AI models on it. It is not price monitoring for another retailer.
How gently
One request at a time, at least 1 s apart, overnight (01:00–06:00 UK), about once a week.
It follows your robots.txt and Crawl-delay, and stops at the first
block.
Stop it
User-agent: FitsRailBot Disallow: /
or email [email protected]. Within two working days we stop and remove your products from search.
You review bots
| Operator | Aleksei Alekseev, sole trader, United Kingdom · fitsrail.com |
|---|---|
| Purpose | Product search with links to the store (Search; Aggregator). Not price monitoring for another retailer. |
| Content use | Reference: index, excerpt and link back. Not training. |
| User-Agent | FitsRailBot/0.1 (+https://bot.fitsrail.com/bot) |
| robots.txt token | FitsRailBot (falls back to *) |
| Signature-Agent | "https://bot.fitsrail.com" |
| Key directory | /.well-known/http-message-signatures-directory |
| Key id | SCHupUDQZg51QgYOiLyVOHCY4719E6YuWUriC0FxnEw (Ed25519) |
| Rate per store | 1 connection, ≥ 1 s apart: ≤ 60 req/min, ≤ 18,000 req/day; Crawl-delay raises the gap |
| Schedule | 01:00–06:00 UK, weekly refresh |
| On 429 / 503 | Honours Retry-After, backs off |
| On 403 / 430 / challenge | Stops the store's crawl for human review; no IP or identity rotation |
| Data use | Used only for FitsRail's product search, with a link to your store. We never sell it, pass it on, or let anyone else train AI models on it. |
| IP addresses | Not published (requests are signed) |
| Contact | [email protected] |