FindMeStockBot

FindMeStockBot checks whether products are in stock at UK retailers, and at what price, so FindMeStock users can be told when something they want comes back. It identifies itself as FindMeStockBot/1.0 (+https://findmestock.com/bot).

What it fetches

Only product pages, the stock and price data those pages load, and search result pages for products our users track. It doesn't create accounts, add to baskets, buy anything or submit forms.

How it behaves

• It obeys robots.txt. Rules for FindMeStockBot apply first, then those for *, and it honours Crawl-delay.
• It keeps to a low, fixed request rate for each retailer, shared across all our servers.
• On a 429 it waits as long as Retry-After asks. When a site blocks it, it stops and backs off. It never rotates IP addresses, disguises itself as a browser or solves captchas.

Stopping it

To stop it visiting your site, add this to your robots.txt:

User-agent: FindMeStockBot
Disallow: /

Contact

If the bot is causing a problem, or you'd rather we used an official feed or API, email [email protected]. We read every message and will slow down or stop straight away.