CheapestFirstBot

CheapestFirstBot is the crawler behind cheapest first. Once a day it reads public product listings (title, price, sizes, stock, fabric and the photo's address) so we can list them by price, with a link back to your store.

How it identifies itself

CheapestFirstBot/1.0 (+https://cheapestfirst.com/bot)

How it behaves

• It reads robots.txt first and obeys it, including Crawl-delay.
• It keeps to about one request per second per site. Shopify stores share one slower limit between them.
• On Shopify stores it reads the public /products.json feed. Elsewhere it follows your sitemaps and reads the product data (schema.org JSON-LD) on product pages.
• If you block it, it stops. It never switches to a browser user-agent, a headless browser, proxies or any other workaround.

How to block it

Add this to your robots.txt:

User-agent: CheapestFirstBot
Disallow: /

Or email hello@theresetseries.com and we'll take your store off the site.