For website owners
TajiPriceCheck
TajiPriceCheck is the price checker of Taji, a billing platform for web hosts. It reads public price pages for a host that sells services like yours, so that host can compare its prices with the prices you publish.
It names itself in every request
TajiPriceCheck/1.0 (+https://gettaji.com/bot)How to stop it
Add these two lines to the robots.txt at the root of your site:
User-agent: TajiPriceCheck Disallow: /
- Capital letters do not matter: tajipricecheck works too.
- Keep the two lines together, with no other User-agent line between them.
- To keep it out of one page only, put that page's path after Disallow, for example
Disallow: /pricing. - If no group names TajiPriceCheck, it obeys your
User-agent: *rules. - It reads robots.txt again at every check. If robots.txt cannot be read, it reads the page as if there were no rules.
Questions
Write to help@gettaji.com. Say which site, and what you saw.
How often it visits
- Only when a host asks for a check, or once a week if the host turns that on.
- Only the pages the host added: up to 5 pages for each company.
- One page at a time, with at least 5 seconds between pages on the same site.
- It gives up on a page after 20 seconds or 2 MB.
What it reads and keeps
- It reads your robots.txt first, and obeys it.
- An AI model reads the text of the page to find the prices on it.
- It keeps the prices it finds, and up to 200 characters of the words each price was written in. It does not keep the page.
What it never does
- It never signs in, and never sends cookies.
- It never fills in or sends a form.
- It never reads a page your robots.txt disallows.
- It leaves a sign-in page, or a page with a password field, unread.
- It never visits a private or internal address.
- It does not look for or keep personal data.