agenticcrawl.ca

Terms

The notice in the site footer is a summary. These are the terms it summarizes, and they govern. They cover agenticcrawl.ca, demo.agenticcrawl.ca and the results they publish.

No warranty

The site, its demo and its published results are provided as is, for research and demonstration only. No warranty of any kind, express or implied, including without limitation any warranty of merchantability, fitness for a particular purpose, accuracy, availability or non-infringement. No claim is made that they are complete, correct, reliable or continuously available, and they may change or be withdrawn without notice.

Not for production decisions

Every result on the site and in the demo comes from recorded crawls of a generated test corpus served on one machine, with its setup stated beside it. Nothing on this site is a tool validated for production operations, and the published results describe those runs, not the behavior of any crawl of other sites or the fitness of any system.

The test corpus

The sites, shops, journals, forums, libraries, companies, people and products shown in the demo are invented by a generator. Any resemblance to real ones is coincidental. No real website was crawled to produce the results on this site.

Affiliation

Agentic Crawl is an independent technical project by Alexander Chernov, unaffiliated with the author’s employer. Nothing on this site represents the employer’s views.

Liability

Use is entirely at your own risk. To the fullest extent permitted by law, the author accepts no liability or responsibility for any loss or damage whatsoever arising from the use of this site, its demo or its results.

Third-party names

Product and project names mentioned on the site, including Ollama and nomic-embed-text, belong to their owners, and their mention implies no affiliation or endorsement. GPTBot, ClaudeBot and CCBot are the names of other crawlers, used in the test corpus’s robots.txt files.

Copyright

Maintainer: Alexander Chernov · ORCID 0009-0007-3198-2712 · Contact · LinkedIn