Set up in minutes
Paste a URL and it learns your whole site.
The crawler reads your site, strips the nav and footer, and imports clean chunks into the knowledge base. It re-crawls on a schedule so answers stay current.
Live demo
Just paste a URL
It crawls same-site pages and imports clean, readable text.
Strips the noise
Navigation, footers and boilerplate are removed so answers stay sharp.
Stays fresh
Optional weekly re-crawl, and it respects your robots.txt.
Questions about this
How much of my site does it read?
Up to 150 pages on Starter and 500 on Pro, 1,500 on Scale. You can point it at one section instead of the whole domain when only part of it is relevant.
Does it strip the menu and the footer?
Yes, the crawler keeps the body text of a page and drops the repeating navigation, so the same footer does not end up in every source.
How often does it check for changes?
You set an interval per source, or press re-index yourself. Only the changed pages are rewritten, so a refresh costs seconds instead of a full crawl.
Ready when you are
Put this to work on your own store
Train it on your content in minutes, add one snippet, and let it handle this for your customers 24/7.
Explore more