Skip to content
Doublewire Help

Link and delete a Website Crawler

Section titled “Link to an assistant”

Open the assistant, find Website Crawlers under Knowledge, select the crawler, and save. A linked assistant can search Ready pages alongside linked Knowledge Base documents.

Unlinking a crawler from one assistant does not delete the crawler or affect other assistants.

Delete permanently

Section titled “Delete permanently”

From the crawler list, open the row menu, select Delete, and confirm. Deletion permanently removes the crawler’s pages and searchable content, and disconnects it from assistants.

Use page exclusion when only one URL should stop participating. Delete the entire crawler only when the whole website source is no longer needed.