How do I keep my page from being indexed?
Two options to exclude pages from the VCU Search Engine are:
Exclude a single page
In each HTML file you want to exclude, add the following between the <HEAD> and </HEAD> tags:
<META NAME="robots" CONTENT="noindex, follow">
Doing so will allow HtDig to still follow links to other documents, but will prevent this document from being put into the index itself.
Exclude a single page and all links off of that page:
If you don't want htdig to follow your links from that page then insert this line of code:
<META NAME="robots" CONTENT="noindex, nofollow">
This will prevent the linked pages from being indexed as well as that page.
(See HtDig's information on Recognized META information for more details.)
