ht://Dig is a search engine well suited to intranets. It scours web pages, acting as a web browser, cataloging and indexing the pages it sees. It is able to index regular HTML pages as well as MS Office documents and PDFs with the use of external parsers.

I have completed numerous installations of ht://Dig including installations using the external parsers mentioned above. I have also integrated the search functions in to an intranet home page (rather than using the default ht://Dig search page) providing integrated searching restricted to certain areas/document trees, as well as giving the option to search the entire site.