MACROMEDIA COLFUSION MX 7 - INSTALLING AND USING COLDFUSION..., Manual

Page: 124 / 170

124 Chapter 9: Indexing Collections with Verity Spider
Example
The following is a URL without parameters:
http://server.com/cgi-bin/program?
If you include parameters in the URL to be indexed, as specified with the
-start
option, those
parameters are processed and any resulting pages are indexed and parsed.
By default, a URL with a question mark (?) is skipped.
-domain
Type : Web crawling only
Syntax :
-domain name_1 [name_n] ...
Limits indexing to the specified domain(s). You must use only complete text strings for domains.
You cannot use wildcard expressions. URLs not in the specified domain(s) are not downloaded or
parsed.
You can list multiple domains by separating each one with a single space.
Note: You must have the appropriate Verity Spider licensing capability to use this option. The Verity
Spider that is included with ColdFusion MX is licensed for websites that are defined and reside on the
same machine on which ColdFusion MX is installed. Contact Verity Sales for licensing options
regarding the use of Verity Spider for external websites.
-followdup
Specifies that Verity Spider follows links within duplicate documents, although only the first
instance of any duplicate documents is indexed.
You might find this option useful if you use the same home page on multiple sites. By default,
only the first instance of the document is indexed, while subsequent instances are skipped. If you
have different secondary documents on the different sites, using the
-followdup
option lets you
get to them for indexing, while still indexing the common home page only once.
-followsymlink
Type : File system only
Specifies that Verity Spider follows symbolic links when indexing UNIX file systems.
-host
Type : Web crawling only
Syntax :
-host name_1 [name_n] ...
Limits indexing to the specified host or hosts. You must use only complete text strings for hosts.
You cannot use wildcard expressions.
You can list multiple hosts by separating each one with a single space. URLs not on the specified
host(s) are not downloaded or parsed.