CrawlerThreads defines the number of
crawling threads to start by default,
when the -N command line option is not given to indexer.
More threads usually give better crawling speed
(especially when working with remote sites),
but consumes more CPU time and loads the database higher.
The default value is 1.