How to Set Up Webalizer to Ignore Spiders
- 1). Open the "webalizer.conf" file in a text editor. This is usually located in the "etc" directory on your system.
- 2). Add the text "IgnoreAgent" followed by the name of the user agent you wish to ignore in the generated statistics. For example, the spider for Google is known as "Googlebot," so type "IgnoreAgent GoogleBot." Bing uses "bingbot," while Yahoo uses "yahoo."
- 3). Save the text file and restart Webalizer if it is running.
Source...