The Spiders tab in the CMS Statistics area shows the list of spiders that have accessed your site. A spider, or web crawler, is an internet bot that systematically browses thw World Wide Web, typically for the purpose of Web indexing.
Here is an explanation of the stats listed for each spider:
- Hits: This is the number of hits that have been made by that spider this month. This is not the page count. For example, if a visitor goes to your main page, all images, as well as the files that make up the page itself would generate 1 hit each.
The next column to the right is the % (percentage) column. This shows you the percentage of hits for the month from that specific spider.
- Bandwidth: This is how much bandwidth is used by that specific spider during this month.
The next column to the right is the % (percentage) column. This shows you the percentage of bandwidth usage for the month that has been used by that specific spider.
- Last Visit: This shows the date and time that the spider last visited your site.
- Robots.txt: This is the number of times that the spider has accessed the Robots.txt file. This file is that is put in your root directory during development that provides crawling instructions to those spiders that access it. The robots.txt file tells the spider what pages or directories to ignore.
|Previous: Referrers Tab||Visitor Statistics Directory||Next: Searches Tab|