|
|
|||||||
| Search Engine Spiders Exchange ideas and opinions about search engine spiders here. Discuss about identifying search engine spiders' spidering habits and make it to your advantage here. |
 |
|
|
LinkBack | Thread Tools |
29th January 2007, 01:58 AM
|
|||
|
|||
Not all spiders are good
Who actually owns these spiders? It's good to know the beneficial from the bad. Some agents are generated by software such as Teleport Pro, an application that allows people to download a full "mirror" of your site onto their hard drives for viewing later on, or sometimes for more insidious purposes such as plagiarism. If you have a large or image heavy site, the practice of web site stripping could also have a serious impact on your bandwidth usage each month.
|
|
«
Previous Thread
|
Next Thread
»
| Thread Tools | |
|
|
Similar Threads
|
||||
| Thread | Thread Starter | Forum | Replies | Last Post |
| How do spiders work? | cloud9925 | Search Engine Spiders | 8 | 21st July 2008 08:23 AM |
| How to set up a robots.txt to control search engine spiders | arpan911 | Search Engine Spiders | 3 | 20th June 2008 06:56 PM |
| What are search engine spiders? | astros99 | Search Engine Spiders | 4 | 7th June 2007 10:05 PM |
| Spiders explained | hassen1 | Search Engine Spiders | 0 | 1st November 2006 07:42 PM |
| Search engine spiders list | arpan911 | Search Engine Spiders | 2 | 19th September 2006 05:55 AM |
All times are GMT -4. The time now is 04:24 AM.
