Home Resources Forum Advertise Contact

Go Back   Webmaster Forums > Search Engines > Search Engine Spiders

Search Engine Spiders Exchange ideas and opinions about search engine spiders here. Discuss about identifying search engine spiders' spidering habits and make it to your advantage here.

Reply
 
LinkBack Thread Tools
  #1 (permalink)  
Old 24th March 2007, 08:03 AM
w3bmaster's Avatar
w3bmaster w3bmaster is offline
WD Addict Poster
 
Join Date: 20th March 2007
Posts: 107
Default Spider Friendly Pages

Spider Friendly Pages

First off what is spider friendly navigation? Basically it is how easily search engines can read your website. This ultimately depends on the search engine that is reading your site. Some have the patience to dig deep into your site and promise to follow every link. Others may get bored before they finish indexing a whole page. Carefully organize your page content and Web site to ensure that spiders index the whole thing - not just bits and pieces. Here are some tips that will help you to do this:
Use Keywords/phrases that best describe the target page.
Avoid using image maps, if needed make sure to add text links at the bottom of all pages.
Do not use long text; limit 40-50 characters in a text link
Avoid using JavaScript links
Create text links and use a common navigational menu for all pages
For best results try to limit the number of links per page to 20. (Only a recommendation)
Include a site map if you have more than 20 pages.
If you are using flash navigation, always have text links as a supplement to the flash
Try to use keyword phrases in the HTML and image file names
Keep your file names hyphenated (e.g. use this-page.html instead of thispage.html)
General Tips and Tricks
Make sure your website is completely finished, spell checked, online and all links are working before submitting to Search Engines'.
Try to include .robots.txt. to prevent spiders from crawling certain directories. (For more info, visit robotstxt.org)
If the site was designed in something other than HTML, make sure there is some static content for the spider to read.
Try and get on DMOZ if you are not already there.
Read each search engines. guidelines and follow them closely.
Use meta tags in all places
For getting proper keywords that are commonly used visit:
a) Keyword services for professional search engine optimization
b) http://inventory.goto.com/searchinventory/suggestion/
c) https://adwords.google.com/select/m...=KeywordSandbox
For checking keyword density use the following sites:
a) Keyword Density Analyzer tool for search engine optimization and internet marketing experts
b) Ranks.nl SEO Consultancy and Web site Promotion Tools
When using frames, make sure to include keyword rich content between the <noframe> </noframe> tags, on the main frameset page.
Keep all content in root directory if possible.
Make sure your home page can load within 8-10 seconds on a 56k modem
Try to use CSS data as an external file and call it using <link> tag
Optimize your images and keep the page size low
Update your more important pages at a regular interval
Check your site for broken links periodically

Things to Avoid



Here are some things to avoid when creating your website:
Avoid strange color combinations, as this can make it hard to read for a viewer
Text that is too small to read will also cause the reader to leave
Unrelated Advertisements will distract viewers
Hidden text, which is text the same color as the background
Submitting your site to FFA sites
Duplicate pages, doorway pages and cloaked pages
Re-direction from the homepage to another
Automated submission to search engines
Submitting to search engines more than once a month
Use of <meta refresh> tag in HTML page header
Using trademarks or company names other than yours in Meta tags.
Instance of 5 or 6 keywords being repeated in one row

Summary

Search engine optimization is the process of Internet marketing and is the most cost-effective means of marketing to your target visitors. 90 percent of the web users are turning to search engines to search information online, so it is very crucial that your website rank within the top 20 results if you want to be found. A successful search engine optimization will bring qualified customers and prospects to your website. So if after several months of your website's position on the search engines result page has not improved, you might want to consider the services of a professional website optimization and search engine placement expert.
Reply With Quote
  #2 (permalink)  
Old 30th March 2007, 06:28 AM
samkhan's Avatar
samkhan samkhan is offline
WD Frequent Poster
 
Join Date: 16th February 2007
Posts: 63
Default Ses

you can also use robot.txt file to facilitate spiders for crawling your site.

This is best way by which you can invite Search Engine Spiders.

__________________
US FastFacts | Unlimited Jokes
Reply With Quote
  #3 (permalink)  
Old 8th May 2007, 02:05 PM
mini_0's Avatar
mini_0 mini_0 is offline
WD Addict Poster
 
Join Date: 10th March 2007
Posts: 1,799
Default

I think more than spider friendly , one should try and make the page user friendly . But because most of the people are making money through their websites by advertising like adsense etc . they go for spider friendly pages which helps them to get a traffic eventually converting ino good money . Many spiders are built to parse the HTML on your page. One of the things that may confuse a parser or cause it to work harder is improper nesting of HTML elements on a page.So you can use a readble html code that can be understood by anyone , which will make your page spider friendly too .
Reply With Quote
  #4 (permalink)  
Old 26th June 2008, 01:02 AM
weiwei weiwei is offline
WD Addict Poster
 
Join Date: 29th May 2008
Posts: 496
Smile But a spirit prevailed

But a spirit prevailed then which wow gold was quintessentially are a challenge,not a alibi , that men are measured wow power leveling not only wow power leveling by their success wow powerleveling but also World of Warcraft gold by their striving; that it is better to aim grandly than to wallow in mediocre comfort. weiwei1978123
Reply With Quote
Reply



Thread Tools

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

vB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Trackbacks are On
Pingbacks are On
Refbacks are On

Similar Threads
Thread Thread Starter Forum Replies Last Post
Create a Search Engine friendly website eyesontech SEO Talk 2 2nd May 2007 02:53 PM
Search engine spider identification hassen1 Search Engine Spiders 0 29th January 2007 02:03 AM
Search engine spider simulator hassen1 Web Resource Centre 0 3rd December 2006 08:32 AM
Developing a user friendly website arpan911 Web Design and Development 0 28th July 2006 06:44 PM
Is your web site spider-friendly? arpan911 Search Engine Spiders 0 20th July 2006 03:11 PM


All times are GMT -4. The time now is 12:12 PM.


Powered by vBulletin
Copyright ©2000 - 2008, Jelsoft Enterprises Ltd.
Search Engine Optimization by vBSEO 3.0.0 RC6
vB Ad Management by =RedTyger=