Home Resources Forum Advertise Contact

Go Back   Webmaster Forums > Internet Marketing, Business Online and E-Commerce > SEO Talk > Google Search Engine Optimization

Google Search Engine Optimization Let's talk about the many ways possible to get your website at the top of Google Search Engine. Share your thoughts about Google Search Engine Optimization here.

Reply
 
LinkBack Thread Tools
  #1 (permalink)  
Old 21st June 2006, 04:23 AM
dizyn1 dizyn1 is offline
WD Newbie
 
Join Date: 21st June 2006
Posts: 20
Send a message via MSN to dizyn1
Default Google ignores the meta robots noindex tag.

How many people have noticed the many thousands of Supplemental pages with a 2005 June or July cache date that have been indexed, show in the SERPs with a full title and description, rank, and have a <meta name="robots" content="noindex"> tag both on the live page and in the old cached copy linked from the SERPs.

Oh yeah! There are thousands of them. Now that is a programming bug.

Obviously when you place the <meta name="robots" content="noindex"> tag on a page, you expect that the page will be spidered, but not indexed. But if Google keeps no data about that URL, they will never "remember" anything about that URL, and will return every few minutes to "discover" the content, again and again.

However, when you think about it, Google must keep a copy of that page internally so that they can tell when the content has changed, and so that they know where that page links to, and so that they know the index/noindex status of the page.

Such a page should never appear in search results, ever. Well, now they do, and in very large numbers; all (so far) marked as Supplemental Results, and with cache dates from a year ago.

It appears that something in their system is forgetting to check the index/noindex status of the pages in their database and is showing them all in the SERPs whatever their status.

I first noticed this yesterday; but found it on some searches that I have not done for several months. I have no idea how long this bug has been showing up... it could be several months.
Reply With Quote
Reply



Thread Tools

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

vB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Trackbacks are On
Pingbacks are On
Refbacks are On

Similar Threads
Thread Thread Starter Forum Replies Last Post
Optimizing the meta tags arpan911 Yahoo! Search Engine Optimization 1 19th May 2007 06:52 AM
Meta tags hassen1 It's all about E-Business 1 3rd May 2007 01:28 PM
Explain robots.txt varun1182 Search Engine Spiders 5 3rd January 2007 08:45 PM
Supporting wildcards in robots.txt hassen1 Yahoo! News 1 18th November 2006 12:06 AM
Code for meta crawler! tino2099 Link Development 3 15th November 2006 09:57 PM


All times are GMT -4. The time now is 08:20 AM.


Powered by vBulletin
Copyright ©2000 - 2008, Jelsoft Enterprises Ltd.
Search Engine Optimization by vBSEO 3.0.0 RC6
vB Ad Management by =RedTyger=