Home Resources Forum Advertise Contact

Go Back   Webmaster Forums > Search Engines > Search Engine Spiders

Search Engine Spiders Exchange ideas and opinions about search engine spiders here. Discuss about identifying search engine spiders' spidering habits and make it to your advantage here.

Reply
 
LinkBack Thread Tools
  #1 (permalink)  
Old 29th January 2007, 02:20 AM
hassen1 hassen1 is offline
WD Addict Poster
 
Join Date: 29th October 2006
Posts: 2,603
Send a message via Yahoo to hassen1
Default Searching by Means of Search Engines

This is where things start to get complicated.
Search engines are trickier than they look! You'll discover this the first time you enter a query on C++, the programming language. At least of the Web search engines will essentially say, "Huh?"

C++ is not a word. It's a letter followed by two characters that might, depending on the index, be regarded merely as punctuation. Many text search engines have trouble handling input of this type. Many don't deal too well with numbers, either. So much for "007," "R2D2,"or "Catch-22."

Important Note: This problem is no longer as bad as it used to be. I'm now finding relevant hits for C++ on a majority of search engines sites.

Here's another example of a text string search engines hate: To be or not to be. Just about anyone who finished junior high school will be able to tell you where the phrase comes from and (possibly!) what it means. But some search engines choke because all the words in the phrase are stop words--i.e., unimportant words too short and too common to be considered relevant strings on which to search. However, if you enclose the query in quotation marks, forcing the search engine to find the words, "to be or not to be" in that precise order, most search engines can recognize the phrase as a famous quotation from Hamlet.

Let's take a less obvious example. Suppose you're a fan of murder mysteries and you want to search the Web for the home pages of all your favorite authors in that genre. If you simply enter the words "mystery" and "writer," most search engines will return hyperlinks to all Web documents that contain the word "mystery" or the word, "writer." This will probably include hundreds--or even thousands--of URLs, most of which will have no relevance to your search. If you enter the words as a phrase, however, you stand a better chance of getting some good hits.

However, as search technology advances, this is not as much of a problem as it was a couple of years ago. Many search engines will now automatically apply the "adjacency" operator when responding to a two-word query. This means that they will indeed look for documents in which your two words appear next to each other.
If you understand how search engines organize information and run queries, you can maximize your chances of getting hits on URLs that matter.
Reply With Quote
Reply



Thread Tools

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

vB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Trackbacks are On
Pingbacks are On
Refbacks are On

Similar Threads
Thread Thread Starter Forum Replies Last Post
Why we use various search engines arpan911 SEO Talk 1 13th May 2007 02:28 PM
The most popular search engines varun1182 SEO Talk 10 13th May 2007 10:55 AM
Ppc search engines varun1182 Pay Per Click / PPC Engines 9 16th March 2007 05:31 AM
Searching by Means of Subject Directories hassen1 Search Engine Spiders 0 29th January 2007 02:18 AM
Search engines hassen1 Marketing and advertising on the web 0 10th November 2006 04:03 AM


All times are GMT -4. The time now is 07:03 AM.


Powered by vBulletin
Copyright ©2000 - 2008, Jelsoft Enterprises Ltd.
Search Engine Optimization by vBSEO 3.0.0 RC6
vB Ad Management by =RedTyger=