Mar 24
Search Engine Spiders Explained…
When a web site is submitted to a search engine, a piece of scanning software called a spider, is used to read all the web pages of a website. The spider uses the menu hyperlinks, the links to other pages, to find each web page. This scan will index all the text and readable information you present to the internet world. Once it is completed, the information collected is added to an enormous database of that search engine. So when someone enters that search engine and types a particular query, they will be able to locate web sites offering that information.
Each Search Engine has it’s own “spider”. The spider is made up of code that works differently for each search engine, but many of the search engine spiders have similar rules when scanning a web site.
The main rule is the web page code, called html, should be error free. (Yes, I read that recent article about Google and poorly coded web sites rankings, but I still think the code needs to be clean. I bet they will fix that in another update) So nothing can impede the spider software. One of the problems I seem to run into are the menu systems. Some website menu designs do not allow search engine spiders to follow the menu system, so the search engine will not index your website. It will only index the first page with whatever content is on it.
There are several ways to correct this.
- You can change the menu system to a text based, CSS type of menu system
- You can add a text menu to the bottom of the web page as a second menu system
- You can update the code to the latest version that has been tested to be search engine friendly
There are other techniques to help optimize the web page.
- for images - No Search Engine will understand the content of an image except for it’s text name. So to get the search engines to understand what the image represents use “alt tags” which are the text equivalent of the image. This will also help those with vision impairments understand your web page.
- To work around some of the code issues - we can create a sitemap off the main page that will let the spiders search all the web pages for information.
- There are also some no-no’s like any text on the web page that is the same or close to same color as the background. The text looks hidden or almost hidden. The search engine will penalize you for those types of techniques.
- Another recent non-no is using hidden text in the CSS files. There are plenty of thing that can now effect your web page ranking. The best thing to do is stick with the traditional techniques - Titles, Descriptions, Metatags (although meta tags are not that useful - I still recommend them) and of course loads of good content!
There are many techniques used to “help” the spiders locate the correct information. You can contact us to help you with your website marketing.
-= Smitty =-
