• How do search engines work?
• Directories - a whole different ball game
• Hybrid search engines:  The new generation
• What search engines don't like
• Frames and others
• Problem with dynamic generated sites
• Search Engine Ranking factors
• page-related ranking factors
• Title Tag
• Using the Meta Description tag
• Using the Meta Keywords tag
• Using ALT tags
• Using Comment tags
• Keywords in the URL name
• Search engines and themes
• Link Popularity
• Site Popularity
• Final Checklist
• What are doorway pages?
• Analyzing your competition

Question: How do Search Engines Work?

Answer: Search engines help people find relevant information on the Internet.

Major search engines have huge databases of web sites that surfers can search by typing in some text.  Search engines send out spiders or robots, which follow links from web sites and index all pages they come across.  Each search engine has its own formula for indexing pages; some index the whole site, while others index only the main page. Search engines decide the amount of weight that will be placed on various factors that influence results.

Some want link popularity to be the most important criterion, while others prefer meta tags.  Search engines use a combination of factors to devise their formulas

Question: Directories – a whole different ball game.

Answer: Often confused with search engines, directories are completely different.

Unlike search engines, directories use "human indexing;" people review and index links.
Directories have rigid guidelines that sites must meet before being added to their index.
Therefore, they have a smaller, but cleaner index.Yahoo!, LookSmart, MSN, Go and others are directories.
Factors that influence search engine rankings are irrelevant to directory rankings.

Since people review sites, more attention is placed on the quality of a site: its functionality, content and design.  Directories strive to categorize sites accurately and often correct categories suggested by a site's webmaster.

Question:  Hybrid search engines: The new generation

Answer:

Hybrid search engines combine a directory and a search engine to give their visitors the most relevant and complete results.

The Top 10 search engines/directories today are hybrid. Yahoo!, for example, is a directory, which uses results from Google (a search engine) for its secondary results

Question: What search engines don't like.

Answer:

Search engines now know of the following techniques and define it as "spam". Currently, sites that use invisible text are banned from most of the major search engines.

The following techniques are spam:

Meta refresh tags
Invisible text and overuse of tiny text
Irrelevant keywords in the title and meta tags
Excessive repetition of keywords
Overuse of mirror sites (same sites that point to different URLs)
Submitting too many pages in one day
Identical or nearly identical pages
Submitting to an inappropriate category (for directories)

Question:  Problem with dynamic generated sites

Answer:

Web Sites with Dynamic created pages also block Web crawlers. While it's great to give visitors unique experiences, tailored to their needs, the techniques you use to do that could stop search engines from indexing your content and hence could greatly reduce your potential traffic. Dynamically generated pages are created on the fly from a variety of elements held in databases. Typically such pages have a question mark (?) in the URL (or not). When a search engine crawler arrives at such a page, it captures the content but halts immediately, and will not follow the links, because it sees ahead of it an infinite number of pages -- a black hole that would bring it to a crash. !!!!!

Suggestion create a static index page and add in the Metatag a robots tag with following text * Index, not follow *
There some technical solution from the server side to get your dynamic web sites in to the search engines.

Question: Search Engine Ranking factors

Answer:

Search engines are different
Every search engine has its own algorithm - a formula for indexing and scoring web sites. Search engines attempt to give their visitors most relevant results by constantly improving their formulas. They analyze page elements and other factors to determine what combination is best for most appropriate results.

Search engines form partnerships and buy technologies to improve their algorithms. They combine many factors with a different weight placed on each one.

Question: Page Ranking Factors.

Answer: These factors include:

Title tag
Keyword frequency, weight, prominence and proximity
Meta tags
ALT tags
Comment tags
URL names
Alphabetical placement

Question: Title Tag

Answer:  What is an HTML Title and why should I use it?
HTML Title describes the contents of your web page in one sentence. This title is most likely to appear in search engines' results and in bookmarks. It is also the first thing that a spider sees on your page. Therefore, the title has dual importance since it will be seen by both people and search engines.

HTML Title looks like this: <Title>Your title here</Title>

It is the most important part of your page as far as search engines are concerned. Note that every search engine supports the Title tag. Here are a few tips on how to make you title tag more appealing to both search engines and people.
 
Add keywords to your title, never use only a company name ! Length of your title title is limited to about 75 characters.

Question:  Using the Meta Description Tag

Answer:

The meta description tag describes your site's content, giving the reader and the search engine an accurate summary filled with multiple keywords.

Meta tags are hidden in the document's source, invisible to the readers. Some search engines, however, are able to use meta tags as a part of their algorithm. Engines do not penalize those who use meta tags properly, so it's recommended that you always include them.
A meta description tag can boost your rankings on some engines.
Use it on all pages
Limit it to 150 characters
Should contain keywords
Keywords shouldn't repeat more than 7 times.

Question:  Using the Meta Keywords Tag

Answer:

A meta keyword tag summarizes all the keywords that you would like to be found under for search engines.
Meta tags are hidden in the document's source, invisible to the reader. Some search engines, however, do see and use them as a part of their algorithm. Engines do not penalize those who use meta tags properly, so it's recommended that you always include them on your pages
Avoid the use of spam
Avoid repeating keywords more than 3-7 times; you can get penalized for that. Repetitions up to 3 times are recommended, just don't place them one after the other.
Provides a list of keywords
Limit it to 1024 characters
List keywords in order of importance
Don't repeat the same keyword more than 7 times.

Question:  Using ALT Tags

Answer:

Since search engines don't index images, they can't index all the text that your web site has in image format. To fix this problem, there are ALT tags, which are basically images' descriptions.
ALT tags are an excellent way of dealing with images, but they're not the solution. Not all engines are capable of reading ALT tags. Engines such as Excite, Inktomi and Northern Light don't pay any attention to them. However, you will never be penalized for the use of ALT tags.
Avoiding the use of spam
Search engines do not penalize for ALT tags, or for a certain amount of keywords in ALT tags. There's a general rule of not repeating keywords more than 3-7 times. Although this rule is not specific to ALT tags, better safe than sorry.
Describe images
Add more keywords
Should be used for each image
Make site accessible to visually impaired
Keywords should not be repeated more than 7 times.

Question: Using Comment Tags

Answer:

Comment tags are not visible to the reader because they are hidden in the HTML code. They provide a way for the web master to make notes right on the page. Although the reader doesn't see these tags, some search engines, such as Inktomi, can index them.
Therefore, comment tags are another great way to add keywords to your page, thus increasing keyword frequency, an important factor in many ranking algorithms.
Avoid the use of spam
Search engines do not penalize for the use of comment tags. However, the general rule is not to repeat the same keyword more than 3-7 times. So, to be on the safe side, follow that rule in comment tags.
Place them on every single page
Add keywords to comment tags
Place them after meta tags in the head
Do not repeat keywords more than 7 times

Question:  Keywords in the URL Name

Answer:  What is a URL name?
The URL name is the name of the site, such as search engines. Although the whole URL would look like this:
http://www.searchengines.com, the part that the search engines are interested in is "search engines."
Recently, search engines started to use keywords in the URL as a part of their ranking formula. One of the search engines that uses it is Google. Google is extremely important because Yahoo! selected it as a provider of their non-directory search results. Google's ranking formula should receive more attention than ever because Yahoo! accounts for at much as 50% of traffic to many sites.
Name files with keywords
Consider alphabetical priority
Look for a URL name with keywords in it

Question:  Search engines and themes

Answer:  A theme is defined by search engines as a common topic throughout the site. In an effort to provide their users with more relevant information, search engines developed sophisticated technology that "extracts" site's themes. This technology allows results to be more focused on the topic searched for. Hint: Think of themes as your most important keywords.
Themes technology is quite complex. It's used by some of the major search engines when indexing and ranking sites. Currently, Excite, Altavista, Lycos and Google use themes as part of their formulas. Inktomi will soon join them. That will include AOL, Hotbot, iWon, LookSmart, MSN and NBCi.
The purpose of themes is to look at the bigger picture, not just the parts. To determine a theme spiders index the whole site and then analyze its HTML. Factors analyzed are: HTML title, meta tags, headings, text on the site, and links. Spiders use technologies such as keyword weighting, extrapolation and root stemming to determine a theme.
Excite, Altavista, Lycos and Google use them
Inktomi should be joining soon
Determined by keywords in title, meta tags, text and links.

Question:  Link popularity

Answer:  Link popularity is much more than a number of links that point to a site. Search engines have been able to come up with sophisticated formulas that go beyond numbers. Link popularity and the quality of links, are currently determined by the following three factors

Number of Links - The more, the better. Although having several irrelevant links is not as effective as relevant ones, it's better than nothing. Inktomi, a provider of search results to engines like Hotbot, still values the number of links more than anything else. Relevance - Search engines want links from pages that are relevant to your site. This can include your competition, supplier, or anyone else in the same category.

Google measures relevance through its Page Rank formula, along with other engines such as Hotbot and Altavista. This lets people, rather than meta tags, determine how high a page ranks. If a similar site links to you, they probably found your content to be interesting.

Link text - This refers to text used in a link, the text that people will click. For example:
SearchEngines.com or Search engine guide or Click here all link to the same place, but use different text. Obviously, the use of keywords in the description of a link is beneficia

Question: Site Popularity

Answer:

Any web master trying to achieve top search engine placement has to be familiar with DirectHit technology. DirectHit is currently used by over 25 engines including: Lycos, Infoseek, Hotbot, MSN, Infospace and About.com. DirectHit technology, which measures click popularity and stickiness, claims to let users, rather than engines and editors, organize search results
What is click popularity and stickiness?
Click popularity and stickiness are two factors used in DirectHit's ranking formula. Click popularity measures the number of clicks every site in the search engine results page receives. Let's say that 20 people search for "puppy food." If all of them click on the same page, DirectHit assumes that the page has more relevance and it will be scored higher next time.
Stickiness measures the amount of time that a user stays on a site. This is measured by the time between clicks on the results page.
Measures click popularity and stickiness
Ranks clicks for low scoring sites higher
Allows people to participate in ranking pages
Can be spammed.

Question:  Final Checklist

Answer:

My pages are ready!
You've been hard at work optimizing your pages. You learned all there is to know about search engine ranking formulas.

Use this checklist to see if all of your pages are optimized:
Checklist for optimization

HTML Title - Your title contains properly placed keywords - Meta tags
Use the meta description and keyword tags on every page
Keyword prominence, density, proximity, frequency
Few of the most important elements
Keywords in the URL or file names - Name your files with keywords
Alt tags - Search engines don't index images - Link popularity
Most search engines use it as a factor - Themes
One of the latest technologies that search engines use – Design.

Question:  What are doorway pages?

Answer:

Doorway pages are specially optimized pages for one search engine and 1-3 keywords. They are also known as gateway, bridge, entry, jump and supplemental pages. Companies use doorway pages to achieve higher search engine rankings by giving each search engine what it wants.
Doorway pages stand on their own, separate from the rest of the site. These pages usually feature a logo, some text and a link that asks visitors to enter for more information.
Importance of doorway pages:
Doorway pages provide web masters with an opportunity to rank high for any keyword, with any search engine. If a site contains dynamic content, frames, multimedia files or large graphics, doorway pages are a must. Never use doorway pages for Directories, which use humans to review web sites, don't enjoy doorway pages. You risk being blacklisted by submitting a doorway page to a directory. Since people don't need to see your HTML, its optimization is unnecessary. Can help rank high for any keyword in any engine - optimize for one keyword, one engine
Don't create them for directories  - Learn what search engines want - Don't spam.

Question:  Analyzing your competition

Answer:

What should I analyze?
Same page? - Do you and the search engine see the same page? There are some techniques that will make a search engine index and rank a different page. Here's how to spot this:
Look at the title - Is it the same as it appears in the results?
Why was the page ranked high? - If you can't figure out why a page ranks high, consider the possibility of it being a different page.
Use Google - Take advantage of Google's cache feature, which stores the page indexed by their spider. Look to see if it's the same as the page you see.
Is it a doorway page ? - Is it a page with few images that has a link? Does it look like it doesn't belong to the rest of the site? This may be a specially optimized doorway page, which focuses on the requirements for a specific engine and has a link to the site
HTML code - Analyze for all the elements you have learned about, including: HTML title, meta tags, ALT tags, keyword frequency and weight. See how many characters each one of the elements has, how keywords are placed in relationship to each other, etc