Search Engine Optimization, Website Development and Search Engine Spiders - Implementing a 301 Redirect

(Page 3 of 5 )

The 301 redirect is a friendly way to point search engines and visitors to the pages you want them to see. The 301 redirect passes link power from the old address to the new one.

Only for Apache Server:

To implement a 301 redirect you need to put an .htaccess file in the root directory where all the pages are stored. If you don't have an .htaccess file yet, you can create one using notepad.

Put the following in the .htaccess file:

redirect 301 /old/old.htm http://www.newsite.com/new.html	Redirects a single page or a site directory to a new location.
redirect 301 / http://www.site.com/	Redirects an old site to a new domain, passing link power from the old domain.
RewriteEngine on RewriteCond %{HTTP_HOST} ^site.com [NC] RewriteRule (.*) http://www.site.com/$1 [L,R=301]	Redirects site.com to www.site.com

If you're redirecting an old domain to a new one, make sure to keep renewing the old domain. If the domain expires, all links pointing to the old domain will lose their value for your new domain. Renewals are very cheap, but it may cost several grand and a load of time to get back previous link juice.

Search Engine Spiders

You can see the spiders that have visited your pages by looking at the log file. This list will help you identify who's who in the spider world.

Google Spiders

Google Search

googlebot

Microsoft Spiders

MSN Search	msnbot/x.xx MSNBOT/0.xx
MSN Media Search	msnbot-media/1.0
Windows Live Product Search	msnbot-Products/1.0
Microsoft Mobile Search	MSNBOT_Mobile MSMOBOT Mozilla/2.0

Yahoo Spiders

Yahoo Search	SLURP
Yahoo Blog Search	Yahoo-Blogs/v3.9
Yahoo Multimedia Search	Yahoo-MMAudVid/1.0
Yahoo Product Search	YahooSeeker/1.0 YahooSeeker/1.1

Ask.com Spiders

Ask Search

Teoma MP

Alexa

Alexa / The Internet Archive

ia_archiver ia_archiver-web.archive.org ia_archiver/1.6

Look for those robot names in your log files. You can learn more robot names on this website: http://www.user-agents.org/

Next: Robot TXT Use >>
 

More Search Optimization Articles
More By Ivan Strouchliak

Comments On: Search Engine Optimization, Website Development and Search Engine Spiders

· Acquirelists marketing and sales department invested a lot of resources in writing...   >>> Post your comment now!