<?xml version="1.0" encoding="iso-8859-1"?><rss version="2.0" xmlns:atom="http://www.w3.org/2005/Atom"
	xmlns:dc="http://purl.org/dc/elements/1.1/"
	xmlns:content="http://purl.org/rss/1.0/modules/content/">

<channel>
<title>Search Engine Spiders Help - Search Engine Optimization Tutorials</title>
<link>http://www.seochat.com</link>
<!-- PubSubHubbub Discovery -->
<link rel="hub"  href="http://devshednet.superfeedr.com/" xmlns="http://www.w3.org/2005/Atom" />
<link rel="self" href="http://www.seochat.com/rss-feeds-5.xml" xmlns="http://www.w3.org/2005/Atom" />
<!-- End Of PubSubHubbub Discovery -->
<atom:link href="http://www.seochat.com/rss-feeds-5.xml" rel="self"/>
<description>Search Engine Spiders Help Tutorials at SEO Chat.  SEO Chat is all about the latest trends, techniques and how-tos for SEO, Link Building, Google Search Optimization and Online Marketing/SEM.</description>
<language>en-us</language>
<lastBuildDate>Fri, 25 May 2012 18:21:01 -0400</lastBuildDate>
<pubDate>Fri, 25 May 2012 18:21:01 -0400</pubDate>
<item><title>Search Engine Spiders: Why Don`t They Crawl My Site?</title>
<pubDate>Mon, 08 Nov 2010 09:00:13 -0500</pubDate>
<link>http://www.seochat.com/c/a/Search-Engine-Spiders-Help/Search-Engine-Spiders-Why-Dont-They-Crawl-My-Site/</link>
		<description><![CDATA[So you have designed your site, created fresh content, checked off your search engine optimization checklist, and all bases seem to be covered. Yet when you check to see if your pages have actually made it into the search engines, you notice a few pages (or worse -- all pages) are not there yet. Where did you go wrong? Never fear; this article will show you five common mistakes you can make when optimizing your site that might make spiders avoid it.]]></description>
		<content:encoded><![CDATA[ Below is a list of five reasons search engine spiders may not crawl your site:    Flash or Java Links   robots.txt   Too Many Link on One Page   Links in Forms   Links in frames Flash or Java Links While Google assures us that Flash is becoming more crawlable, for the time being, you will probably want to avoid relying on embedding links in Flash. If you do it, be sure to have a link outside of Flash on the page as well. The same goes for Java, Silverlight, and any other type of plug-in. Robots.txt I wrote an article a while back concerning the uses of robots.txt that may be helpful to check ...]]></content:encoded>
<category>Search Engine Spiders Help</category>
<guid isPermaLink="true">http://www.seochat.com/c/a/Search-Engine-Spiders-Help/Search-Engine-Spiders-Why-Dont-They-Crawl-My-Site/</guid>
</item>
<item><title>The Yahoo SLURP Crawler</title>
<pubDate>Tue, 08 Aug 2006 09:00:46 -0400</pubDate>
<link>http://www.seochat.com/c/a/Search-Engine-Spiders-Help/The-Yahoo-SLURP-Crawler/</link>
		<description><![CDATA[As SEOs and webmasters, we're always looking for ways to get the search engine spiders to crawl our sites, and the deeper, the better. This article shows you how to target Yahoo's crawler and convince it to stop by regularly.]]></description>
		<content:encoded><![CDATA[The search engine wars are fought with strategies, alliances, and robots. As Yahoo! primes itself to be the number one contender for market share after Google, websites that want to optimize for Yahoo must study how Yahoo ranks pages and how it indexes pages. The Yahoo web crawler SLURP should be studied; your site server logs should have recorded visits from various robots, including SLURP. If you do not have records of SLURP visiting your site, then this article will give tips on how to get SLURP to crawl (hopefully deep crawl) your site. The Preamble Yahoo SLURP evolved from Inktomi SLURP. ...]]></content:encoded>
<category>Search Engine Spiders Help</category>
<guid isPermaLink="true">http://www.seochat.com/c/a/Search-Engine-Spiders-Help/The-Yahoo-SLURP-Crawler/</guid>
</item>
<item><title>How Search Engines Work (and Sometimes Don’t)</title>
<pubDate>Mon, 26 Dec 2005 09:00:46 -0500</pubDate>
<link>http://www.seochat.com/c/a/Search-Engine-Spiders-Help/How-Search-Engines-Work-and-Sometimes-Dont/</link>
		<description><![CDATA[You know how important it is to score high in the SERPs. But your site isn't reaching the first three pages, and you don't understand why. It could be that you're confusing the web crawlers that are trying to index it. How can you find out? Keep reading.]]></description>
		<content:encoded><![CDATA[You have a masterful website, with lots of relevant content, but it isn't coming up high in the search engine results pages (SERPs). You know that if your site isn't on those early pages, searchers probably won't find you. You can't understand why you're apparently invisible to Google and the other major search engines. Your rivals hold higher spots in the SERPs, and their sites aren't nearly as nice as yours.  Search engines aren't people. In order to handle the tens of billions of web pages that comprise the World Wide Web, search engine companies have almost completely automated their proce...]]></content:encoded>
<category>Search Engine Spiders Help</category>
<guid isPermaLink="true">http://www.seochat.com/c/a/Search-Engine-Spiders-Help/How-Search-Engines-Work-and-Sometimes-Dont/</guid>
</item>
<item><title>Spider Guts</title>
<pubDate>Tue, 12 Oct 2004 09:00:56 -0400</pubDate>
<link>http://www.seochat.com/c/a/Search-Engine-Spiders-Help/Spider-Guts/</link>
		<description><![CDATA[What's inside the spiders? To get a good ranking in search engines, a good understanding of the fundamentals of SEO and how search robots crawl web pages is essential. The author includes valuable information such as a list of core elements considered by a typical search engine when calculating page relevance.]]></description>
		<content:encoded><![CDATA[In the quest for that elusive nirvana of search engine friendliness, we frequently find ourselves searching for  instant fix  ways to improve a page's ranking without considering the big picture; that is, without looking at the problem of optimizing a web page as a whole and instead looking at several separate optimization steps as part of routine markup development or copy writing. While SEO experts do not tend to fit this mold, the average web developer certainly does. How many web pages have you  optimized  by simply adding keyword and description meta tags, and stopped right there? I imagi...]]></content:encoded>
<category>Search Engine Spiders Help</category>
<guid isPermaLink="true">http://www.seochat.com/c/a/Search-Engine-Spiders-Help/Spider-Guts/</guid>
</item>
<item><title>Score One for the Spiders?</title>
<pubDate>Mon, 10 May 2004 00:00:00 -0400</pubDate>
<link>http://www.seochat.com/c/a/Search-Engine-Spiders-Help/Score-One-for-the-Spiders/</link>
		<description><![CDATA[Spiders. Those creepy, crawlies of data mining that scour the web for bits and pieces of information have a habit of getting into trouble. Just ask eBay and Boats.com, who recently had to resort to some legal bug spray in order to get rid of the little pests. Is your data scavenging in danger?]]></description>
		<content:encoded><![CDATA[Call them spiders. Call them robots. Call them bargain hunters (or one heck of a nuisance); they're software programs with a mission: to hunt down information and bring it back. Many search engines couldn't live without these electronic assistants to help them keep track of the proverbially explosive growth of the Web. Certainly they can save a lot of time when you're trying to comparison shop online -- just let a spider do the hunting and bring back the results. This is all well and good, unless the owner of the site doesn't take kindly to spiders. eBay won an injunction against Bidder's Edge...]]></content:encoded>
<category>Search Engine Spiders Help</category>
<guid isPermaLink="true">http://www.seochat.com/c/a/Search-Engine-Spiders-Help/Score-One-for-the-Spiders/</guid>
</item>
<item><title>Protect Against Invaders by SPAM-Proofing Your Website</title>
<pubDate>Wed, 05 May 2004 00:00:00 -0400</pubDate>
<link>http://www.seochat.com/c/a/Search-Engine-Spiders-Help/Protect-Against-Invaders-by-SPAM-Proofing-Your-Website/</link>
		<description><![CDATA[Benjamin Pfeiffer discusses how to SPAM-proof your website. He explains how to use Javascript and mod_rewrite to stop SPAMbots and Spybots from finding email addresses on your website. He also talks about how to find  and set up the .htaccess file and gives examples of robots and how to block them.]]></description>
		<content:encoded><![CDATA[Despite recent improvement in tools and programs in the battle against SPAM, most of us cannot escape the menace that plagues most of our inboxes on a regular basis. Each day most of us probably receive more SPAM than actual real email, and with Spammers getting more and more creative in their ways to circumvent traditional anti-SPAM tactics, it's vital webmasters empower themselves with some anti-SPAM tactics for their own websites.  In this article I will discuss a few ways to SPAM-proof your website against malicious SPAM robots that inevitably collect your email to be sold by the thousands...]]></content:encoded>
<category>Search Engine Spiders Help</category>
<guid isPermaLink="true">http://www.seochat.com/c/a/Search-Engine-Spiders-Help/Protect-Against-Invaders-by-SPAM-Proofing-Your-Website/</guid>
</item>
<item><title>ROBOTS.TXT Primer</title>
<pubDate>Mon, 29 Sep 2003 00:00:00 -0400</pubDate>
<link>http://www.seochat.com/c/a/Search-Engine-Spiders-Help/ROBOTS-TXT-Primer/</link>
		<description><![CDATA[There is often confusion as to the role and usage of the robots.txt file. I thought it would be a good idea to dispel some myths and highlight what robots.txt files are all about.]]></description>
		<content:encoded><![CDATA[There is often confusion as to the role and usage of the robots.txt file. I thought it would be a good idea to dispel some myths and highlight what robots.txt files are all about. Firstly, a robots.txt file is NOT to let search engine robots and other crawlers know which pages they are allowed to spider (enter), it is primarily to tell them what pages (and directories) they can NOT spider.The majority of websites do not have a robots.txt, and do not suffer from not having one. The robots.txt file does not influence ranking in any way. Its goal is to disallow certain spiders from visiting and t...]]></content:encoded>
<category>Search Engine Spiders Help</category>
<guid isPermaLink="true">http://www.seochat.com/c/a/Search-Engine-Spiders-Help/ROBOTS-TXT-Primer/</guid>
</item>
<item><title>Designing Websites For Humans  In A World Of Robots!!</title>
<pubDate>Fri, 11 Jul 2003 00:00:00 -0400</pubDate>
<link>http://www.seochat.com/c/a/Search-Engine-Spiders-Help/Designing-Websites-For-Humans/</link>
		<description><![CDATA[In this day and age, it can be easy to forget the basics of why your website is online. Crawlers/Robots, they come, they go, but they never pay. Thats where your visitors come in.]]></description>
		<content:encoded><![CDATA[With the ever increasing number of web pages   documents available on the internet, it has become difficult to find information fast and without having hundreds of advertisements thrown into our faces (most of which will have no relevancy to the information we are seeking). There is quite simply no realistic method to finding material on the internet other than using search engines. At this point, everyone should realize that search engines use  robots  in order to  crawl  through the internet and collect web pages   other documents. The search engine will then use these documents to make up t...]]></content:encoded>
<category>Search Engine Spiders Help</category>
<guid isPermaLink="true">http://www.seochat.com/c/a/Search-Engine-Spiders-Help/Designing-Websites-For-Humans/</guid>
</item>
</channel>
</rss>

