Search Engine Spiders
  Home arrow Search Engine Spiders arrow Page 3 - Protect Against Invaders by SPAM-Proof...
SEO Chat Forums  
Choosing Keywords  
Google Optimization  
Link Trading  
MSN Optimization  
Search Engine News  
Search Engine Spiders  
Search Optimization  
Web Directories  
Website Marketing  
Website Promotion  
Website Submission  
Yahoo Optimization  
SEO Tools
Adsense Calculator
AdSense Preview
Advanced Meta-Tags
Alexa Rank Tool
Check Server Headers
Class C Checker
Code to Text Ratio
CPM Calculator
Domain Age Check
Domain Typos
Future PageRank
Google Dance
Google Keywords
Google Search
Google Suggest
Google vs Yahoo
Indexed Pages
Keyword Cloud
Keyword Density
Keyword Difficulty
Keyword Optimizer
Keyword Position
Keyword Typos
Link Popularity
Link Price Calculator
Meta Analyzer
Meta Tag Generator
Multiple Link Popularity
Page Comparison
Page Size
PageRank Lookup
PageRank Search
Robots.txt Generator
ROI Calculator 
S.E. Comparison 
S.E. Keyword Position 
Site Link Analyzer 
Spider Simulator 
URL Redirect Check 
URL Rewriting 
Mobile Linux 
APP Generation ROI 
IBM® developerWorks 
SEO Weekly Newsletter
 
Developer Updates  
Free Website Content 
 RSS  Articles
 RSS  Forums
 RSS  All Feeds
Write For Us Get Paid 
Request Media Kit
Contact Us 
Site Map 
Privacy Policy 
Support 
 USERNAME
 
 PASSWORD
 
 
  >>> SIGN UP!  
  Lost Password? 
SEARCH ENGINE SPIDERS

Protect Against Invaders by SPAM-Proofing Your Website
By: Benjamin Pfeiffer
  • Search For More Articles!
  • Disclaimer
  • Author Terms
  • Rating: 4 stars4 stars4 stars4 stars4 stars / 17
    2004-05-05

    Table of Contents:
  • Protect Against Invaders by SPAM-Proofing Your Website
  • How to Use the JavaScript Method
  • Using mod_rewrite
  • Blocking Malicious "Good for Nothing" Robots

  • Rate this Article: Poor Best 
      ADD THIS ARTICLE TO:
      Del.ici.ous Digg
      Blink Simpy
      Google Spurl
      Y! MyWeb Furl
    Email Me Similar Content When Posted
    Add Developer Shed Article Feed To Your Site
    Email Article To Friend
    Print Version Of Article
    PDF Version Of Article
     
     
    ADVERTISEMENT


    Protect Against Invaders by SPAM-Proofing Your Website - Using mod_rewrite


    (Page 3 of 4 )

    In this section, the use of mod_rewrite is very successful in blocking the SPAMbots and other spybots that visit the website with a mission to either steal your email address or grab information from your website without your permission. Consider this method as a step above using JavaScript, because it stops them before they ever read the webpage itself.  So if you are thinking of using JavaScript on the page to block bots from finding your email, consider the use of mod_rewrite as a primary defense weapon against SPAM and other malicious robots.

    One note to readers: The use of mod_rewrite requires that you have it installed on your server, and you have the ability to edit the .htaccess file.  Below is a simple way to locate the .htaccess file while using a program such as CuteFTP (or a similar FTP client that performs the same functions).  If you are unsure whether you have mod_rewrite installed, you should first consult the server administrator with your primary hosting company.  Ask them if you have mod_rewrite and permissions to edit the .htaccess file.

    How to Find .htaccess in a Common FTP Client

    To locate the .htaccess file, most often you need to display all hidden files present when connecting to your hosting account.

    To enable your FTP client to display all hidden files (.htaccess and many other files not normally seen by the user).

    1. First locate your saved site properties.

    2. Right click on the profile of the website you want to display hidden files. This is most often located in the "FTP Sites" section of most clients.

    3. Once you right click on the FTP site, select "SITE PROPERTIES" from the menu.

    4. An option box will load up displaying the site properties of your site. Look for a tab called "ACTIONS" and click on it.

    5. It will display the actions of the site. Locate a gray box called "FILTERS" and click on it.

    6. This will display the "Filters" properties of the site.

    7. Locate the "Enable Filtering" from the options available. Make sure this box is checked.

    8. Once you have checked the enable filtering box, a small box at the bottom of the options will be displayed.

    9. It should say something similar to "Enable Server Side Filtering". Make sure this box is checked as well.

    10. Now enter the following into the "Remote Filter" box: -a

    Once you have entered in the filtering options, make sure to click "Ok" or "Apply" in order to save your changes.  You should now be able to see all hidden files on the server.  Make sure you start a new connection to view all files.  If you are still having trouble viewing all your files and can't seem to locate the .htaccess file, don't give up, but consult the system administrator of your hosting account to assist.

    How to Setup Your .htaccess File

    Once you have confirmed that you do have a .htaccess file, and mod_rewrite is turned on, add the following lines to your .htaccess file:

    Options +FollowSymlinks
    RewriteEngine On
    RewriteBase /

    More Search Engine Spiders Articles
    More By Benjamin Pfeiffer


     

    SEARCH ENGINE SPIDERS ARTICLES

    - The Yahoo SLURP Crawler
    - How Search Engines Work (and Sometimes Don’t)
    - Spider Guts
    - Score One for the Spiders?
    - Protect Against Invaders by SPAM-Proofing Yo...
    - ROBOTS.TXT Primer
    - Designing Websites For Humans In A World Of...





    © 2003-2009 by Developer Shed. All rights reserved. DS Cluster 1 Hosted by Hostway
    Stay green...Green IT