Search Engine News
  Home arrow Search Engine News arrow Page 4 - Learning to Crawl: an Investigation of...
SEO Chat Forums  
Choosing Keywords  
Google Optimization  
Link Trading  
MSN Optimization  
Search Engine News  
Search Engine Spiders  
Search Optimization  
Web Directories  
Website Marketing  
Website Promotion  
Website Submission  
Yahoo Optimization  
SEO Tools
Adsense Calculator
AdSense Preview
Advanced Meta-Tags
Alexa Rank Tool
Check Server Headers
Class C Checker
Code to Text Ratio
CPM Calculator
Domain Age Check
Domain Typos
Future PageRank
Google Dance
Google Keywords
Google Search
Google Suggest
Google vs Yahoo
Indexed Pages
Keyword Cloud
Keyword Density
Keyword Difficulty
Keyword Optimizer
Keyword Position
Keyword Typos
Link Popularity
Link Price Calculator
Meta Analyzer
Meta Tag Generator
Multiple Link Popularity
Page Comparison
Page Size
PageRank Lookup
PageRank Search
Robots.txt Generator
ROI Calculator 
S.E. Comparison 
S.E. Keyword Position 
Site Link Analyzer 
Spider Simulator 
URL Redirect Check 
URL Rewriting 
Mobile Linux 
APP Generation ROI 
IBM® developerWorks 
SEO Weekly Newsletter
 
Developer Updates  
Free Website Content 
 RSS  Articles
 RSS  Forums
 RSS  All Feeds
Write For Us Get Paid 
Request Media Kit
Contact Us 
Site Map 
Privacy Policy 
Support 
 USERNAME
 
 PASSWORD
 
 
  >>> SIGN UP!  
  Lost Password? 
SEARCH ENGINE NEWS

Learning to Crawl: an Investigation of the Personal Web Crawler
By: Bruce Coker
  • Search For More Articles!
  • Disclaimer
  • Author Terms
  • Rating: 3 stars3 stars3 stars3 stars3 stars / 3
    2008-10-21

    Table of Contents:
  • Learning to Crawl: an Investigation of the Personal Web Crawler
  • A better way?
  • Examples
  • Copernic Agent

  • Rate this Article: Poor Best 
      ADD THIS ARTICLE TO:
      Del.ici.ous Digg
      Blink Simpy
      Google Spurl
      Y! MyWeb Furl
    Email Me Similar Content When Posted
    Add Developer Shed Article Feed To Your Site
    Email Article To Friend
    Print Version Of Article
    PDF Version Of Article
     
     
    ADVERTISEMENT


    Learning to Crawl: an Investigation of the Personal Web Crawler - Copernic Agent


    (Page 4 of 4 )

    The Copernic search agent, although not exactly a web crawler in the traditional sense of the term, has enough similarities to merit inclusion. Rather than indexing the web itself, it is an “intelligent” search tool that queries multiple search engines and processes what it receives to present filtered, usable results from which much of the useless material has been removed. It perhaps more closely resembles a meta search engine than a crawler. A number of additional functions are included that further improve the usability of the results:

    • Returns results from over 90 categorized search engines.

    • Results are improved by removing duplicate entries and retaining the most relevant.

    • Built-in tools allow the removal of broken links, searching within the results, local saving, result sorting and extensive reporting.

    • Searches are saved for later use, making them available instantly for use, modification and update.

    The Copernic agent is available in three versions. The "basic" version is a free download, and offers standard searching and reporting capabilities. The "personal" version provides greater facilities for customization and personalization along with advanced result management capabilities. The "professional" version comes closest to the functionality of a web crawler: in addition to the basic and personal functions, it will track new search results in the background as they become available, track changes in web page content, and provides powerful tools for the analysis of search results.

    For more information on the Copernic Agent, see:

    http://www.copernic.com/en/products/agent/index.html


    DISCLAIMER: The content provided in this article is not warranted or guaranteed by Developer Shed, Inc. The content provided is intended for entertainment and/or educational purposes in order to introduce to the reader key ideas, concepts, and/or product reviews. As such it is incumbent upon the reader to employ real-world tactics for security and implementation of best practices. We are not liable for any negative consequences that may result from implementing any information covered in our articles or tutorials. If this is a hardware review, it is not recommended to open and/or modify your hardware.

     

    SEARCH ENGINE NEWS ARTICLES

    - Fast Flip, Google`s New News Reading Service
    - Masterseek: a Global Business Search Engine
    - Behavioral Advertising Bill Breaks New Ground
    - Microsoft-Yahoo Deal: Where Do We Go From He...
    - The History of Search and Search Technology
    - Yahoo Closes Geocities
    - Tokoni Takes Storytelling in New Direction
    - Stumpedia: Yet Another Human-Powered Search ...
    - Does Mufin Know Music?
    - Google Layoffs: A Sign of the Times
    - What Makes Question and Answer Sites Popular?
    - Taking a DeepDyve into the Deep Web
    - Is Yahoo`s New CEO Up to the Challenge?
    - Yasni Puts the People in People Search
    - Yasni: Yet Another People Search Engine?





    © 2003-2009 by Developer Shed. All rights reserved. DS Cluster 4 Hosted by Hostway
    For more Enterprise Application Development news, visit eWeek