World wide web robots: an overview

Abstract

This paper traces the development of World Wide Web Robots and provides an overview of their main functions and workings. The focus is on search robots and illustrations will be drawn from two major search engines: AltaVista and Excite. In the concluding section, prblems associated with the use of Web Robots and their implications for electronic publishing will be examined.