Defining metrics to automate the quantitative analysis of textual information within a web page

Abstract

The aim of this paper is to define a system of metrics and experimental ways to valuate them to quantitatively analyze the textual information contained by a web page and to determine the differences between the displayed textual information, shown to the human visitor, and the one extracted by the search engines robots. These metrics are the foundation to specify, design and realize an autonomous intelligent robot to find, signal, and interpret the textual information within a web page, hidden or not. For each of that defined metric is specified a computation formula and, if necessary, a procedure to be followed to obtain the involved elements. For each metric is given an interpretation and usefulness depending on the range of the valuation. The metrics are independent on the search engine type, commercial or semantic.