Automated Data Mining from Web Servers Using Perl Script

Abstract

Data mining from the Web is the process of extracting essential data from any web server. In this paper, we present a method called Ethernet Robot to extract information/data from a web server using perl scripting language and to process the data using regular expressions. The procedure involves fetching, filtering, processing and presentation of required data. The resultant HTML file consisting of the required data is displayed for the perusal of users. Future enhancements to our ethernet robot include optimization to improve performance and customization for use as a sophisticated client-specific search agent.