Web development

Web scraping technologies in an API world

Daniel Glez‐Peña, Anália Lourenço, Hugo López-Fernández, Miguel Reboiro‐Jato, Florentino Fdez‐Riverola

Citations: 200 • 2013

SPHINX: a framework for creating personal, site-specific Web crawlers

Robert C. Miller, Krishna Bharat

Citations: 151 • 1998

SiteHelper: a localized agent that helps incremental exploration of the World Wide Web

Daniel Siaw Weng Ngu, Xindong Wu

Citations: 67 • 1997

Conceptual Framework of Web 3.0 and Impact on Marketing, Artificial Intelligence, and Blockchain

Diptiben Ghelani, Tan Kian Hua

Citations: 51 • 2022

Web Services Based Robot Control Platform for Ubiquitous Functions

Bong Keun Kim, Manabu Miyazaki, Kohtaro Ohba, S. Hirai, K. Tanie

Citations: 49 • 2006

A soft computing approach for benign and malicious web robot detection

Mahdieh Zabihimayvan, Reza Sadeghi, Howard N. Rude, Derek Doran

Citations: 42 • 2017

Web Spambot Detection Based on Web Navigation Behaviour

Pedram Hayati, Vidyasagar Potdar, Kevin Chai, Alex Talevski

Citations: 39 • 2010

Detection of Web site visitors based on fuzzy rough sets

Javad Hamidzadeh, Mahdieh Zabihimayvan, Reza Sadeghi

Citations: 37 • 2017

Who and what links to the Internet Archive

Yasmin AlNoamany, Ahmed AlSum, Michele C. Weigle, Michael L. Nelson

Citations: 32 • 2014

Web Page Design: A Different Multimedia

Mary Morris, Randy J. Hinrichs

Citations: 30 • 1996

Information Monitoring on the Web: A Scalable Solution

LING LIU, Wei Tang, David Buttler, Calton Pu

Citations: 29 • 2002

Novel pre-processing technique for web log mining by removing global noise and web robots

P. Nithya, P. Sumathi

Citations: 26 • 2012

Using co-visitation networks for detecting large scale online display advertising exchange fraud

Ori Stitelman, Claudia Perlich, B D'Alessandro, Rod Hook, Troy Raeder, Foster Provost

Citations: 25 • 2013

Why web sites are lost (and how they're sometimes found)

Frank McCown, Catherine C. Marshall, Michael L. Nelson

Citations: 20 • 2009

Robots on the Web

M. Brian Blake, Sekou L. Remy, Yi Wei, Ayanna Howard

Citations: 19 • 2011

How to Set Up and Maintain a Web Site

Lincoln Stein

Citations: 17 • 1996

Detection and confirmation of web robot requests for cleaning the voluminous web log data

Tanvir Habib Sardar, Zahid Ansari

Citations: 16 • 2014

Dominos: A New Web Crawler's Design

Chabane Djeraba

Citations: 16 • 2004

RAMP – the Repository Analytics and Metrics Portal

Patrick OBrien, Kenning Arlitsch, Jeff Mixter, Jonathan Wheeler, Leila Sterman

Citations: 15 • 2017

Twenty Years of Web Scraping and the Computer Fraud and Abuse Act

Andrew Sellars

Citations: 14 • 2018