Focused crawler

Related papers: 20

Top Cited Papers

SPHINX: a framework for creating personal, site-specific Web crawlers

Robert C. Miller, Krishna Bharat

Citations: 151 • 1998

The Ethicality of Web Crawlers

Yang Sun, C. Lee Giles

Citations: 39 • 2010

A dynamic URL assignment method for parallel web crawler

Francesco Ragni, C. Martines

Citations: 22 • 2010

Crawler Detection: A Bayesian Approach

Athena Stassopoulou, Marios D. Dikaiakos

Citations: 21 • 2006

Characterizing Crawler Behavior from Web Server Access Logs

Marios D. Dikaiakos, Athena Stassopoulou, Loizos Papageorgiou

Citations: 20 • 2003

Dominos: A New Web Crawler's Design

Chabane Djeraba

Citations: 16 • 2004

A Web Crawler Detection Algorithm Based on Web Page Member List

Weigang Guo, Yong Zhong, Jianqin Xie

Citations: 14 • 2012

An effective approach to enhancing a focused crawler using Google

Jae-Gil Lee, Donghwan Bae, Sansung Kim, Jungeun Kim, Mun Yong Yi

Citations: 13 • 2019

Applying Web Crawler Technologies for Compiling Parallel Corpora as one Stage of Natural Language Processing

Nilufar Abdurakhmonova, Ismailov Alisher, Guli Toirova

Citations: 10 • 2022

A study of different web-crawler behaviour

Alexander Menshchikov, Antonina Komarova, Yurij Gatchin, A.G. Кorobeynikov, Nina Tishukova

Citations: 9 • 2017

An Adaptive Updating Topic Specific Web Search System Using T-Graph

M.

Citations: 8 • 2010

A comprehensive study of the regulation and behavior of web crawlers

Yang Sun

Citations: 5 • 2008

An Approach to Design and Implement Parallel Web Crawler

Tithi Dhar, Sayan Mazumder, Susnigdha Dhar, Susovan Karak, Debraj Chatterjee

Citations: 5 • 2021

Adaptive crawler for external hyperlinks search and acquisition

Andrey Anatolievich Pechnikov, D. I. Chernobrovkin

Citations: 5 • 2014

A modular crawler-driven robot: Mechanical design and preliminary experiments

Qiquan Quan, Shugen Ma

Citations: 5 • 2009

CNDROBOT : a robot for the CINDI digital library system

Cong Zhou

Citations: 5 • 2005

Development of a Modular Crawler for Tracked Robots

Qiquan Quan, Shugen Ma

Citations: 4 • 2011

CINDI Robot: an Intelligent Web Crawler Based on Multi-level Inspection

Rui Chen, Bipin C. Desai, Cong Zhou

Citations: 4 • 2007

Ground Adaptability of Crawler Mobile Robots with Sub-Crawler Rotary Joint Compliance

Ayaka Watanabe, Tomonori Mitsuhashi, Masayuki Okugawa, Katsuji Ogane, Tetsuya Kimura, Tetsuya KINUGASA, Yoshikazu Ohtsubo

Citations: 3 • 2024

Warning system for crawler-type mobile robot with passive sub-crawler

Soichiro SUZUKI, Satoshi Hasegawa, Masayuki Okugawa

Citations: 3 • 2013