Abstract
In this paper we present a methodology for detecting web crawlers in real time. We use decision trees to classify requests in real time, as originating from a crawler or human, while their session is ongoing. For this purpose we used machine learning techniques to identify the most important features that differentiate humans from crawlers. The method was tested in real time with the help of an emulator, using only a small number of requests. Our results demonstrate the effectiveness and applicability of our approach.
Original language | English |
---|---|
Title of host publication | 2011 18th International Conference on Telecommunications, ICT 2011 |
Pages | 428-432 |
Number of pages | 5 |
DOIs | |
Publication status | Published - 2011 |
Event | 2011 18th International Conference on Telecommunications, ICT 2011 - Ayia Napa, Cyprus Duration: 8 May 2011 → 11 May 2011 |
Other
Other | 2011 18th International Conference on Telecommunications, ICT 2011 |
---|---|
Country/Territory | Cyprus |
City | Ayia Napa |
Period | 8/05/11 → 11/05/11 |