AJOSE-ISMAIL, B. M. and OSANYIN, Q. A. (2020) A REVIEW OF WEB CRAWLERS FOR INFORMATION RETRIEVAL. In: Proceedings of the 2nd International Conference, The Federal Polytechnic, Ilaro, 10th – 11th Nov., 2020, 10th – 11th Nov., 2020, The Federal Polytechnic, Ilaro.
![[img]](http://eprints.federalpolyilaro.edu.ng/style/images/fileicons/text.png) |
Text
Web crawler for information retrieval.pdf Download (347kB) |
Abstract
Performance of any search engine relies heavily on its Web crawler. Web crawlers are the programs that get webpages from the web by following hyperlinks. These webpages are indexed by a search engine and can be retrieved by a user query. In the area of web crawling which is a subfield of Information Retrieval, we still lack an exhaustive study that covers all crawling techniques. This study follows the guidelines of systematic literature review and applies it to the field of Web crawling. Existing literature about the web crawler is classified into different key subareas. Each subarea is further divided according to the techniques being used. We have highlighted future areas of research. We call for an increased awareness in various fields of the web crawler.
| Item Type: | Conference or Workshop Item (Paper) |
|---|---|
| Subjects: | Q Science > QA Mathematics > QA75 Electronic computers. Computer science Q Science > QA Mathematics > QA76 Computer software |
| Divisions: | Faculty of Engineering, Science and Mathematics > School of Electronics and Computer Science |
| Depositing User: | Mr. Bolanle Yisau I. |
| Date Deposited: | 07 Jun 2021 10:52 |
| Last Modified: | 07 Jun 2021 10:52 |
| URI: | http://eprints.federalpolyilaro.edu.ng/id/eprint/1651 |
Actions (login required)
 |
View Item |
