News: Welcome to !! Please ask your questions in respective categories !!

learn image-text associations using web crawler (Read 92 times)


  • Posts: 10
A web crawler is an internet bot which searches the web in a systematic way and it copies all the pages they visit for more efficient usage to the user.crawlers can validate hyperlinks and HTMLcodes.Web crawler is visiting URLs it identifies the ads and hyperlinks in that pages and
saves the information of the sites and we can access it later.Web crawlers typically identify themselves to a Web server by using the User-agent field of an HTTP request.
Bing bot is the Microsoft bing web crawler and google bot from google are examples for web crawlers.There are knit-morris-pratt(KMP) and finite automata and boyer more(BMM) algorithms.
« Last Edit: March 24, 2017, 05:02:35 PM by surya »