search engine - What should be the initial list of urls for a crawler to start its work -
I want a list of URLs where my crawler can start crawling efficiently so that it can cover the maximum portion of the web .
- Do you have any other ideas for creating an initial index for a different host? Is good seed
- As stated earlier, in order to orient a crawl, the inquiry from a search engine gives good results.
Comments
Post a Comment