search engine - What should be the initial list of urls for a crawler to start its work -


I want a list of URLs where my crawler can start crawling efficiently so that it can cover the maximum portion of the web .

  • Do you have any other ideas for creating an initial index for a different host? Is good seed
  • As stated earlier, in order to orient a crawl, the inquiry from a search engine gives good results.

Comments

Popular posts from this blog

Eclipse CDT variable colors in editor -

AJAX doesn't send POST query -

wpf - Custom Message Box Advice -