In the beginning, webmasters submitted the deal with of a web site, or URL to the assorted search engines like google and yahoo, which would ship a web crawler to crawl that webpage, extract hyperlinks to other pages from it, and return info observed on the web page to be https://www.youtube.com/watch?v=OeFqbAORPUg