This command allows search engine bots to report the web pages that are requested to be crawled and indexed. Also, this command enables webmasters to inform search engine bots about the pages or folders that are requested to be crawled.
Related Articles
