Which file controls search engine crawling?

Explanation:
robots.txt instructs search engines which pages to crawl.

Latest Blogs