Which file controls crawler access to website pages?

Explanation:

robots.txt tells crawlers which pages to crawl.