a file used to exclude some or all robots from crawling some or all the files or directories on a website. This file should be placed in your website's root directory.