Skip to content

Fixed formatting in robots.txt

Bermler requested to merge directwrite/freetype-web2:robottxt3 into master

Technically, if you want to allow all bots to crawl the entire site, you just include the Disallow header but leave it blank. (Note that this is different from "Disallow: /" , which will exclude the whole site from bots)

Merge request reports