# Spiders will not index all the pages in the html folder

User-agent: *
Disallow: /html/