# Prevent bots from crawling this site User-agent: * # match all bots Disallow: / # keep them out