# The following block of code DISALLOWS the crawling of the following files and directories: /admin/ to all spiders/robots. User-agent: * Disallow: /admin/