# Disallow all crawlers access to certain pages. User-agent: * Disallow: /App_Data Disallow: /App_Themes Disallow: /aspnet_client Disallow: /cache Disallow: /images Disallow: /php Disallow: /_noindex Disallow: /nutrabem