# All robots will spider the domain User-agent: * Disallow: # Disallow directory /admin User-agent: * Disallow: /admin # Disallow directory /App_Code User-agent: * Disallow: /App_Code # Disallow directory /App_Data User-agent: * Disallow: /App_Data # Disallow directory /aspnet_client User-agent: * Disallow: /aspnet_client # Disallow directory /bin User-agent: * Disallow: /bin # Disallow directory /images User-agent: * Disallow: /images # Disallow directory /includes User-agent: * Disallow: /includes