User-agent: * Disallow: /files/ Disallow: /images/ Disallow: /admin/ Disallow: /cgi-bin/ Disallow: /filetransfer/ Disallow: /ftptransfer/ Disallow: /transfer/ Disallow: /vendorftp/ Disallow: /visitors_files/ Disallow: /calendar.cfm Disallow: /BOE_Nov2008/