# All robots will spider the domain User-agent: * Disallow: # Disallow directory ICES2006 User-agent: * Disallow: ICES2006 # Disallow directory report_samples User-agent: * Disallow: /report_samples/