# robots.txt file to control indexing of site User-agent: * Disallow: /News/uoft/ Disallow: /vendors/ Disallow: /eUser/ Disallow: /b2b/ Disallow: /staff/ Disallow: /oecm/ # exceptions for uoft robot User-agent: UofTSpider Disallow: /News/uoft/ Disallow: /eUser/ Disallow: /staff/ Disallow: /b2b/team/ Disallow: /oecm/