# robots.txt - 02.21.07 - smh # updated 06.06.2008 Tom Haflinger User-agent: * Disallow: /cgi-bin/ Disallow: /conn/ Disallow: /error/ Disallow: /icons/ Disallow: /manual/ Disallow: /usage/ # BEGIN TOM'S MODIFICATIONS Disallow: /acad/ Disallow: /academics2/ Disallow: /adm/ Disallow: /admin/ Disallow: /Athletics2/ Disallow: /bookstore/ Disallow: /c4/ Disallow: /camp/ Disallow: /campus_services/ Disallow: /docs/ Disallow: /faculty/ Disallow: /features/ Disallow: /fin_aid/ Disallow: /functions/ Disallow: /GeneratedItems/ Disallow: /helpdesk/ Disallow: /hispanic_heritage/ Disallow: /homecoming/ Disallow: /homecoming2007/ Disallow: /homecoming_test/ Disallow: /intranet/ Disallow: /kmxx/ Disallow: /luau/ Disallow: /management/ # allow management after content update Disallow: /newhome/ Disallow: /phpdig/ Disallow: /phpMyAdmin/ Disallow: /portal_oaknet/ Disallow: /prerelease/ Disallow: /search/ Disallow: /secure/ Disallow: /stud/ Disallow: /studentjobs_old/ Disallow: /tech/ Disallow: /test4k/ Disallow: /theoak/ Disallow: /tmp/ Disallow: /tools/ Disallow: /webcal/ Disallow: /Athletics/ # bots should still find athletics.menlo.edu Disallow: /winefest/ Disallow: /archive/