# Note: to exclude a path for all bots, add a Disallow line # to each User-agent section (including the special "*"). # See http://www.robotstxt.org/wc/norobots.html # Disallows for all robots User-agent: * Disallow: /~orlovm/ Disallow: /suexec/calendar/labsched/ Disallow: /facilities/ Disallow: /help/ Disallow: /facilities/ Disallow: /academics/courses/ Disallow: /research/publications/ Disallow: /faculty/person/*/publications.bib Disallow: /news/messageboard/ # Customized access for Google User-agent: Googlebot Disallow: /suexec/calendar/labsched/ Disallow: /help/ Disallow: /facilities/ Disallow: /academics/courses/ Disallow: /research/publications/ Disallow: /faculty/person/*/publications.bib Disallow: /news/messageboard/