# robots.txt for http://www.duke.edu # # Contains directions for robots. # See http://info.webcrawler.com/mak/projects/robots/norobots.html # # Last updated 21-Aug-96 # $Id: robots.txt,v 1.1 1996/11/15 19:28:28 mg Exp mg $ User-agent: * Disallow: /bin/ Disallow: /cgi-bin/ Disallow: /htbin/ Disallow: /images/ Disallow: /Admin/ Disallow: /icons/ Disallow: /duke/ Disallow: /OLD/ Disallow: /deptdir.old/ Disallow: /web/distrib/ Disallow: /staging/