# robots.txt web.archive.org 02/14/2005 User-agent: * Disallow: / Disallow: /archive_notices/ Disallow: /cgi-bin/ Disallow: /collections/e2k/ Disallow: /collections/government/ Disallow: /collections/news/ Disallow: /collections/now/ Disallow: /collections/pioneers/ Disallow: /collections/sep11/ Disallow: /collections/web/ Disallow: /db_dir/ Disallow: /images/ Disallow: /live_dir/ Disallow: /privage_pages/ Disallow: /spec/ Disallow: /web/ Disallow: /e2k/