# FULL access (Google) User-agent: Googlebot Disallow: /Stats Disallow: /stats Disallow: /shoppage Disallow: /secure Disallow: /Scripts Disallow: /random Disallow: /Pdf Disallow: /links Disallow: /jscript Disallow: /includes Disallow: /images1 Disallow: /Images Disallow: /images Disallow: /Guestbook Disallow: /fpdb Disallow: /forms Disallow: /flash Disallow: /database Disallow: /CustomErrorFiles Disallow: /css Disallow: /cgi-bin Disallow: /bbs Disallow: /aspnet_client Disallow: /admin Disallow: /_vti_log Disallow: /_private Disallow: /_derived # FULL access (Alta Vista) User-agent: Scooter Disallow: /Stats Disallow: /stats Disallow: /shoppage Disallow: /secure Disallow: /Scripts Disallow: /random Disallow: /Pdf Disallow: /links Disallow: /jscript Disallow: /includes Disallow: /images1 Disallow: /Images Disallow: /images Disallow: /Guestbook Disallow: /fpdb Disallow: /forms Disallow: /flash Disallow: /database Disallow: /CustomErrorFiles Disallow: /css Disallow: /cgi-bin Disallow: /bbs Disallow: /aspnet_client Disallow: /admin Disallow: /_vti_log Disallow: /_private Disallow: /_derived # FULL access (FASTDisallow: /AllTheWeb) User-agent: FAST-WebCrawler Disallow: /Stats Disallow: /stats Disallow: /shoppage Disallow: /secure Disallow: /Scripts Disallow: /random Disallow: /Pdf Disallow: /links Disallow: /jscript Disallow: /includes Disallow: /images1 Disallow: /Images Disallow: /images Disallow: /Guestbook Disallow: /fpdb Disallow: /forms Disallow: /flash Disallow: /database Disallow: /CustomErrorFiles Disallow: /css Disallow: /cgi-bin Disallow: /bbs Disallow: /aspnet_client Disallow: /admin Disallow: /_vti_log Disallow: /_private Disallow: /_derived # FULL access (Inktomi) User-agent: Slurp Disallow: /Stats Disallow: /stats Disallow: /shoppage Disallow: /secure Disallow: /Scripts Disallow: /random Disallow: /Pdf Disallow: /links Disallow: /jscript Disallow: /includes Disallow: /images1 Disallow: /Images Disallow: /images Disallow: /Guestbook Disallow: /fpdb Disallow: /forms Disallow: /flash Disallow: /database Disallow: /CustomErrorFiles Disallow: /css Disallow: /cgi-bin Disallow: /bbs Disallow: /aspnet_client Disallow: /admin Disallow: /_vti_log Disallow: /_private Disallow: /_derived # FULL access (Lycos) User-agent: Lycos_Spider_(T-Rex) Disallow: /Stats Disallow: /stats Disallow: /shoppage Disallow: /secure Disallow: /Scripts Disallow: /random Disallow: /Pdf Disallow: /links Disallow: /jscript Disallow: /includes Disallow: /images1 Disallow: /Images Disallow: /images Disallow: /Guestbook Disallow: /fpdb Disallow: /forms Disallow: /flash Disallow: /database Disallow: /CustomErrorFiles Disallow: /css Disallow: /cgi-bin Disallow: /bbs Disallow: /aspnet_client Disallow: /admin Disallow: /_vti_log Disallow: /_private Disallow: /_derived # FULL access (All Spiders) User-agent: * Disallow: /Stats Disallow: /stats Disallow: /shoppage Disallow: /secure Disallow: /Scripts Disallow: /random Disallow: /Pdf Disallow: /links Disallow: /jscript Disallow: /includes Disallow: /images1 Disallow: /Images Disallow: /images Disallow: /Guestbook Disallow: /fpdb Disallow: /forms Disallow: /flash Disallow: /database Disallow: /CustomErrorFiles Disallow: /css Disallow: /cgi-bin Disallow: /bbs Disallow: /aspnet_client Disallow: /admin Disallow: /_vti_log Disallow: /_private Disallow: /_derived