# $Id: robots.txt,v 1.18 2004/07/23 08:56:41 kday Exp $ # # This is a file retrieved by webwalkers a.k.a. spiders that # conform to a defacto standard. # See # # Comments to the webmaster should be posted at # # # Format is: # User-agent: # Disallow: | # Flag Date By Reason # $l1- 20040723 kday finally understood what the file was for! # ----------------------------------------------------------------------------- User-agent: * Disallow: // Disallow: /Aestus Disallow: /_borders Disallow: /EarthTech Disallow: /FGS Disallow: /FL-DEP Disallow: /FW Disallow: /Lansing-Hisert_Group Disallow: /PB-STV Disallow: /Pennridge_web Disallow: /S2C2 Disallow: /Schmidt Disallow: /SSM Disallow: /Stratus Disallow: /Synergy Disallow: /Transfer Disallow: /TriHydro Disallow: /vironex_web Disallow: /WRS