Text preview for : robots.txt part of http://www.hardwarebook.info/ Hardware Book The Hardware Book has been released as of 2004-04-12
Back to : hwb-040412.rar | Home
# robots.txt
# This file specifies what harvesting robots are allowed to index and not.
#
# For information on the format:
# http://www.robotstxt.org/
#
# Everything not explicitly disallowed is considered fair game to retrieve.