Text preview for : robots.txt part of http://www.hardwarebook.info/ Hardware Book The Hardware Book has been released as of 2001-06-08
Back to : hwb-010706.rar | Home
# robots.txt
# This file specifies what harvesting robots are allowed to index and not.
#
# For information on the format:
# http://www.robotstxt.org/
#
# Everything not explicitly disallowed is considered fair game to retrieve.