# This file excludes web robots from searching files in the designated directories. User-agent: * Disallow: /logs/ Disallow: /private-cgi-bin/ Disallow: /communications/ Disallow: /original_website/ Disallow: /test/