# Disallow access to admin, db, images, cgi and test folders to all robot crawlers User-agent: * Disallow: /admin/ Disallow: /db/ Disallow: /images/ Disallow: /test/ Disallow: /cgi-bin/