12-2 robots.txt

1. robots.txt

   User-agent: *
   Disallow: /cgi-bin/
   Disallow: /tmp/
   Disallow: /cache/
   Disallow: /class/
   Disallow: /kernel/
   Disallow: /templates_c/

    

2.