You do not need to disallow anything other than directories that you do not want spiders to index. If there are no links in your site to a scripts directory and it does not appear in any URL found on your site, then you do not have to include that directory. The only way a spider will get into a directory is when someone provides a link to it or it appears in a path in a URL.

One important rule it to never include directories or folders in the robots.txt file that reveals a secret area, such as the administration area of a site. If you want to hide a directory and you put it in the robots.txt file, anyone can easily view it.

You are correct. Do not disallow the images directory if you want Google to index your images. I always block the images directory because too many people think that anything they find in Google Images is free to use. It is not. The overwhelming number of images in Google’s index are copyrighted images taken from web sites without permission. I am a bit surprised that there hasn’t been a legal challenge to that. However, the way to prevent it is to block the images directory.

If I want my images to be indexed by google images I should not disallow my images, correct?

Two questions:

1) What is a short list of recommended files or folders to disallow in robot.txt? ie. /images, /styles, /cgibin, /subdomians, /scripts etc

2) If you disallow subdomain site folders in the root directory of the main site folder will they still be accessible by the robots through their individual URL?

Thank you,

Joseph