Don’t bother. You need a password to get past /manager and /assets gives you a 403 (forbidden) error.
Just learning the ropes.
-
☆ A M B ☆
- 24,524 Posts
Such a file certainly won’t hurt anything, though.
And there’s no point in having the files in those directories muddying up the search engine’s indexes.
Bob
I go back and forth on this. Keeping application files out of the search engine’s index is a good idea. From a security standpoint I feel it’s best to obscure references to the application, thereby eliminating the temptation of a hack. This can’t be done in a robots.txt file which is publicly viewable and therefore provides insight as to the application used and the directory structure and consequently provides a roadmap to hacking. Using "noindex, nofollow" in the header of those files solves this issue but still potentially leaves the directories exposed.
If this isn’t a concern, it’s quick and easy just to modify the robots.txt file as previously posted to prevent the indexing of those pages/directories.
