I have the need to disallow engines to crawl a part of a MODx website I am working on. Of course that would be easy to do if the part of the website was a physical folder on the server, but since it’s a MODx folder I have no idea if the traditionnal method :
User-agent: *
Disallow: /myfolder/
will work.
Will the robot understand the rewrite rules as a folder or not ?
Will it ignore it ?
If not, how do you handle this (remember I don’t want to password protect the folder, just hide it from the bots) ?
Thanks !
.: COO - Commerce Guys - Community Driven Innovation :.
MODx est l'outil id
Ok, I think I self answered it... I am pretty much ashamed for not remembering this :
<meta name="robots" content="noindex">
Dumb me !
I’ll just add this to my template for this section and there I am !
.: COO - Commerce Guys - Community Driven Innovation :.
MODx est l'outil id
