We launched new forums in March 2019—join us there. In a hurry for help with your website? Get Help Now!
    • 10226
    • 412 Posts
    I almost posted this in off-topic so admins - fell free to move it.

    I was looking for myself on google and found that they are indexing pages that are not shown in menu and not linked to anywhere. I have setup an appropriate robots.txt file and requested the removal. Has anyone seen this before? I do not use a sitemap and those pages are for in-house use with no links to them anywhere.
      • 10226
      • 412 Posts
      Yeah Google has indexed links I have posted here. But the pages it has indexed were never shown in the menu or linked from anywhere else. I have added the items I do not want indexed for exclusion in the robots.txt file earlier this morning. I have also requested they be removed from Google’s index. So I guess somehow Google found them... I have other pages of the same manner, but only a few have been indexed.

      I was just wondering if there is some good explanation as to how those pages were indexed.

      Thanks!
        • 20289
        • 958 Posts
        Create new template and copy/paste the default template code you are using and add the line below in your html HEAD section and assign it to those documents you don’t like to be indexed by search bots:
        <meta name="robots" content="noindex,nofollow">

        Or you can do the same with TV.
          [img]http://i10.tinypic.com/52c4eir.gif[/img][/td]
          [td][Wiki] [Persian support forum]
          [SVN] [RTL SVN Branch] [bugs] [FishEye+Crucible] [Learn MODx!] | [My Google Code]
          [font=tahoma][برای دسترسی به راهنمای فارسی به [url=http://www.modxcms.ir]
          • 10226
          • 412 Posts
          Yeah that is a good idea.. can never have too many templates! that way I can put a different logo so my wife will stop asking me if it is public or not.

            • 20289
            • 958 Posts
            Check it out after sometime with google, as their db need time to be updated, but don’t cheat your wife on this by placing some other logo grin lol
              [img]http://i10.tinypic.com/52c4eir.gif[/img][/td]
              [td][Wiki] [Persian support forum]
              [SVN] [RTL SVN Branch] [bugs] [FishEye+Crucible] [Learn MODx!] | [My Google Code]
              [font=tahoma][برای دسترسی به راهنمای فارسی به [url=http://www.modxcms.ir]
              • 29181
              • 480 Posts
              Another option which I use (to avoid having very similar templates) is a list TV which defaults to no content and has

              Allow indexing==||No indexing=={{noIndex}}


              where noIndex is a chunk that holds the meta robots tag as above.

              Another tasty little addon would be a TV that either displays a special wifey banner is a page isn’t public otherwise the default.

              But that would just be playing.

              Either way, all the best with the Birdy Num Nums! grin

              Taff
                Adrian Lawley: www.adrianlawley.com