New Community Forums are coming. Watch this space for news.
Subscribe: RSS
  • theoretiker Reply #1, 6 years ago
    I want to create a place in cloud which is not seen by especially google.

    The directory structure of Contexts is generated dynamically by modx, so i wonder how i can achive an "mainly" invisible context (for spiders and searchbots) for crazy testing purposes in cloud.

    Maybe i have to add some Nginx rules... maybe i can try to do the robots.txt in modx itself?

    What the right way to get a invisible context (by searchbots).


    Thank you,
    with best regards,
    Chris


    This question has been answered by multiple community members. See the first response.

    • theoretiker Reply #2, 6 years ago
      Ah, a linkless and this way not spiderrable context start-page would do the job i think... right?
      • Can you not just make a robots.txt document for the context and disallow things as you normally do? Google will hit the URL of that context and respect the robots.txt file no?

        We create a robots document in each of our contexts with a document type of text and never rely on a physical robots.txt file.
        • theoretiker Reply #4, 6 years ago
          I am not sure because of http headers ... don't know if this works this way... it should work, but i have to be shure about it....

          So in your case it works right? So it should work in my case too...

          • discuss.answer
            I really don't have any knowledge of http headers so I could be wrong. What we do is:


            1. Create a New Document
            2. Set the Content Type to text
            3. Save it
            4. Open/Edit it
            5. Ensure we the RTE is inactive (I believe setting the content type to text does this)
            6. Create the Rules and save the document

            I guess you could try and it see if that works.
            • Hopefully development clouds will have a robots.txt file with no index turned on by default - as there is a risk of duplicate content.
                Eighth day design
                Design agency with offices in Edinburgh and Brighton
              • discuss.answer
                Mathias Dannevang Reply #7, 6 years ago
                Quote from: theoretiker at Feb 28, 2013, 12:51 PM

                The directory structure of Contexts is generated dynamically by modx, so i wonder how i can achive an "mainly" invisible context (for spiders and searchbots) for crazy testing purposes in cloud.

                If it's mainly for your own testing, and not something that other (non-registered users) should see you could simply set the system setting "site_status" to "No". That way all non-registered visitors would only see the Site unavailable message.
                  Mathias Dannevang | Webdesigner at dannevang.org | Tweets @dannevang
                • theoretiker Reply #8, 6 years ago
                  Wow, thats a good hint, but is this possible on a single special context within a multi context envoirenment too?
                  Can i use site_status in a context setting?

                  I will try that ... great! Maybe a save solution...
                  • discuss.answer
                    Mathias Dannevang Reply #9, 6 years ago
                    Quote from: theoretiker at Mar 13, 2013, 04:38 PM

                    Can i use site_status in a context setting?

                    There shouldn't be a problem using it in a context setting.

                    Another idea could be to remove the "anonymous" group in the access permissions of the context. That should do the same: only users that are logged in to the manager (and with the right permissions) would be able to see the context.
                      Mathias Dannevang | Webdesigner at dannevang.org | Tweets @dannevang
                    • I often do that for "test" or development environments. Logged-in Manger users see the site as usual, but everybody else just gets your offline message page.
                        Studying MODX in the desert - http://sottwell.com
                        Tips and Tricks from the MODX Forums and Slack Channels - http://modxcookbook.com
                        Join the Slack Community - http://modx.org