Hello Modx’ers!
Hopefully I’ve got this in the right section!
Was wondering if my Robots.txt file looks correct? Only, that Google has indexed a bunch of my pages (including page title some relevant text) but has not cached or updated it’s listing for my homepage. When I search for my site in google the homepage appears like it did when I had a holding page a few weeks ago..
search: ’ah!digital’ (3rd position) and then try ’tunenation’ (5th position). You’ll see the difference.
I wasn’t sure if maybe my Robots.txt file could be blocking crawler access somehow?
# Default modx exclusions
User-agent: * Disallow: /assets/cache/
Disallow: /assets/docs/
Disallow: /assets/export/
Disallow: /assets/import/
Disallow: /assets/modules/
Disallow: /assets/plugins/
Disallow: /assets/snippets/
Disallow: /install/
Disallow: /manager/
# For sitemaps.xml autodiscovery. Uncomment if you have one:
Sitemap: http://www.ahdigital.co.uk/sitemap.xml
Thanks for any help or suggestions!
