Xenu Link Sleuth not working with Modx?

I haven't but a little googling tells me quite some people use Xenu successfully to test their ModX-sites for broken links. So it should be possible. Strange it doesn't work

Perhaps your server is blocking it with some kind of security application?

They haven't blocked it, as Xenu can crawl the subdomains of my domain just fine. That's the irony of it all.

Perhaps Xenu cached the robots.txt, and you need to do something to jog it to clear the cache?

Are the pages by any chance protected by a login?

Quote from: sottwell at Apr 14, 2014, 02:59 PM

Perhaps Xenu cached the robots.txt, and you need to do something to jog it to clear the cache?

That could be the case, but I can't find a setting in the software to do so. I will check if Google has anything on that. Good thinking!

Quote from: sottwell at Apr 14, 2014, 03:00 PM

Are the pages by any chance protected by a login?

No, I haven't protected pages with a login

ps: I appreciate the thinking along with me

The only other things that come to mind are, is the site set to be offline? and are the pages published? A logged-in Manager user can see a site that's offline, and can also see unpublished pages, so it can happen that that sort of thing gets overlooked.

And are you sure you got the right robots.txt file? I've spent hours fighting a bug when it turned out I was actually working on a file in a different directory than I thought I was.