How many documents can be managed with MODx (and what gain with new core) ?

I am getting questions about how many documents can be managed with MODx before there is a significant performance penalty. Also, how will the new core impact performance in this regard (this would depend on what database is used, I guess) ?

I remember reading something about this, either theoretical limits or actual feedback of high document count MODx powered websites but I can’t remember the thread nor find it through search / bookmarks...

Thanks in advance !

A good starting post to refer to is here. It illustrates how the size of the siteCache file increases to over a megabyte in size with 5000 documents. At that point, the ability of MODx to handle that many documents is completely dependent on the power and configuration of the hardware, web server configuration, amount of total traffic, frequency of content editing, and numerous other factors.

Some of what is planned for improving this situation is discussed in the same thread here. I’ll post new information on performance and scalability in the new core as soon as we are done with a few more features, some additional legacy code cleanup, and some initial optimization.

I believe there are some other threads that discuss similar topics, but this was the only one I could find at the moment.

That’s the thread I vaguely remembered, I’ll go do some re-reading...
Thanks for the quick response !

FYI: I had a site with over 4,000 documents and more than 30GB of traffic per month, and I didn’t notice any decrease in performance at all.

Nice to know ZAP, great to have feedback such as this !

Wow, my 600+ page site is nothing compared to that... Mine loads pages at 0.4 seconds from database, and < 0.1 from cache.

Quote from: ZAP at Sep 02, 2007, 01:00 AM

FYI: I had a site with over 4,000 documents and more than 30GB of traffic per month, and I didn’t notice any decrease in performance at all.

Hey ZAP, would u like to share the host info/hardware with us?

thanks.

Actually, you may be surprised to know that it was nothing special. It was a shared host (Linux/Apache) running PHP 4 and MySQL 4 and an otherwise pretty bare-bones setup. We use this host for a lot of sites because they’ve always been very reliable for us, but this particular site had way more traffic than any of the others (and almost all of the traffic was actual web pages as well; it didn’t have much in the way of multimedia going on when it was over 30GB/month).

And this will be the real shocker: It was running MODx 0.9.2!

The site came down about three months or so ago, however, due to internal issues in the organization running it. Probably the closest thing we have up now is a 900-page site that often does 20GB/month. Same host, but this site is 0.9.6 of course (and uses Ditto like mad!).