<![CDATA[ Ditto and thousands news? - My Forums]]> https://forums.modx.com/thread/?thread=41206 <![CDATA[Re: Ditto and thousands news?]]> https://forums.modx.com/thread/41206/ditto-and-thousands-news#dis-post-238947 Quote from: mooreds at Jan 02, 2007, 09:12 PM

Quote from: OpenGeek at Dec 09, 2006, 03:30 AM

All of this is being addressed at the core level, and hopefully we’ll have some additional scalability in this respect with the next minor release of MODx. wink

I’m curious--can you get around the 5K limit on total documents via turning off caching?

Thanks,
Dan
Not yet Dan; part of the bottleneck is a large index of document metadata that is loaded on all requests, which a large part of the current parsing engine is dependent on. As I mentioned though, these issues are being addressed.]]>
opengeek Jan 02, 2007, 06:26 PM https://forums.modx.com/thread/41206/ditto-and-thousands-news#dis-post-238947
<![CDATA[Re: Ditto and thousands news?]]> https://forums.modx.com/thread/41206/ditto-and-thousands-news#dis-post-238946 Quote from: OpenGeek at Dec 09, 2006, 03:30 AM

Quote from: ajayre at Dec 09, 2006, 03:07 AM

Ditto will work fine with 1000s of documents or will work fine with a custom table?
I thought that MODx itself had performance problems above 5000 documents, so I was referring to that rather than any performance problems with Ditto.
Andy, this has nothing specifically to do with Ditto actually, though I’m sure Ditto adds some additional overhead to the problem. The real problem is the current approach to caching the entire site structure within a single cache file in MODx. Sites with thousands of documents will have very large siteCache files which will tax the web server more by requiring more memory, more time to load the file from the filesystem, and more time to process it with the PHP interpreter. In addition, thousands of pageCache files will also exist in a single directory, which can also increase resource loads for the web server when reading the cache directory contents searching for a cached file. This reduces performance exponentially.

All of this is being addressed at the core level, and hopefully we’ll have some additional scalability in this respect with the next minor release of MODx. wink

I’m curious--can you get around the 5K limit on total documents via turning off caching?

Thanks,
Dan]]>
mooreds Jan 02, 2007, 03:12 PM https://forums.modx.com/thread/41206/ditto-and-thousands-news#dis-post-238946
<![CDATA[Re: Ditto and thousands news?]]> https://forums.modx.com/thread/41206/ditto-and-thousands-news#dis-post-238945 There isn’t much point trying to use Ditto with 5k+ documents if MODx can’t handle it well.

Andy]]>
ajayre Dec 08, 2006, 09:34 PM https://forums.modx.com/thread/41206/ditto-and-thousands-news#dis-post-238945
<![CDATA[Re: Ditto and thousands news?]]> https://forums.modx.com/thread/41206/ditto-and-thousands-news#dis-post-238944 Quote from: ajayre at Dec 09, 2006, 03:07 AM

Ditto will work fine with 1000s of documents or will work fine with a custom table?
I thought that MODx itself had performance problems above 5000 documents, so I was referring to that rather than any performance problems with Ditto.
Andy, this has nothing specifically to do with Ditto actually, though I’m sure Ditto adds some additional overhead to the problem. The real problem is the current approach to caching the entire site structure within a single cache file in MODx. Sites with thousands of documents will have very large siteCache files which will tax the web server more by requiring more memory, more time to load the file from the filesystem, and more time to process it with the PHP interpreter. In addition, thousands of pageCache files will also exist in a single directory, which can also increase resource loads for the web server when reading the cache directory contents searching for a cached file. This reduces performance exponentially.

All of this is being addressed at the core level, and hopefully we’ll have some additional scalability in this respect with the next minor release of MODx. wink]]>
opengeek Dec 08, 2006, 09:30 PM https://forums.modx.com/thread/41206/ditto-and-thousands-news#dis-post-238944
<![CDATA[Re: Ditto and thousands news?]]> https://forums.modx.com/thread/41206/ditto-and-thousands-news#dis-post-238943 MARKSVIRTUALDESK Dec 08, 2006, 09:25 PM https://forums.modx.com/thread/41206/ditto-and-thousands-news#dis-post-238943 <![CDATA[Re: Ditto and thousands news?]]> https://forums.modx.com/thread/41206/ditto-and-thousands-news#dis-post-238942 I thought that MODx itself had performance problems above 5000 documents, so I was referring to that rather than any performance problems with Ditto.

Andy]]>
ajayre Dec 08, 2006, 09:07 PM https://forums.modx.com/thread/41206/ditto-and-thousands-news#dis-post-238942
<![CDATA[Re: Ditto and thousands news?]]> https://forums.modx.com/thread/41206/ditto-and-thousands-news#dis-post-238941
You might consider paging the results to make it easier on the visitor--- and your db server.]]>
MARKSVIRTUALDESK Dec 08, 2006, 09:05 PM https://forums.modx.com/thread/41206/ditto-and-thousands-news#dis-post-238941
<![CDATA[Re: Ditto and thousands news?]]> https://forums.modx.com/thread/41206/ditto-and-thousands-news#dis-post-238940
Andy]]>
ajayre Dec 06, 2006, 01:08 PM https://forums.modx.com/thread/41206/ditto-and-thousands-news#dis-post-238940
<![CDATA[Ditto and thousands news?]]> https://forums.modx.com/thread/41206/ditto-and-thousands-news#dis-post-238939
Can Ditto help me?]]>
konstantin Dec 03, 2006, 06:10 AM https://forums.modx.com/thread/41206/ditto-and-thousands-news#dis-post-238939