Running out of memory and server hangs for large-ish site with Articles

45 Posts

Qodo Reply #11, 14 years, 8 months ago

Thanks Mark.....I will try editing archives and let you know.

Stewart
Freelance Web Designer & Developer:
http://www.qodo.co.uk

My extras:
TwitterX http://modx.com/extras/package/twitterx
TableOfContentsX http://modx.com/extras/package/tableofcontentsx

☆ A M B ☆
3,141 Posts

Mark Hamstra Reply #12, 14 years, 8 months ago

I suspect this is DB caching that I have been playing around with.... but so strange.

If you enabled the cache_db system setting, it could be worth trying to disable that. I never used that myself, but every now and then I see the core team recommending to turn it off.. not sure about the technical details.

Mark Hamstra • Developer spending his days working on Premium Extras and a MODX Site Dashboard with the ability to remotely upgrade MODX and extras to make the MODX world a little better.

Tweet me @mark_hamstra, check my infrequent blog at markhamstra.com, my slightly more frequent ramblings at MODX.today or see code at Github.

45 Posts

Qodo Reply #13, 14 years, 8 months ago

I just edited the archivist snippets to make them empty.

The homepage loads a little quicker:

Performance: 0.0000 s , 0 request(s), PHP: 2.6583 s , total: 2.6583 s , document retrieved from database

The main articles page now doesn't load at all so it seems it IS trying to build archives at the same time which would explain poor performance. I am going to try and edit the Articles snippet to remove the archives calls and see what happens!

Any other ideas welcomed!

One thing I was thinking of trying is a MASSIVE server setup to see if it can cope (ie 8GHz and 8Gb RAM)... do you think that would help?

Stewart
Freelance Web Designer & Developer:
http://www.qodo.co.uk

My extras:
TwitterX http://modx.com/extras/package/twitterx
TableOfContentsX http://modx.com/extras/package/tableofcontentsx

45 Posts

Qodo Reply #14, 14 years, 8 months ago

I noticed a slight improvement with db_cache as I configured MySQL to enable it and it seems a little quicker! I will experiment!

Stewart
Freelance Web Designer & Developer:
http://www.qodo.co.uk

My extras:
TwitterX http://modx.com/extras/package/twitterx
TableOfContentsX http://modx.com/extras/package/tableofcontentsx

MODX Staff
730 Posts

netProphET Reply #15, 14 years, 8 months ago

Qodo,
Do you have a plugin named phpThumbCacheManager?
If so, and if there are any thumbnails on these pages, try turning it off. The next uncached page load will be just as slow, but after that, the uncached page loads should be faster.

Mike Schell
Lead Developer, MODX Cloud
Email: [email protected]
GitHub: https://github.com/netProphET/
Twitter: @mkschell

45 Posts

Qodo Reply #16, 14 years, 8 months ago

Hi thanks for the reply, yes I have disabled the plugin and it helps when clearing cache.

The phpthumbof doesn't appear to be the problem. I think that it is because the entire Articles list is loaded using getArticles and then enclosed in getPage.

I am investigating...

Stewart
Freelance Web Designer & Developer:
http://www.qodo.co.uk

My extras:
TwitterX http://modx.com/extras/package/twitterx
TableOfContentsX http://modx.com/extras/package/tableofcontentsx

☆ A M B ☆
3,141 Posts

Mark Hamstra Reply #17, 14 years, 8 months ago

getPage passes a limit to getArticles (or whatever snippet you use), so that shouldn't be the case.

Did you disable/uninstall both tagLister and Archivist to see if that's the main cause like I suspect it to be?

Mark Hamstra • Developer spending his days working on Premium Extras and a MODX Site Dashboard with the ability to remotely upgrade MODX and extras to make the MODX world a little better.

Tweet me @mark_hamstra, check my infrequent blog at markhamstra.com, my slightly more frequent ramblings at MODX.today or see code at Github.

45 Posts

Qodo Reply #18, 14 years, 8 months ago

Yes I removed the calls from Articles that were:

//$container->getArchivistCall();
//$container->getLatestCommentsCall();
//$container->getLatestPostsCall();
//$container->getTagListerCall();

This helped a small amount but still very slow with 3000 articles...

Stewart
Freelance Web Designer & Developer:
http://www.qodo.co.uk

My extras:
TwitterX http://modx.com/extras/package/twitterx
TableOfContentsX http://modx.com/extras/package/tableofcontentsx

45 Posts

Qodo Reply #19, 14 years, 8 months ago

Ok I can now get the homepage to load in 4 seconds by removing Wayfinder from the navigation and changing some content from dynamic snippets to chunks.

On the article page I have found that the different between having a single snippet call and not time differences are:

[[getResources? &parents=`14` &resources=`-[[*id]]` &includeTVs=`1` &includeTVList=`Image` &sortby=`{"publishedon":"DESC"}` &limit=`5` &tpl=`ArticleRowMini` &showHidden=`1` &depth=`1` ]]

With snippet: 24 seconds
Without snippet: 4 seconds

Template:

[[$Header? &class=`article` &title=`[[*pagetitle]]` ]]
<div id="left">
  <div id="main">
    <h1>[[*pagetitle]]</h1>
    <p class="post-info">
      <span class="calendar">[[*publishedon:strtotime:date=`%b %d, %Y`]]</span>
      <span class="tags">[[+article_tags]]</span>
      <a href="[[~[[*id]]]]#comments" class="comments">Comments ([[+comments_count]])</a>
    </p>
    <p id="article_options">
      <a href="[[~17]]?aid=[[*id]]" class="button" id="sendtofriend">Send to friend</a>
    </p>
    <div class="entry">
      [[*content]]
    </div>
    <div class="post-comments" id="comments">
    [[+comments]]
    [[+comments_count:then=`<p>There are currently no comments on this article.</p>`]]
    <h3>Add a Comment</h3>
    [[+comments_form]]
    </div>
  </div>
</div>
<div id="right">
  [[$ad_right]]
  
  <div id="related_articles">
	<h3>Related [[getFirstTag? tag=`[[*articlestags]]` ]] Articles</h3>
    	<ul>
	  [[getResources? &parents=`14` &resources=`-[[*id]]` &includeTVs=`1` &includeTVList=`Image` &sortby=`{"publishedon":"DESC"}` &limit=`5` &tpl=`ArticleRowMini` &showHidden=`1` &depth=`1` ]]
	<ul>
  </div>
  [[$EmailSubscribe]]
</div>
[[$Footer]]

It REALLY seems like MODX hits some kind of wall and cannot cope with the extra request made by the snippet call...

Stewart
Freelance Web Designer & Developer:
http://www.qodo.co.uk

My extras:
TwitterX http://modx.com/extras/package/twitterx
TableOfContentsX http://modx.com/extras/package/tableofcontentsx

147 Posts

David Walker Reply #20, 14 years ago

Mark H, has there been any resolution to this? I'm about to start a similar exercise with 12,000 articles. I committed to MODX because Articles had supposedly solved the resource maximum problem.

David Walker
Principal, Shorewalker DMS
Phone: 03 8899 7790
Mobile: 0407 133 020