Is there any workaround for that or do I have to live with it?
That *is* the workaround: use a different browser. The problem occurs because when you are logged in, the manager manipulates your pages -- often the "QuickEdit" plugin is the culprit: when you’re logged in, it will inject its little widget that floats over your pages as you look through your site. You can disable that plugin if you don’t use its features, but other plugins might have a similar effect.
Either way, sinbad’s recommendation to check your pages in a browser you’re not logged into is a good one.