Character encoding

429 Posts

c-m Reply #1, 17 years, 4 months ago

I am working in a multilingual website at the moment. for the pages that have not yet been uploaded/translated I just have a holding page with holding text stating "Country website coming soon".

The problem is that for Russia, Ukraine, Bulgaria etc.. the cyrillic characters are showing as huh

?

e.g

Страница скоро открывается.

Is showing as:

???????? ????? ???????????.

Now i have checked my database and the character encoding is UTF-8.

Any idea on who to fix this easily?

634 Posts

Lammikko Reply #2, 17 years, 4 months ago

Are you using MODx 0.9.6.3?

Mikko Lammi, Owner at Maagit

171 Posts

etal Reply #3, 17 years, 4 months ago

How are the cyrillic characters showing up in the database (with phpmyadmin for example)?

Did you try using ’SET NAMES’ on your database connection to force it to be UTF-8?

429 Posts

c-m Reply #4, 17 years, 4 months ago

Hi I’m using modx 0.9.6.3 my database is UTF-8 SET_Names.

Now when i input either the text or the code into TinyMCE the characters show up just fine in the editor. But when previewed they show up as question marks. when veiwing the webpage source this shows just question marks rather than the code

Страница скоро открывается

634 Posts

Lammikko Reply #5, 17 years, 4 months ago

As you are using MODx 0.9.6.3 this is quite definitely database issue.

What does the system info say about database (from MODx manager: Reports > System Info)?

Look for "Database Charset" and "Database Collation Charset". Are they both utf-8?

Mikko Lammi, Owner at Maagit

429 Posts

c-m Reply #6, 17 years, 4 months ago

MODx version  	   	0.9.6.3
Version codename 	  	rev 4565
phpInfo() 	  	View
Access permissions 	  	Enabled
Server Time 	  	12:20:21
Local Time 	  	12:20:21
Server Offset 	  	0 h
Database name 	  	web248nature
Database server 	  	localhost
Database Version: 	  	5.1.33-community-log
Database Charset 	  	latin1
Database Collation Charset 	  	latin1_swedish_ci
Table prefix 	  	presspointproof_

160 Posts

rfoster Reply #7, 17 years, 4 months ago

This is a problem:

Database Charset 	  	latin1
Database Collation Charset 	  	latin1_swedish_ci

You should change this to

Database Charset 	  	utf
Database Collation Charset 	  	utf_unicode_ci

You should note though, that if you only change the default charset/collation for the db, it will not change the charset for existing tables...you will have to change this too. If you you haven’t put very much into MODx yet, and you still have trouble, it may be best just to empty the database and reinstall MODx. But make sure that the default charset/collation is set correctly on the db before installing.

429 Posts

c-m Reply #8, 17 years, 4 months ago

Ok so i change this in config.inc.php but how do i change it in the actual Mysql database?

I have over 170 pages in this installation. huh

429 Posts

c-m Reply #9, 17 years, 3 months ago

I have selecet utf_unicode_ci in the database but how do I now change all the tables?

SQL query:

ALTER TABLE `presspointproof_site_content` CHANGE `content` `content` MEDIUMTEXT CHARACTER SET utf8 COLLATE utf8_unicode_ci NULL DEFAULT NULL

MySQL said: Documentation
#1283 - Column 'content' cannot be part of FULLTEXT index

The answer is here:

http://answers.yahoo.com/question/index?qid=20090319040418AAGvbXz

Thanks

75 Posts

Amrit Reply #10, 17 years, 2 months ago

I also have a problem with character encoding, in TinyMCE, but only in the Link list.

I use MODx 0.9.6.3, and TinyMCE 3.2.4.1. (Same problem with all 3.x.x.x versions)

System Info states:
Database Charset utf8
Database Collation Charset utf8_general_ci

And yet, I cannot have swedish characters in Link list. Why?

This problem has been around for quite som time now, and there was a solution for 0.9.6.2, but I can´t find it, and seems like 0.9.6.3 is programmed differently.

Cheers
Amrit