View previous topic :: View next topic |
Author |
Message |
dodger10k Tux's lil' helper
Joined: 27 Jun 2003 Posts: 97
|
Posted: Wed Apr 19, 2006 10:13 am Post subject: |
|
|
Me again,
as this mixture of latin1 and utf8 gave me some disturbance (especially since the database HAS utf8 collation) I re-emerged mysql with utf8-support.
STILL DOESN'T WORK!!!
Here's the actual debug-output of the php-script, just in case...
Quote: |
The current character set is: utf8
Get the charset data: character_set_client -_-_- utf8
character_set_connection -_-_- utf8
character_set_database -_-_- utf8
character_set_results -_-_- utf8
character_set_server -_-_- utf8
character_set_system -_-_- utf8
character_sets_dir -_-_- /usr/share/mysql/charsets/
Get the collation data:
collation_connection -_-_- utf8_general_ci
collation_database -_-_- utf8_general_ci
collation_server -_-_- utf8_general_ci
|
This definitely is a horrible situation, there has to be some kind of solution?!? Maybe I´ve overlooked something??? |
|
Back to top |
|
|
llongi Retired Dev
Joined: 15 Apr 2004 Posts: 459 Location: Switzerland
|
Posted: Wed Apr 19, 2006 11:14 am Post subject: |
|
|
The idea here is that with the new MySQL and PHP you're able to set the charsets you want, so that you can bring the situation back to the old one, if you have problems. Now, knowing _what_ the old situation was, is a *must* here...
So if you set it all to latin1 or all to utf8, and still have problems, it's pretty obvious that before you didn't have all latin1 or all utf8. That the server charset changed is pretty hard, so it's probably the client (PHP) charset... So just experiment with the [client] default-character-set until it works (until you restore the mix of charsets it had before). _________________ Best regards, Luca. |
|
Back to top |
|
|
doc.twn n00b
Joined: 20 Nov 2002 Posts: 15 Location: Luxembourg
|
Posted: Wed Apr 19, 2006 1:07 pm Post subject: |
|
|
my configuration after the upgrade was exactly the same for mysql as before, latin1 everywhere.
yet, there was just one little detail... mbstring!
after the upgrade to 4.4.2-r1 all apache2 php modules on all my servers were compiled with '--disable-mbstring', i don't know why suddenly the mbstring extension was missing. before the update everything was working fine and the mbstring extension was always part of my php module.
now with 4.4.2-r1 i had to add the "unicode" use flag to get the mbstring extension back, and after that, everything just worked fine again.
so if you applied all the fixes mentioned in this thread and still got the same problems, as i did, please verify if the mbstring extension is activated in php. if it's not you apparently have to use the "unicode" useflag now to enable it.
maybe it will solve your "umlaut"-problems as well, at least it worked for me.
cheers _________________ Keyboard not found, Press F1 to continue... |
|
Back to top |
|
|
dodger10k Tux's lil' helper
Joined: 27 Jun 2003 Posts: 97
|
Posted: Wed Apr 19, 2006 1:33 pm Post subject: |
|
|
doc.twn wrote: | yet, there was just one little detail... mbstring!
[...]
maybe it will solve your "umlaut"-problems as well, at least it worked for me.
cheers |
Maaan, you just saved my day GREAT, it worked! After spending whole night trying to get this up and running again I finally can get some rest
Thanks, MATE! |
|
Back to top |
|
|
scdgro n00b
Joined: 16 Nov 2002 Posts: 56
|
Posted: Wed Apr 19, 2006 5:59 pm Post subject: |
|
|
THANKS YOU GENTOO !! I would rather say something that isn't allowed to say....
Ik also f*cked up my complete mysql database after upgrading to 14-r1
Lucky i got a backup. |
|
Back to top |
|
|
scdgro n00b
Joined: 16 Nov 2002 Posts: 56
|
Posted: Wed Apr 19, 2006 6:31 pm Post subject: |
|
|
Hmm. It seems that just emerging the 4.1.14 version solves all problems.
But ....
as long as you didn't have tried to alter the tables. Than you have a slighter bigger problem.. |
|
Back to top |
|
|
luispa Guru
Joined: 17 Mar 2006 Posts: 359 Location: España
|
Posted: Wed Apr 19, 2006 7:44 pm Post subject: |
|
|
Going to dev-lang/php-5.1.2-r1 and adding default-character-set=latin1 to my original my.cnf solved also the problem, however some articles I was playing with while trying to fix it (before knowing the solution) got definitely corrupted, and I need probably to retype all accents again (spanish).
Do you know of any migration tool, guide, or document, to convert all my current databases (latin1) to utf8?
thanks in advance,
luis |
|
Back to top |
|
|
jannis Guru
Joined: 05 Dec 2004 Posts: 340 Location: Germany / Bavaria / Aschaffenburg
|
Posted: Thu Apr 20, 2006 12:44 pm Post subject: |
|
|
Just one thing for you all to think about:
I got a mysql server running on my dedicated server and all the mysql- and PHP-stuff on this machine works. The PHP-engine reads the client-part of the my.cnf-file and displays the chars correctly (finally ).
But one problem still remains:
I've got one php-board (woltlab) running on a different server, getting the mysql-stuff from my dedicated server. And: yes, it CANNOT read the my.cnf (it doesn't even run gentoo, so doesn't have a patched php-version). And as you might guess, the "umlauts" are NOT displayed correctly.
Using the workaround Code: | [mysqld]
init-connect='SET NAMES latin1' | works but is defenitely just a workaround.
Any better solution for this case? |
|
Back to top |
|
|
doc.twn n00b
Joined: 20 Nov 2002 Posts: 15 Location: Luxembourg
|
Posted: Thu Apr 20, 2006 1:07 pm Post subject: |
|
|
scdgro wrote: |
Lucky i got a backup. |
how often did i say that already, i really started to discover the whole potential of my backup software since i started using gentoo.
after finally having resolved the charset problems, i already had to explain the whole situation to the management here and they were not pleased at all.
two hours later i update dev-php/smarty from 2.6.10 to 2.6.13, 2.6.10 used /usr/lib/php as the install dir but with 2.6.13 it changes to /usr/share/php. guess what, after the update all sites using smarty templates wor offline, again!
i noticed that with the switch from dev-php/php to dev-lang/php the pear directory moved to /usr/share/php as well. so i had to create a symlink between /usr/lib/php and /usr/share/php just to be safe. and later the pear shell command didn't work anymore.
and again i had to explain to management what happend. that was the last straw, we're considering switching our gentoo servers (about 30 servers) to another distro.
i really like gentoo, it's a great distro and has lots and lots of advantages. but it's just too risky to update, almost everytime you update there'll be some surprises. and it's a lot of maintenance, with everything changing every 6 months. especially the apache, php and mysql stuff. _________________ Keyboard not found, Press F1 to continue... |
|
Back to top |
|
|
uppe n00b
Joined: 04 Jul 2004 Posts: 18 Location: Sweden
|
Posted: Mon Apr 24, 2006 1:42 am Post subject: |
|
|
I was experiencing the exact same thing as the thread starter originally posted. ÅÄÖ was outputted as UTF-8 whether I wanted it to or not.
I found this quote in a similar thread. This worked perfectly for me. I used a mysql version of 5.0.19 though, but I guess the problem source is the same ^^
|
|
Back to top |
|
|
kitana_ann Tux's lil' helper
Joined: 04 Sep 2003 Posts: 117
|
Posted: Wed Apr 26, 2006 9:09 am Post subject: |
|
|
Hi, I am having this exact same problem.
I am wondering how I downgrade to mysql-4.1.14
What emerge command to I use?
Thanx for reply. |
|
Back to top |
|
|
jannis Guru
Joined: 05 Dec 2004 Posts: 340 Location: Germany / Bavaria / Aschaffenburg
|
Posted: Wed Apr 26, 2006 10:34 am Post subject: |
|
|
Please read the whole thread before you reply. Downgrading to 4.1.14 is possible but shouldn't be done. Either upgrade your PHP if you only have problems concerning PHP or use the "workaround" mentioned in this thread. |
|
Back to top |
|
|
kitana_ann Tux's lil' helper
Joined: 04 Sep 2003 Posts: 117
|
Posted: Wed Apr 26, 2006 12:56 pm Post subject: |
|
|
Yes, when I first replied I only thought there was one page on this thread. After I replied I saw there was 4 pages. I did not take away my post becouse I was so busy reading everything and trying to solve the problem at the same time.
So next time I will dubbel check |
|
Back to top |
|
|
SoylentGreen l33t
Joined: 19 Aug 2005 Posts: 904 Location: The Hostel
|
Posted: Wed Apr 26, 2006 1:04 pm Post subject: |
|
|
kitana_ann wrote: | trying to solve the problem at the same time.
|
well, *is* it solved for you now as well? please keep in mind that the developer is reading here as well.
for me it looks like this problem is meanwhile solved for everyone. |
|
Back to top |
|
|
kitana_ann Tux's lil' helper
Joined: 04 Sep 2003 Posts: 117
|
Posted: Wed Apr 26, 2006 1:32 pm Post subject: |
|
|
I am holding my fingers krossed still. I am right now emerging mysql-4.1.14-r1 again. And will do the same with php.
I started emerging PHP but it gives me this message:
Code: | emerge -pv php
These are the packages that I would merge, in order:
Calculating dependencies
!!! The short ebuild name "php" is ambiguous. Please specify
!!! one of the following fully-qualified ebuild names instead:
dev-lang/php
dev-php/php |
I am so imberessed to ask what the php packege is called. I ran a search on all php packages and I have none installed .
So, what does the package call |
|
Back to top |
|
|
SoylentGreen l33t
Joined: 19 Aug 2005 Posts: 904 Location: The Hostel
|
Posted: Wed Apr 26, 2006 1:47 pm Post subject: |
|
|
jesus fscking christ, why dont you read this thread first?
dev-lang/php is your pick. |
|
Back to top |
|
|
kitana_ann Tux's lil' helper
Joined: 04 Sep 2003 Posts: 117
|
Posted: Wed Apr 26, 2006 2:15 pm Post subject: |
|
|
I see I have to upgrade my PHP4 to PHP5. I get this error:
Code: | emerge -p dev-lang/php
These are the packages that I would merge, in order:
Calculating dependencies ...done!
[blocks B ] dev-php/mod_php (is blocking dev-lang/php-5.1.2-r1)
[blocks B ] dev-php/php (is blocking dev-lang/php-5.1.2-r1)
[ebuild N ] app-admin/php-toolkit-1.0-r2
[ebuild N ] dev-lang/php-5.1.2-r1 |
So I am folowing upp a new thread. Guess this will take some time. |
|
Back to top |
|
|
SoylentGreen l33t
Joined: 19 Aug 2005 Posts: 904 Location: The Hostel
|
Posted: Wed Apr 26, 2006 2:29 pm Post subject: |
|
|
would you mind using the searchfunctions, reading howtos, sticky post, and whatnot?
Code: |
[blocks B ] dev-php/mod_php (is blocking dev-lang/php-5.1.2-r1)
[blocks B ] dev-php/php (is blocking dev-lang/php-5.1.2-r1)
|
emerge -C dev-php/mod_php dev-php/php
emerge dev-lang/php
this is *basic* knowledge!
people have written HOWTOS and whatnot how to do this.
AND BACKUP YOUR SYSTEM FIRST !!! |
|
Back to top |
|
|
kitana_ann Tux's lil' helper
Joined: 04 Sep 2003 Posts: 117
|
Posted: Wed Apr 26, 2006 2:32 pm Post subject: |
|
|
Sorry for not knowing this. Thank you for your help.
I will try this. |
|
Back to top |
|
|
m27315 Apprentice
Joined: 10 Dec 2004 Posts: 253 Location: 2 workstations down
|
Posted: Thu Apr 27, 2006 1:53 pm Post subject: don't forget the new php style |
|
|
Code: | emerge dev-lang/php |
tries to pull in php5 for me. I really want php4, so I had to emerge it like so:
Code: | emerge =dev-lang/php-4* |
Otherwise, everything worked for me after performing these steps given here, earlier in this thread:
https://forums.gentoo.org/viewtopic-p-3254919.html#3254919
Plus, I rebooted to restart all the services cleanly...
In case you have not already, you may want to check out the PHP upgrade guide, in case you are still using old-school php (which you seem to be doing, kitana_ann):
http://www.gentoo.org/proj/en/php/php-upgrading.xml
I believe earlier instructions assume that you have upgraded. Plus, I think they assume you want to use php5, given my experience of it trying to pull in php5. |
|
Back to top |
|
|
lysergicacid Guru
Joined: 25 Nov 2003 Posts: 352 Location: The Universe,Virgo Super Cluster,Milky Way,Earth
|
|
Back to top |
|
|
jonfr Veteran
Joined: 20 Jul 2003 Posts: 1008 Location: Denmark
|
Posted: Fri Apr 28, 2006 2:17 pm Post subject: |
|
|
CHTEKK wrote: | We had a bug in the eclass, this bug made all older versions compile with latin1 as default charset. This was wrong. We fixed it, now the -r1's compile correctly with utf8 as default charset. Problem: your databases are in latin1 format. Solution: set the defatult-character-set in my.cnf to latin1. BUT this fixes it only for the mysql* stuff, PHP doesn't read my.cnf, so it tries to interpret stuff now as utf8, but you data is latin1 encoded --> TROUBLE! The fix we're working on is to make PHP read too my.cnf, so that if there you set latin1 as default, it will indeed use latin1 too. This may take a while to be done and tested et all, it was a problem we didn't foresee, sorry for that. Once all is ready and working as expected, PHP and MySQL will be both revbumped, the goal once that is done is the following: new installs will use utf8 for both PHP and MySQL, and that's it. For people like you that have still latin1 databases around, you then just need to set it in my.cnf, and it will work. |
Utf-8 is a bad format for anything that is not english. I don't even understan why utf-8 is even used. I know what it is ment to do, but i also know what i doesn't do. |
|
Back to top |
|
|
kybber Apprentice
Joined: 25 Jun 2002 Posts: 228 Location: Trondheim, Norway
|
Posted: Fri May 05, 2006 1:23 am Post subject: |
|
|
I have been having the same problem as everyone else here: phpBB spits out weird characters for æ, ø and å, the three special
Norwegian letters. I solved it by adding the line default-character-set=latin1 to the [client] section of my.cnf, as suggested in this
thread. But there is something I don't understand: The database seems to be utf8 all over, my.cnf mentions no other encoding
than utf8 in all sections except [client], and the test-script that was posted in this thread told me utf8 on all points before I added
the line under [client]. So if everything is set up to UTF8, including PHP which by default uses unicode, why on earth do I need to
force PHP to use latin1 in my.cnf? That just doesn't make any sense to me... Can someone please explain the rationale behind this?
Edit: One thing I find highly peculiar is that Drupal works fine regardless of client character set, wheras phpBB hates utf8 and needs
latin1. They ar both running on the same server. Since Drupal also uses PHP, is this an indication that it is really phpBB that is messed
up in my case? |
|
Back to top |
|
|
llongi Retired Dev
Joined: 15 Apr 2004 Posts: 459 Location: Switzerland
|
Posted: Fri May 05, 2006 9:52 am Post subject: |
|
|
Basically, the situation was like this, if you don't change anything:
BEFORE
mysql utf8, php latin1
NOW
mysql utf8, php utf8
(MySQL may vary, but PHP always was latin1)
So if you want things to be like before, you MUST set PHP back to latin1, by emerging the new version and setting the default charset in the [client] section of my.cnf. _________________ Best regards, Luca. |
|
Back to top |
|
|
kybber Apprentice
Joined: 25 Jun 2002 Posts: 228 Location: Trondheim, Norway
|
Posted: Fri May 05, 2006 10:41 am Post subject: |
|
|
Ah, thank you! I didn't know that PHP was Latin1 before - that explains it.
But... and there's always a but... that doesn't fully explain why Drupal works regardless of client setting, even though it uses PHP, while
phpBB is messed up?
Another funny thing is that if I set character encoding under client to be UTF8, thus messing up already existing æ, ø and å in phpBB,
and try to enter a post with one of those characters, the part of the post after and including the first such character disappears. I
would have assumed that phpBB would then just save the characters/post as UTF8, but apparently it doesn't.
This makes me feel a bit like this is a bandaid-solution. If I were to do a complete reinstall of everything today, wouldn't I then end up
with a system that has both MySQL and PHP with full UTF8 support and therefore no need to set character encoding to latin1 in my.cnf?If so, how would I be able to get to that point without reinstalling? I suppose if I were to dump the database, convert from latin1 to utf8
and then import it again, this would solve the current characters in pbpBB? That still leaves the problem with newly entered characters,
as I mentioned immediately above. |
|
Back to top |
|
|
|