Welcome, Visitor!

• Home
• Forum
• Songs
• Song Sources
• Song Platforms
• Artists
• Groups
• Labels
• Compilations
• Screenshots
• Licenses
• Tags
• Statistics
• Queue
•  
• Search For Something
• Latest Uploads
• Recent Updates
•  
• FAQ
• Links
• Simple Chat

Infamous OneLiner

Who's Currently Online?

There are currently 2 users online:

Hneet , LimeProselyte

User Menu

• Log In / Register

Now Playing

Noname by Anty
Requested By: djrandom

Time Left: 3:35

Rating: 4.11 (9 Votes)

Development Area » Unicode support

Author	Thread
Falken Falken / brainstorm 48 Posts #374 (13 years, 6 months ago)	I'll be blunt: CVGM *needs* unicode support. And it needed it yesterday. I haven't been very vocal about this since it's really only affected me (Japanese text gets converted to '?' marks), and I've only dealt with it happening on the oneliner. But about a week ago, I had an interesting idea to add the proper kanji for the names of Japanese artists as their nickname, leaving the romaji/English version intact. Sadly, even changing the name from the Admin panel still results in '?' marks for the kanji, so I gave up. Finally, today, I realized I'm no longer the only one who's had to deal with this issue. Starpilot uploaded a new compilation Derecha last night, and the non-English characters in the song names are thrown out and converted to '?' marks. From what I can tell, this looks like it's a web server related configuration issue, or at least something local, as Demovibes (@scenemusic.net) doesn't have any problem with Japanese characters at all. This really, really, reeeeaaally needs to be fixed. If I can help with the server configuration in any way, or do any kind of testing/troubleshooting, please let me know.
	Quote
jyooruje Coimbra 34 Posts #375 (13 years, 6 months ago)	Yep i saw that caracters on the Starpilot uploads. I think that they are portuguese caracters, let me try Não. São. Característica. Well they work here.
	Quote
Falken Falken / brainstorm 48 Posts #376 (13 years, 6 months ago)	Hmm, never tested the forums... Japanese text: ???
	Quote
Falken Falken / brainstorm 48 Posts #377 (13 years, 6 months ago)	No love here. There's something interesting I noticed though: the number of question marks is exactly equal to the glyph count. If not interpreted as unicode, kanji characters (which I entered above) are multibyte. This means that for the 3 kanji I entered above, there should be at least 6 question marks, but there aren't. This leads me to think that the web server is properly reading and processing everything as Unicode, but the storage (the database backend) is not. What SQL server is CVGM using? If it's MySQL, it might just be that the collation for the tables is set incorrectly.
	Quote
FishGuy876 FishGuy876 / Brainstorm 484 Posts #382 (13 years, 6 months ago)	I think it is just that the database is not in a format that supports the unicode properly, probbably latin1 and needs converted to utf-8. I need to figure out how to do this on the site and set it up properly when I get some free time
	Quote
FishGuy876 FishGuy876 / Brainstorm 484 Posts #385 (13 years, 5 months ago)	Unicode support has now been added. After wasting an hour farting with PHPMyAdmin I found a script that converted the database for me. I should now be able to do crazy shit like: 子曰：「學而時習之，不亦說乎？有朋自遠方來，不亦樂乎？ 人不知而不慍，不亦君子乎？」 有子曰：「其為人也孝弟，而好犯上者，鮮矣； 不好犯上，而好作亂者，未之有也。君子務本，本立而道生。 孝弟也者，其為仁之本與！」 or even: ٱلْحَمْدُ لِلّٰهِ رَبِّ ٱلْعَالَمِينَ ٱلرَّحْمـَبنِ ٱلرَّحِيمِ مَـالِكِ يَوْمِ ٱلدِّينِ إِيَّاكَ نَعْبُدُ وَإِيَّاكَ نَسْتَعِينُ ٱهْدِنَــــا ٱلصِّرَاطَ ٱلمُسْتَقِيمَ صِرَاطَ ٱلَّذِينَ أَنعَمْتَ عَلَيهِمْ غَيرِ ٱلمَغضُوبِ عَلَيهِمْ وَلاَ ٱلضَّالِّينَ And maybe even: По оживлённым берегам Громады стройные теснятся Дворцов и башен; корабли Толпой со всех концов земли К богатым пристаням стремятся; Im not sure what it means, but it should display fine
	Quote
FishGuy876 FishGuy876 / Brainstorm 484 Posts #386 (13 years, 5 months ago)	Yup, displaying fine here
	Quote
Falken Falken / brainstorm 48 Posts #387 (13 years, 5 months ago)	The oneliner works fine, let's try some Japanese... あいうえおカキクケコ日本語
	Quote
Falken Falken / brainstorm 48 Posts #388 (13 years, 5 months ago)	I'd say it's fixed. Awesome work, Fishy! Thanks!! \o/
	Quote
Falken Falken / brainstorm 48 Posts #389 (13 years, 5 months ago)	I've fixed the song names in Derecha, and added proper Japanese names for Nobuo Uematsu (植松 伸夫) , Kazumi Totaka (戸高 一生) and Norio Hanzawa (半沢 紀夫) , for now. The only slightly odd thing I noticed is that the true Japanese names don't appear in parenthesis until after the song is requested -- you can see what I mean by looking at any of these Artist's pages. I guess Demovibes has some internal update system that doesn't take affect until after a song has been in the queue?
	Quote
Falken Falken / brainstorm 48 Posts #447 (13 years, 1 month ago)	I just tried editing a song's information, and added some Japanese characters to the text. When I went to approve the change, the characters were changed to question marks. So here's a test to see if Unicode broke again recently: 日本語テスト
	Quote
Falken Falken / brainstorm 48 Posts #448 (13 years, 1 month ago)	Looks like Unicode is still working fine for the forums and the oneliner, so something must be broken on the edit information page. I'll use the Admin interface directly for now, I guess...
	Quote
Falken Falken / brainstorm 48 Posts #449 (13 years, 1 month ago)	Right, so I can't use the Admin interface for song info changes anymore. Here's the song which needs to be fixed: SuPeiNJin
	Quote

Reply To This Forum Post

Before posting a new, or replying to a forum topic, please be mindful of the following simple rules:

• Automated robots and spammers are not allowed to post on CVGM. Don't bother. Go peddle your crap elsewhere.
• Posts should not be hurtful, derogatory or rude towards other members. Avoid topics referring to Politics, Religion and other subjects that may be upsetting or uncomfortable to other members.
• Anyone found to be breaking any of these rules may be banned by a moderator at any time. You have been warned!!
• Think before you post - Don't say anything you might regret later!

Forum posts can include highlighting and other fancy commands for embedding content, songs and groups etc. To learn more about how to use the BBCode features in your post, take a read Here on the forums to see how they look!

Please log in to post a reply.