[gentoo-user] emacs and asian languages

[gentoo-user] emacs and asian languages

[David Relson]

I'm using emacs.22.1 and it's having trouble displaying asian
languages, specifically chinese and korean.

From the menus, using Options//Mule//ShowMultiLingualText, displays
Japanese correctly but shows boxes for Chinese and Korean characters.

Similarly, I've got a HelloWorld.java program that displays "Hello
World" in English, Chinese, Japanese, and Korean. This file displays
perfectly using Eclipse.  Emacs displays the japanese characters
without any problem.  4 of the 5 chinese characters are displayed
properly, with the 5th showing as a box.  All 8 korean characters show
up as boxes.  

FWIW, the strings show up properly in my mail reader (Claws-Mail).  The
strings are:

    zh: "____________"
    ja: "_____________________"
    ko: "____________ ______"

Can anybody identfy what's wrong and point me toward a solution?

Thanks.

David

Re: [gentoo-user] emacs and asian languages

[David Sveningsson]

[-- Attachment #1: Type: text/plain, Size: 1215 bytes --]

Citerar "David Relson" <relson@osagesoftware.com>:

> I'm using emacs.22.1 and it's having trouble displaying asian
> languages, specifically chinese and korean.
>
> From the menus, using Options//Mule//ShowMultiLingualText, displays
> Japanese correctly but shows boxes for Chinese and Korean characters.
>
> Similarly, I've got a HelloWorld.java program that displays "Hello
> World" in English, Chinese, Japanese, and Korean. This file displays
> perfectly using Eclipse.  Emacs displays the japanese characters
> without any problem.  4 of the 5 chinese characters are displayed
> properly, with the 5th showing as a box.  All 8 korean characters show
> up as boxes.
>
> FWIW, the strings show up properly in my mail reader (Claws-Mail).  The
> strings are:
>
>     zh: "____________"
>     ja: "_____________________"
>     ko: "____________ ______"
>
> Can anybody identfy what's wrong and point me toward a solution?
>
> Thanks.
>
> David
>
>

This sounds like a font issue to me. Can you see the characters  
correctly if you cat the files?

----------------------------------------------------------------
This message was sent using IMP, the Internet Messaging Program.

[-- Attachment #2: PGP Digital Signature --]
[-- Type: application/pgp-signature, Size: 189 bytes --]

Re: [gentoo-user] emacs and asian languages

[David Relson]

On Sun, 20 Jul 2008 22:29:15 +0200
David Sveningsson wrote:

> Citerar "David Relson" <relson@osagesoftware.com>:
> 
> > I'm using emacs.22.1 and it's having trouble displaying asian
> > languages, specifically chinese and korean.
> >
> > From the menus, using Options//Mule//ShowMultiLingualText, displays
> > Japanese correctly but shows boxes for Chinese and Korean
> > characters.
> >
> > Similarly, I've got a HelloWorld.java program that displays "Hello
> > World" in English, Chinese, Japanese, and Korean. This file displays
> > perfectly using Eclipse.  Emacs displays the japanese characters
> > without any problem.  4 of the 5 chinese characters are displayed
> > properly, with the 5th showing as a box.  All 8 korean characters
> > show up as boxes.
> >
> > FWIW, the strings show up properly in my mail reader (Claws-Mail).
> > The strings are:
> >
> >     zh: "____________"
> >     ja: "_____________________"
> >     ko: "____________ ______"
> >
> > Can anybody identfy what's wrong and point me toward a solution?
> >
> > Thanks.
> >
> > David
> >
> >
> 
> This sounds like a font issue to me. Can you see the characters  
> correctly if you cat the files?

Hi David,

Using a Gnome terminal and the default character set "Current Local
Ansi_X3.4-1968" all the asian characters are bad.  Using "Unicode
(UTF-8)" all look good.  So cat'ing _does_ work properly.

On the plus side, being able to display correctly in (1) a Gnome
terminal and (2) in Eclipse's source code window (which uses
"Monospace") and (3) in a Claws-Mail window indicates that all needed
fonts are available.

On the minus side, e experiments to change emacs' mule encoding to
ascii, chinese, and utf-8 don't seem to have any effect :-<

David

Re: [gentoo-user] emacs and asian languages

[David Relson]

On Sun, 20 Jul 2008 22:29:15 +0200
David Sveningsson wrote:

> Citerar "David Relson" <relson@osagesoftware.com>:
> 
> > I'm using emacs.22.1 and it's having trouble displaying asian
> > languages, specifically chinese and korean.
> >
> > From the menus, using Options//Mule//ShowMultiLingualText, displays
> > Japanese correctly but shows boxes for Chinese and Korean
> > characters.
> >
> > Similarly, I've got a HelloWorld.java program that displays "Hello
> > World" in English, Chinese, Japanese, and Korean. This file displays
> > perfectly using Eclipse.  Emacs displays the japanese characters
> > without any problem.  4 of the 5 chinese characters are displayed
> > properly, with the 5th showing as a box.  All 8 korean characters
> > show up as boxes.
> >
> > FWIW, the strings show up properly in my mail reader (Claws-Mail).
> > The strings are:
> >
> >     zh: "____________"
> >     ja: "_____________________"
> >     ko: "____________ ______"
> >
> > Can anybody identfy what's wrong and point me toward a solution?
> >
> > Thanks.
> >
> > David
> >
> >
> 
> This sounds like a font issue to me. Can you see the characters  
> correctly if you cat the files?

Hi David,

Using a Gnome terminal and the default character set "Current Local
Ansi_X3.4-1968" all the asian characters are bad.  Using "Unicode
(UTF-8)" all look good.  So cat'ing _does_ work properly.

On the plus side, being able to display correctly in (1) a Gnome
terminal and (2) in Eclipse's source code window (which uses
"Monospace") and (3) in a Claws-Mail window indicates that all needed
fonts are available.

On the minus side, e experiments to change emacs' mule encoding to
ascii, chinese, and utf-8 don't seem to have any effect :-<

And in an emacs *shell* window (with "mule...set UTF-8", the strings
show up like:

   String sh = "zh: \344\270\226\347\225u"\345\245\275";

which interprets as the octal codes corresponding to UTF-8 char. 

David

Re: [gentoo-user] emacs and asian languages

[David Sveningsson]

[-- Attachment #1: Type: text/plain, Size: 1793 bytes --]

David Relson skrev:
> On Sun, 20 Jul 2008 22:29:15 +0200
> David Sveningsson wrote:
>> This sounds like a font issue to me. Can you see the characters  
>> correctly if you cat the files?
> 
> Hi David,
> 
> Using a Gnome terminal and the default character set "Current Local
> Ansi_X3.4-1968" all the asian characters are bad.  Using "Unicode
> (UTF-8)" all look good.  So cat'ing _does_ work properly.
> 
> On the plus side, being able to display correctly in (1) a Gnome
> terminal and (2) in Eclipse's source code window (which uses
> "Monospace") and (3) in a Claws-Mail window indicates that all needed
> fonts are available.
> 
> On the minus side, e experiments to change emacs' mule encoding to
> ascii, chinese, and utf-8 don't seem to have any effect :-<
> 
> And in an emacs *shell* window (with "mule...set UTF-8", the strings
> show up like:
> 
>    String sh = "zh: \344\270\226\347\225u"\345\245\275";
> 
> which interprets as the octal codes corresponding to UTF-8 char. 
> 
> David
> 
> 

I assume you are using xemacs, does it work if you're not using xemacs 
(use the -nw flag when launching)? I have never used mule myself as it 
is not needed with emacs 22. Since everything seems to work in your 
terminal I cannot see why it wouldn't work in emacs, but I'm not an expert.

Just to be sure, have you followed the steps in 
http://www.gentoo.org/doc/en/utf-8.xml?
-- 


//*David Sveningsson [eXt]*

Freelance coder | Game Development Student
http://sidvind.com

Thou shalt make thy program's purpose and structure clear to thy fellow 
man by using the One True Brace Style, even if thou likest it not, for 
thy creativity is better used in solving problems than in creating 
beautiful new impediments to understanding.


[-- Attachment #2: OpenPGP digital signature --]
[-- Type: application/pgp-signature, Size: 260 bytes --]

Re: [gentoo-user] emacs and asian languages

[David Relson]

On Mon, 21 Jul 2008 00:34:29 +0200
David Sveningsson wrote:

> David Relson skrev:
> > On Sun, 20 Jul 2008 22:29:15 +0200
> > David Sveningsson wrote:
> >> This sounds like a font issue to me. Can you see the characters  
> >> correctly if you cat the files?
> > 
> > Hi David,
> > 
> > Using a Gnome terminal and the default character set "Current Local
> > Ansi_X3.4-1968" all the asian characters are bad.  Using "Unicode
> > (UTF-8)" all look good.  So cat'ing _does_ work properly.
> > 
> > On the plus side, being able to display correctly in (1) a Gnome
> > terminal and (2) in Eclipse's source code window (which uses
> > "Monospace") and (3) in a Claws-Mail window indicates that all
> > needed fonts are available.
> > 
> > On the minus side, e experiments to change emacs' mule encoding to
> > ascii, chinese, and utf-8 don't seem to have any effect :-<
> > 
> > And in an emacs *shell* window (with "mule...set UTF-8", the strings
> > show up like:
> > 
> >    String sh = "zh: \344\270\226\347\225u"\345\245\275";
> > 
> > which interprets as the octal codes corresponding to UTF-8 char. 
> > 
> > David
> > 
> > 
> 
> I assume you are using xemacs, does it work if you're not using
> xemacs (use the -nw flag when launching)? I have never used mule
> myself as it is not needed with emacs 22. Since everything seems to
> work in your terminal I cannot see why it wouldn't work in emacs, but
> I'm not an expert.
> 
> Just to be sure, have you followed the steps in 
> http://www.gentoo.org/doc/en/utf-8.xml?
> -- 

I've got both emacs and xemacs installed.  Using xemacs, most of the
chinese, japanese, and korean characters show up as hex codes like
\226.  emacs does the better job (with japanese being correct).

I've looked at the utf-8.xml page and what I've got is a combination of
en_US.UTF-8 and "C" (see the end of this message).

My 2.6.24 kernel has iso8859-1 as its default and I'm rebuilding with
UTF-8 as the default to see if this helps.

Regards,

David

****************************************************
In /etc/locale.gen is:

    en_US.UTF-8 UTF-8

In /etc/profile.env is:

    export LANG='en_US.UTF-8'

In /etc/env.d/02locale.gen is:

    LANG="en_US.UTF-8"

"env-update" and "source /etc/profile" have been run.

Running "locale" reports:

    LANG=en_US.UTF-8
    LC_CTYPE="C"
    LC_NUMERIC="C"
    LC_TIME="C"
    LC_COLLATE="C"
    LC_MONETARY="C"
    LC_MESSAGES="C"
    LC_PAPER="C"
    LC_NAME="C"
    LC_ADDRESS="C"
    LC_TELEPHONE="C"
    LC_MEASUREMENT="C"
    LC_IDENTIFICATION="C"
    LC_ALL=C

Running "locale -a" reports:

    C
    POSIX
    en_US.utf8

Re: [gentoo-user] emacs and asian languages

[Hong Hao]

On Sun, Jul 20, 2008 at 08:09:24PM -0400, David Relson wrote:
> Running "locale -a" reports:
> 
>     C
>     POSIX
>     en_US.utf8
> 
Hi,

I'm not sure about your problem. emacs-cvs-23 support unicode it works
like a charm on my laptop (both Chinese an Korean characters shows
correctly here, I don't need any extra setup just install CJK fonts
is enough.) You might give it try.

Regards

   oahong
-- 
Hong Hao                oahong@gmail.com

Re: [gentoo-user] emacs and asian languages

[David Sveningsson]

[-- Attachment #1: Type: text/plain, Size: 2107 bytes --]

David Relson skrev:
> 
> I've got both emacs and xemacs installed.  Using xemacs, most of the
> chinese, japanese, and korean characters show up as hex codes like
> \226.  emacs does the better job (with japanese being correct).
> 
> I've looked at the utf-8.xml page and what I've got is a combination of
> en_US.UTF-8 and "C" (see the end of this message).
> 
> My 2.6.24 kernel has iso8859-1 as its default and I'm rebuilding with
> UTF-8 as the default to see if this helps.
> 
> Regards,
> 
> David
> 
> ****************************************************
> In /etc/locale.gen is:
> 
>     en_US.UTF-8 UTF-8
> 
> In /etc/profile.env is:
> 
>     export LANG='en_US.UTF-8'
> 
> In /etc/env.d/02locale.gen is:
> 
>     LANG="en_US.UTF-8"
> 
> "env-update" and "source /etc/profile" have been run.
> 
> Running "locale" reports:
> 
>     LANG=en_US.UTF-8
>     LC_CTYPE="C"
>     LC_NUMERIC="C"
>     LC_TIME="C"
>     LC_COLLATE="C"
>     LC_MONETARY="C"
>     LC_MESSAGES="C"
>     LC_PAPER="C"
>     LC_NAME="C"
>     LC_ADDRESS="C"
>     LC_TELEPHONE="C"
>     LC_MEASUREMENT="C"
>     LC_IDENTIFICATION="C"
>     LC_ALL=C
> 
> Running "locale -a" reports:
> 
>     C
>     POSIX
>     en_US.utf8
> 
> 
> 

Try running emacs like this:
LC_ALL="en_US.UTF-8" emacs -nw

If that doesn't help I have no idea why it doesn't work. I am able to 
display Japanese, Chinese and Korean with xterm (with unicode enabled) 
and LC_ALL and LANG set to "sv_SE.utf8".

However, in my .emacs file I have these lines (but I don't think they 
are required any longer):

(set-default-coding-systems 'utf-8)
(set-terminal-coding-system 'utf-8)
(set-keyboard-coding-system 'utf-8)

-- 


//*David Sveningsson [eXt]*

Freelance coder | Game Development Student
http://sidvind.com

Thou shalt make thy program's purpose and structure clear to thy fellow 
man by using the One True Brace Style, even if thou likest it not, for 
thy creativity is better used in solving problems than in creating 
beautiful new impediments to understanding.


[-- Attachment #2: OpenPGP digital signature --]
[-- Type: application/pgp-signature, Size: 260 bytes --]

Re: [gentoo-user] emacs and asian languages

[David Relson]

On Mon, 21 Jul 2008 15:49:53 +0200
David Sveningsson wrote:

...[snip]...

> Try running emacs like this:
> LC_ALL="en_US.UTF-8" emacs -nw

That works nicely!

> If that doesn't help I have no idea why it doesn't work. I am able to 
> display Japanese, Chinese and Korean with xterm (with unicode
> enabled) and LC_ALL and LANG set to "sv_SE.utf8".
> 
> However, in my .emacs file I have these lines (but I don't think they 
> are required any longer):
> 
> (set-default-coding-systems 'utf-8)
> (set-terminal-coding-system 'utf-8)
> (set-keyboard-coding-system 'utf-8)

Doesn't seem to have any effect ...


Thanks!

Re: [gentoo-user] emacs and asian languages

[David Sveningsson]

[-- Attachment #1: Type: text/plain, Size: 1364 bytes --]

David Relson skrev:
> On Mon, 21 Jul 2008 15:49:53 +0200
> David Sveningsson wrote:
> 
> ...[snip]...
> 
>> Try running emacs like this:
>> LC_ALL="en_US.UTF-8" emacs -nw
> 
> That works nicely!
> 

For reference:
Depending on whenever you want to set this setting sitewide or not you 
can put LC_ALL="en_US.UTF-8" in either /etc/env.d/02locale or in your 
your profile (~/.bash_profile or similar). Check with locale that LC_ALL 
has changed to en_US.UTF-8 for all fields.

>> If that doesn't help I have no idea why it doesn't work. I am able to 
>> display Japanese, Chinese and Korean with xterm (with unicode
>> enabled) and LC_ALL and LANG set to "sv_SE.utf8".
>>
>> However, in my .emacs file I have these lines (but I don't think they 
>> are required any longer):
>>
>> (set-default-coding-systems 'utf-8)
>> (set-terminal-coding-system 'utf-8)
>> (set-keyboard-coding-system 'utf-8)
> 
> Doesn't seem to have any effect ...
> 
> 
> Thanks!
> 
> 


-- 


//*David Sveningsson [eXt]*

Freelance coder | Game Development Student
http://sidvind.com

Thou shalt make thy program's purpose and structure clear to thy fellow 
man by using the One True Brace Style, even if thou likest it not, for 
thy creativity is better used in solving problems than in creating 
beautiful new impediments to understanding.


[-- Attachment #2: OpenPGP digital signature --]
[-- Type: application/pgp-signature, Size: 260 bytes --]