From mboxrd@z Thu Jan  1 00:00:00 1970
Return-Path: <gentoo-user+bounces-164160-garchives=archives.gentoo.org@lists.gentoo.org>
Received: from lists.gentoo.org (pigeon.gentoo.org [208.92.234.80])
	by finch.gentoo.org (Postfix) with ESMTP id E5E91138CCE
	for <garchives@archives.gentoo.org>; Tue,  5 May 2015 17:03:48 +0000 (UTC)
Received: from pigeon.gentoo.org (localhost [127.0.0.1])
	by pigeon.gentoo.org (Postfix) with SMTP id 0EC79E08A4;
	Tue,  5 May 2015 17:03:40 +0000 (UTC)
Received: from mail101c7.megamailservers.com (mail771.megamailservers.com [69.49.98.81])
	(using TLSv1.1 with cipher ECDHE-RSA-AES256-SHA (256/256 bits))
	(No client certificate requested)
	by pigeon.gentoo.org (Postfix) with ESMTPS id 03C94E081E
	for <gentoo-user@lists.gentoo.org>; Tue,  5 May 2015 17:03:39 +0000 (UTC)
X-POP-User: admin@sys-concept.com
X-VIP: 69.49.109.100
Received: from syscon7.localdomain (S01060050da7ae68c.ed.shawcable.net [68.149.90.13])
	by mail101c7.megamailservers.com (8.14.9/8.13.1) with ESMTP id t45H3aNL024825
	for <gentoo-user@lists.gentoo.org>; Tue, 5 May 2015 13:03:38 -0400
Received: by syscon7.localdomain (Postfix, from userid 1000)
	id E4B43201FFC; Tue,  5 May 2015 11:03:38 -0600 (MDT)
Date: Tue, 5 May 2015 11:03:38 -0600
From: Joseph <syscon780@gmail.com>
To: gentoo-user@lists.gentoo.org
Subject: Re: [gentoo-user] utf8_general_ci
Message-ID: <20150505170338.GC18758@syscon7>
References: <20150505153215.GA18758@syscon7>
 <BLU436-SMTP7462A63DAF5B9EAA3227FE8DD10@phx.gbl>
Precedence: bulk
List-Post: <mailto:gentoo-user@lists.gentoo.org>
List-Help: <mailto:gentoo-user+help@lists.gentoo.org>
List-Unsubscribe: <mailto:gentoo-user+unsubscribe@lists.gentoo.org>
List-Subscribe: <mailto:gentoo-user+subscribe@lists.gentoo.org>
List-Id: Gentoo Linux mail <gentoo-user.gentoo.org>
X-BeenThere: gentoo-user@lists.gentoo.org
Reply-to: gentoo-user@lists.gentoo.org
MIME-Version: 1.0
Content-Type: text/plain; charset=iso-8859-1; format=flowed
Content-Disposition: inline
In-Reply-To: <BLU436-SMTP7462A63DAF5B9EAA3227FE8DD10@phx.gbl>
User-Agent: Mutt/1.5.22 (2013-10-16)
X-CTCH-RefID: str=0001.0A020203.5548F7EA.0132,ss=1,re=0.000,recu=0.000,reip=0.000,cl=1,cld=1,fgs=0
X-CTCH-VOD: Unknown
X-CTCH-Spam: Unknown
X-CTCH-Score: 0.000
X-CTCH-Rules: 
X-CTCH-Flags: 0
X-CTCH-ScoreCust: 0.000
X-CSC: 0
X-CHA: v=2.1 cv=J5eTsmXS c=1 sm=1 tr=0 a=C3ZDv51cNVt4vJz/79I2xQ==:117
	a=C3ZDv51cNVt4vJz/79I2xQ==:17 a=SDcUNfBxAAAA:8 a=BDKbP5mgAAAA:8
	a=Unq3plm5DvEA:10 a=M1kyBYkWWGkA:10 a=8nJEP1OIZ-IA:10 a=pGLkceISAAAA:8
	a=h1PgugrvaO0A:10 a=zWEXFMfvHIVOj1YgbuoA:9 a=Ckt_sXRL7euNKiwp:21
	a=0aabJqJJa0EDXG7t:21 a=wPNLvfGTeEIA:10
X-Origin-Country: CA
X-Archives-Salt: 8673cc75-28ed-40a4-9196-c88b02ace2dd
X-Archives-Hash: b9e3218c782fc9f767df8593089dae37

On 05/05/15 12:32, Fernando Rodriguez wrote:
>On Tuesday, May 05, 2015 9:32:15 AM Joseph wrote:
>> I have my mysql database "Collation" set as: utf8_general_ci
>>
>> but when a customer from for example Japan places an order all I see is:
>>
>>
>&amp;#31481;&amp;#40763;&amp;#31435;&amp;#21407;&amp;#30010;&amp;#65301;&amp;#65293;&amp;#65301;
>>
>> Do I need to change "Collation" setting to something else or something else?
>>
>>
>
>I think that's because the web applications runs the data through something
>like php's htmlspecialchars() or similar to help prevent SQL injections. So
>you'll need to either decode it before using it (I think you can use the app-
>text/recode), or use a different method to filter anything that could be
>malicious SQL.

I've saved the relevant information into a TXT file (address.txt) and tried to run: recode ISO-8859-9..UTF8 < address.txt > address2.txt

&amp;#31481;&amp;#40763;&amp;#31435;&amp;#21407;&amp;#30010;&amp;#65301;&amp;#65293;&amp;#65301;
&amp;#23665;&amp;#31185;&amp;#21306;
&amp;#20140;&amp;#37117;&amp;#24066;, 601-8015
&amp;#20140;&amp;#37117;&amp;#24220;, Japan

It didn't help.  How do you run "recode" correctly?
Yes, the customer is using oscommerce php addlication to provide information.

-- 
Joseph