Mailing-List: contact dev-help@hive.apache.org; run by ezmlm
Precedence: bulk
Reply-To: dev@hive.apache.org
Date: Wed, 15 Feb 2017 11:56:41 +0000 (UTC)
From: "JaySenSharma (JIRA)" <jira@apache.org>
To: dev@hive.apache.org
Message-ID: <JIRA.13043237.1487159766000.86069.1487159801681@Atlassian.JIRA>
In-Reply-To: <JIRA.13043237.1487159766000@Atlassian.JIRA>
References: <JIRA.13043237.1487159766000@Atlassian.JIRA> <JIRA.13043237.1487159766037@jira-lw-us.apache.org>
Subject: [jira] [Created] (HIVE-15927) HIve does not insert UTF-8 characters
 properly when insert query is triggered.
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: quoted-printable
archived-at: Wed, 15 Feb 2017 11:56:55 -0000

JaySenSharma created HIVE-15927:
-----------------------------------

             Summary: HIve does not insert UTF-8 characters properly when i=
nsert query is triggered.
                 Key: HIVE-15927
                 URL: https://issues.apache.org/jira/browse/HIVE-15927
             Project: Hive
          Issue Type: Bug
          Components: Hive
    Affects Versions: 1.2.1, 1.2.0
         Environment: All
            Reporter: JaySenSharma


-=20
If we create a table as following from Ambari Hive View (or using any other=
 approach)

{code}
CREATE TABLE IF NOT EXISTS currency2 (id int, name string) ROW FORMAT SERDE=
 'org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe' WITH SERDEPROPERTIES(=
"serialization.encoding"=3D'UTF-8','store.charset'=3D'UTF-8', 'retrieve.cha=
rset'=3D'UTF-8');

INSERT INTO currency2 VALUES (1, "=C2=A3=E2=82=AC=E2=82=A1");

SELECT * FROM currency2;
{code}


- Output from ambari side is attached as "Result.png"

Here we see that the queries were sent to the "hive" correctly as we see th=
e following entries appear in the "hiveserver2.log"
{code}
ssh root@hiveserevr2host
cd /var/log/hive
tail -f hiveserver2.log
{code}

Output of the log shows that hiveserver2 received the proper insert query s=
tatements from Ambari Hive View.

{code}
2017-01-25 09:25:27,589 INFO  [HiveServer2-Handler-Pool: Thread-60]: parse.=
ParseDriver (ParseDriver.java:parse(185)) - Parsing command: INSERT INTO cu=
rrency2 VALUES (1, "=C2=A3=E2=82=AC=E2=82=A1")

2017-01-25 09:25:28,337 INFO  [HiveServer2-Background-Pool: Thread-244]: ex=
ec.Task (TezTask.java:build(316)) - Dag name: INSERT INTO currency2 VALUES =
(1, "=C2=A3=E2=82=AC=E2=82=A1")(Stage-1)

2017-01-25 09:25:28,694 INFO  [HiveServer2-Background-Pool: Thread-244]: cl=
ient.TezClient (TezClient.java:submitDAGSession(577)) - Submitted dag to Te=
zSession, sessionName=3DHIVE-bf038f08-853a-4850-80bc-7a6eaded3c2d, applicat=
ionId=3Dapplication_1485333705258_0007, dagName=3DINSERT INTO c
urrency1 VALUES (1, "=C2=A3=E2=82=AC=E2=82=A1")(Stage-1)
{code}

- Even the beeline fails to show the correct entry:
{code}
[root@erie3 ~]# su - hive

[hive@erie3 root]$ beeline
Beeline version 1.2.1000.2.5.3.0-37 by Apache Hive

beeline> !connect jdbc:hive2://erie3.example.com:2181,erie1.example.com:218=
1,erie4.example.com:2181,erie2.example.com:2181/;serviceDiscoveryMode=3Dzoo=
Keeper;zooKeeperNamespace=3Dhiveserver2

0: jdbc:hive2://erie3.example.com:2181,erie1.> SELECT * FROM currency2;
+---------------+-----------------+--+
| currency2.id  | currency2.name  |
+---------------+-----------------+--+
| 1             | =EF=BF=BD=EF=BF=BD=EF=BF=BD             |
+---------------+-----------------+--+

{code}


--
This message was sent by Atlassian JIRA
(v6.3.15#6346)