hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Xiaobing Zhou (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-8550) Hive cannot load data into partitioned table with Unicode key
Date Tue, 21 Oct 2014 23:46:34 GMT

    [ https://issues.apache.org/jira/browse/HIVE-8550?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14179334#comment-14179334
] 

Xiaobing Zhou commented on HIVE-8550:
-------------------------------------

Good news, nvarchar really matters. Query runs fine as long as table is created with columns
as nvarchar data types.
I tried two approaches:
1. alter package.jdo (DataNucleus O/R mapping xml) to use nvarchar, re-compile and ship hive-metastore
jar for deployment, there some serious exceptions while launching hive CLI. Something from
JDO are out of our control.
2. update hive-schema-0.13.0.mssql.sql to nvarchar specification, drop metastore DB, and manually
create it, but keep package.jdo mapping file unchanged. This works fine.

Next step is to think about how to maintain compatability, e.g. old schema upgraded to new
schema.

> Hive cannot load data into partitioned table with Unicode key
> -------------------------------------------------------------
>
>                 Key: HIVE-8550
>                 URL: https://issues.apache.org/jira/browse/HIVE-8550
>             Project: Hive
>          Issue Type: Bug
>         Environment: Windows
>            Reporter: Xiaobing Zhou
>            Priority: Critical
>         Attachments: CreatePartitionedTable.hql, LoadIntoPartitionedTable.hql, partitioned.txt
>
>
> Steps to reproduce:
> 1) Copy the file partitioned.txt to the root folder of your HDFS root dir. Copy the two
hql files to your local directory.
> 2) Open Hive CLI.
> 3) Run:
> hive> source <path to CreatePartitionedTable.hql>;
> 4) Run 
> hive> source <path to LoadIntoPartitionedTable.hql>;
> The following error will be shown:
> hive> source C:\Scripts\partition\LoadIntoPartitionedTable.hql;
> Loading data to table default.mypartitioned partition (tag=䶵)
> Failed with exception null
> FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.MoveTask



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message