hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Xiaobing Zhou (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-8550) Hive cannot load data into partitioned table with Unicode key
Date Fri, 31 Oct 2014 00:16:35 GMT

    [ https://issues.apache.org/jira/browse/HIVE-8550?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14191083#comment-14191083
] 

Xiaobing Zhou commented on HIVE-8550:
-------------------------------------

Confirmed two concerns from [~jdere]:
1. legacy system(varchar typed column) with non-unicode partition data in DB, running nvarchar
upgrade, patch works well for unicode partitioned table creation and data loading.
2. run some samples queries on PARTITIONS table to make sure index is still working after
upgrade.

For case 1, smoothy upgrade is seen; For case 2, I ran query on MSSQL, 
{noformat}
select * from dbo.PARTITIONS where part_name = 'ds=2008-04-08/hr=11' and TBL_ID = 7;
{noformat}
, the execution plans include index seek on the [PARTITIONS].[UNIQUEPARTITION] which is NonClustered
index on part_name and TBL_ID. This is good certificate that index is working well after upgrade.

So It's safe to commit it.

> Hive cannot load data into partitioned table with Unicode key
> -------------------------------------------------------------
>
>                 Key: HIVE-8550
>                 URL: https://issues.apache.org/jira/browse/HIVE-8550
>             Project: Hive
>          Issue Type: Bug
>    Affects Versions: 0.14.0
>         Environment: Windows
>            Reporter: Xiaobing Zhou
>            Assignee: Xiaobing Zhou
>            Priority: Critical
>         Attachments: CreatePartitionedTable.hql, HIVE-8550.1.patch, HIVE-8550.2.patch,
HIVE-8550.3.patch, LoadIntoPartitionedTable.hql, partitioned.txt
>
>
> Steps to reproduce:
> 1) Copy the file partitioned.txt to the root folder of your HDFS root dir. Copy the two
hql files to your local directory.
> 2) Open Hive CLI.
> 3) Run:
> hive> source <path to CreatePartitionedTable.hql>;
> 4) Run 
> hive> source <path to LoadIntoPartitionedTable.hql>;
> The following error will be shown:
> hive> source C:\Scripts\partition\LoadIntoPartitionedTable.hql;
> Loading data to table default.mypartitioned partition (tag=䶵)
> Failed with exception null
> FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.MoveTask



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message