hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Shinichi Yamashita (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HIVE-13425) Fix partition addition in MSCK REPAIR TABLE command
Date Fri, 20 May 2016 06:59:12 GMT

     [ https://issues.apache.org/jira/browse/HIVE-13425?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Shinichi Yamashita updated HIVE-13425:
--------------------------------------
    Attachment: HIVE-13425.4.patch

Thank you for your comment.

I confirmed that msck command wasn't carryed out right in multiple partition by the previous
patch. I attach the patch file which corrected this problem.

In this patch, for example (a, b) partition, a=X/b=Y in HDFS is applied, but b=X/a=Y in HDFS
is not applied.

> Fix partition addition in MSCK REPAIR TABLE command
> ---------------------------------------------------
>
>                 Key: HIVE-13425
>                 URL: https://issues.apache.org/jira/browse/HIVE-13425
>             Project: Hive
>          Issue Type: Bug
>          Components: Metastore
>    Affects Versions: 2.0.0
>            Reporter: Shinichi Yamashita
>            Assignee: Shinichi Yamashita
>            Priority: Minor
>         Attachments: HIVE-13425.1.patch, HIVE-13425.2.patch, HIVE-13425.3.patch, HIVE-13425.4.patch
>
>
> I create a table in following HiveQL.
> {code}
> hive> create table example (name string) partitioned by (id int);
> {code}
> And, I make some directories about this table in HDFS.
> {code}
> [root@hadoop ~]# hdfs dfs -ls -R /user/hive/warehouse/example
> drwxr-xr-x   - root hadoop          0 2016-04-05 22:21 /user/hive/warehouse/example/id=1
> drwxr-xr-x   - root hadoop          0 2016-04-05 22:22 /user/hive/warehouse/example/id=1/id=2
> -rw-r--r--   1 root hadoop          8 2016-04-05 22:22 /user/hive/warehouse/example/id=1/id=2/example.txt
> {code}
> Next I executed MSCK REPAIR TABLE command and added a partition. And this result became
as follows.
> {code}
> [root@hadoop ~]# hive -e 'msck repair table example'
> OK
> Partitions not in metastore:	example:id=1/id=2
> Repair: Added partition to metastore example:id=1/id=2
> Time taken: 1.243 seconds, Fetched: 2 row(s)
> [root@hadoop ~]# hive -e 'show partitions example'
> OK
> id=2
> {code}
> "id=1" should be a partition, but "id=2" was added. I will fix this problem.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message