hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ashutosh Chauhan (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-15803) msck can hang when nested partitions are present
Date Mon, 06 Feb 2017 21:31:42 GMT

    [ https://issues.apache.org/jira/browse/HIVE-15803?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15854778#comment-15854778
] 

Ashutosh Chauhan commented on HIVE-15803:
-----------------------------------------

I agree with [~rajesh.balamohan] suggestion to pass on null for thread pull in recursive call.
It will mean parallelism will be limited to number of distinct dirs in first level, but that
will be better than single threaded execution as well as hangs.
[~pxiong] What do you think?

> msck can hang when nested partitions are present
> ------------------------------------------------
>
>                 Key: HIVE-15803
>                 URL: https://issues.apache.org/jira/browse/HIVE-15803
>             Project: Hive
>          Issue Type: Bug
>          Components: Metastore
>            Reporter: Rajesh Balamohan
>            Assignee: Rajesh Balamohan
>            Priority: Minor
>
> Steps to reproduce. 
> {noformat}
> CREATE TABLE `repairtable`( `col` string) PARTITIONED BY (  `p1` string,  `p2` string)
> hive> dfs -mkdir -p /apps/hive/warehouse/test.db/repairtable/p1=c/p2=a/p3=b;
> hive> dfs -touchz /apps/hive/warehouse/test.db/repairtable/p1=c/p2=a/p3=b/datafile;
> hive> set hive.mv.files.thread;
> hive.mv.files.thread=15
> hive> set hive.mv.files.thread=1;
> hive> MSCK TABLE repairtable;
> {noformat}



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

Mime
View raw message