hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Pengcheng Xiong (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-14925) MSCK repair table hang while running with multi threading enabled
Date Tue, 11 Oct 2016 03:40:21 GMT

    [ https://issues.apache.org/jira/browse/HIVE-14925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15564334#comment-15564334
] 

Pengcheng Xiong commented on HIVE-14925:
----------------------------------------

When we implemented this, we tried to reuse the thread pool. Is it possible for you to provide
us a reproduce case? Thanks.

> MSCK repair table hang while running with multi threading enabled
> -----------------------------------------------------------------
>
>                 Key: HIVE-14925
>                 URL: https://issues.apache.org/jira/browse/HIVE-14925
>             Project: Hive
>          Issue Type: Bug
>          Components: CLI
>    Affects Versions: 2.2.0
>            Reporter: Ratheesh Kamoor
>            Priority: Critical
>
> MSCK REPAIR TABLE hanging while running with multi-threading enabled (default). I think
it is because of a major design flaw in how thread pool implemented in HiveMetaSoreChecker
class / checkPartitionDirs method. This method has a thread pool which register Callable but
callable makes a recursive call to checkPartitionDirs method again. This code will hang when
number of directories is more than thread pool size. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message