hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ratheesh Kamoor (JIRA)" <j...@apache.org>
Subject [jira] [Created] (HIVE-14925) MSCK repair table hang while running with multi threading enabled
Date Tue, 11 Oct 2016 02:40:20 GMT
Ratheesh Kamoor created HIVE-14925:
--------------------------------------

             Summary: MSCK repair table hang while running with multi threading enabled
                 Key: HIVE-14925
                 URL: https://issues.apache.org/jira/browse/HIVE-14925
             Project: Hive
          Issue Type: Bug
          Components: CLI
    Affects Versions: 2.2.0
            Reporter: Ratheesh Kamoor
            Priority: Critical


MSCK REPAIR TABLE hanging while running with multi-threading enabled (default). I think it
is because of a major design flaw in how thread pool implemented in HiveMetaSoreChecker class
/ checkPartitionDirs method. This method has a thread pool which register Callable but callable
makes a recursive call to checkPartitionDirs method again. This code will hang when number
of directories is more than thread pool size. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message