hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Rajesh Balamohan (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-13901) Hivemetastore add partitions can be slow depending on filesystems
Date Tue, 14 Jun 2016 04:24:57 GMT

    [ https://issues.apache.org/jira/browse/HIVE-13901?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15328900#comment-15328900
] 

Rajesh Balamohan commented on HIVE-13901:
-----------------------------------------

These tests had multiple creations of HSMHandler creating threadpools often than needed. "hive.metastore.fshandler.threads"
can be a static daemon thread pool which can be shared in the same JVM. Will make the changes
along with rename and post it. 

> Hivemetastore add partitions can be slow depending on filesystems
> -----------------------------------------------------------------
>
>                 Key: HIVE-13901
>                 URL: https://issues.apache.org/jira/browse/HIVE-13901
>             Project: Hive
>          Issue Type: Sub-task
>          Components: Metastore
>            Reporter: Rajesh Balamohan
>            Assignee: Rajesh Balamohan
>            Priority: Minor
>         Attachments: HIVE-13901.1.patch, HIVE-13901.2.patch
>
>
> Depending on FS, creating external tables & adding partitions can be expensive (e.g
msck which adds all partitions).



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message