hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Tao Li (JIRA)" <j...@apache.org>
Subject [jira] [Created] (HIVE-16979) Cache UGI for metastore
Date Wed, 28 Jun 2017 00:06:00 GMT
Tao Li created HIVE-16979:
-----------------------------

             Summary: Cache UGI for metastore
                 Key: HIVE-16979
                 URL: https://issues.apache.org/jira/browse/HIVE-16979
             Project: Hive
          Issue Type: Improvement
            Reporter: Tao Li


FileSystem.closeAllForUGI is called per request against metastore to dispose UGI, which involves
talking to HDFS name node and is time consuming. So the perf improvement would be caching
and reusing the UGI.

Per FileSystem.closeAllForUG call could take up to 20 ms as E2E latency against HDFS. Usually
a Hive query could result in several calls against metastore, so we can save up to 50-100
ms per hive query.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Mime
View raw message