hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Chao Sun (JIRA)" <j...@apache.org>
Subject [jira] [Created] (HIVE-16060) GenericUDTFJSONTuple's HashCache could overgrown
Date Tue, 28 Feb 2017 19:59:45 GMT
Chao Sun created HIVE-16060:
-------------------------------

             Summary: GenericUDTFJSONTuple's HashCache could overgrown 
                 Key: HIVE-16060
                 URL: https://issues.apache.org/jira/browse/HIVE-16060
             Project: Hive
          Issue Type: Bug
          Components: UDF
            Reporter: Chao Sun
            Assignee: Chao Sun


At the moment the [cache object|https://github.com/apache/hive/blob/master/ql/src/java/org/apache/hadoop/hive/ql/udf/generic/GenericUDTFJSONTuple.java#L96]
used in {{GenericUDTFJSONTuple}} is a static linked hashmap that is not thread-safe. In the
case of HoS it may be accessed concurrently and has race conditions. In particular, its size
may overgrow even though the limit is 32. This can be observed from the attached image.

An easy way to fix it is to make it non-static.




--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

Mime
View raw message