hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Chao Sun (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HIVE-16060) GenericUDTFJSONTuple's json cache could overgrow beyond its limit
Date Tue, 28 Feb 2017 19:59:45 GMT

     [ https://issues.apache.org/jira/browse/HIVE-16060?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Chao Sun updated HIVE-16060:
----------------------------
    Summary: GenericUDTFJSONTuple's json cache could overgrow beyond its limit  (was: GenericUDTFJSONTuple's
HashCache could overgrown )

> GenericUDTFJSONTuple's json cache could overgrow beyond its limit
> -----------------------------------------------------------------
>
>                 Key: HIVE-16060
>                 URL: https://issues.apache.org/jira/browse/HIVE-16060
>             Project: Hive
>          Issue Type: Bug
>          Components: UDF
>            Reporter: Chao Sun
>            Assignee: Chao Sun
>
> At the moment the [cache object|https://github.com/apache/hive/blob/master/ql/src/java/org/apache/hadoop/hive/ql/udf/generic/GenericUDTFJSONTuple.java#L96]
used in {{GenericUDTFJSONTuple}} is a static linked hashmap that is not thread-safe. In the
case of HoS it may be accessed concurrently and has race conditions. In particular, its size
may overgrow even though the limit is 32. This can be observed from the attached image.
> An easy way to fix it is to make it non-static.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

Mime
View raw message