hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Eugene Koifman (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HIVE-8914) HDFSCleanup thread holds reference to FileSystem
Date Wed, 14 Jan 2015 02:47:34 GMT

     [ https://issues.apache.org/jira/browse/HIVE-8914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Eugene Koifman updated HIVE-8914:
---------------------------------
    Fix Version/s: 0.15.0

> HDFSCleanup thread holds reference to FileSystem
> ------------------------------------------------
>
>                 Key: HIVE-8914
>                 URL: https://issues.apache.org/jira/browse/HIVE-8914
>             Project: Hive
>          Issue Type: Bug
>          Components: WebHCat
>    Affects Versions: 0.13.1
>            Reporter: shanyu zhao
>            Assignee: shanyu zhao
>             Fix For: 0.15.0
>
>         Attachments: HIVE-8194.1.patch, HIVE-8914.patch
>
>
> WebHCat server has a long running cleanup thread (HDFSCleanup) which holds a reference
to FileSystem. Because of this reference, many FileSystem related objects (e.g. MetricsSystemImpl)
cannot be garbage collected. Sometimes this causes OOM exception. Since the cleanup is done
every 12 hours by default, we can simply recreate a FileSystem when we need to use it.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message