hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Gopal V (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HIVE-5345) Operator::close() leaks Operator::out, holding reference to buffers
Date Mon, 23 Sep 2013 21:03:03 GMT

     [ https://issues.apache.org/jira/browse/HIVE-5345?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Gopal V updated HIVE-5345:
--------------------------

    Release Note: Prevent  OutputCollector leaks from an Operator by clearing the Operator::out
reference on close()
          Status: Patch Available  (was: Open)
    
> Operator::close() leaks Operator::out, holding reference to buffers
> -------------------------------------------------------------------
>
>                 Key: HIVE-5345
>                 URL: https://issues.apache.org/jira/browse/HIVE-5345
>             Project: Hive
>          Issue Type: Bug
>          Components: Query Processor
>    Affects Versions: 0.13.0
>         Environment: Ubuntu, LXC, jdk6-x86_64
>            Reporter: Gopal V
>            Assignee: Gopal V
>              Labels: memory-leak
>         Attachments: HIVE-5345.01.patch, out-leak.png
>
>
> When processing multiple splits on the same operator pipeline, the output collector in
Operator has a held reference, which causes issues.
> Operator::close() does not de-reference the OutputCollector object Operator::out held
by the object.
> This means that trying to allocate space for a new OutputCollector causes an OOM because
the old one is still reachable.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message