hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Lars George (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HBASE-3852) ThriftServer leaks scanners
Date Mon, 08 Jul 2013 18:45:49 GMT

    [ https://issues.apache.org/jira/browse/HBASE-3852?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13702266#comment-13702266

Lars George commented on HBASE-3852:

Just ran across this in 0.89-fb:

commit b5f787b2836ce9750087392a4a3092f9a94f7360
Author: Mikhail Bautin <mbautin@apache.org>
Date:   Tue Aug 28 21:15:39 2012 +0000

    [HBASE-6673] Clear up the scanner in the thrift server whenever these scanners failed
to read data
    Author: liyintang
    We have run into some memory leak problem in the thrift server. It is caused either by
the application client never closed the outstanding scanner or the thr
    Test Plan: not tested; will tested in dev cluster;
    Reviewers: kannan, kranganathan
    Reviewed By: kannan
    CC: arjen, hbase-eng@, davejwatson
    Differential Revision: https://phabricator.fb.com/D541137
    git-svn-id: https://svn.apache.org/repos/asf/hbase/branches/0.89-fb@1378350 13f79535-47bb-0310-9956-ffa450edef68

We should check what FB did there as well.
> ThriftServer leaks scanners
> ---------------------------
>                 Key: HBASE-3852
>                 URL: https://issues.apache.org/jira/browse/HBASE-3852
>             Project: HBase
>          Issue Type: Sub-task
>          Components: Thrift
>    Affects Versions: 0.90.2
>            Reporter: Jean-Daniel Cryans
>            Assignee: Lars George
>         Attachments: 3852.txt, HBASE-3852-0.94.patch, thrift2-scanner.patch
> The scannerMap in ThriftServer relies on the user to clean it by closing the scanner.
If that doesn't happen, the ResultScanner will stay in the thrift server's memory and if any
pre-fetching was done, it will also start accumulating Results (with all their data).

This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

View raw message