hbase-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From stack <st...@duboce.net>
Subject Re: Scan api result loop problem
Date Sat, 19 Dec 2009 16:42:57 GMT
On Thu, Dec 17, 2009 at 9:36 PM, Adam Silberstein <silberst@yahoo-inc.com>wrote:

> Hi,
> I wrote some simple client code to parse scan results, and it seems to be
> causing heavy CPU usage on my machine.  I¹ve commented out most of my code,
> and have this left:
>
> ResultScanner scanner = null;
> //some code to set scanner
>
> for (Result rr: scanner) {
>
> }
> scanner.close();
>
>
The above will run through the scanner nexting composing Result objects --
see ClientScanner#next -- all the way down to its bitter end.  Is this whats
burning your CPU?

St.Ack





> If I comment out the loop, then the CPU problems go away.  If I keep it,
> but
> have nothing inside, I see the problem.
>
> I saw a bug mentioned in release notes that talk about a memory leak in
> scan
> (
>
> http://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12310753&sty
> leName=Html&version=12314307).  But it appears that it was fixed in
> 0.20.2,
> which is the verison I am using.
>
> Has anyone else noticed this, and have any suggestions?
>
> Thanks,
> Adam
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message