accumulo-notifications mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Josh Elser (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (ACCUMULO-1534) Tablet Server using large number of decompressors during a scan
Date Sat, 26 Oct 2013 04:36:30 GMT

    [ https://issues.apache.org/jira/browse/ACCUMULO-1534?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13805994#comment-13805994
] 

Josh Elser commented on ACCUMULO-1534:
--------------------------------------

I would strongly doubt that this is something upstream. Given the internal buffers that rfile
and tfile create, I would not feel comfortable pointing the finger immediately at another
component. I think we would really need to do some quantitative testing to really understand
what's going on here. 

> Tablet Server using large number of decompressors during a scan
> ---------------------------------------------------------------
>
>                 Key: ACCUMULO-1534
>                 URL: https://issues.apache.org/jira/browse/ACCUMULO-1534
>             Project: Accumulo
>          Issue Type: Bug
>    Affects Versions: 1.4.3
>            Reporter: Mike Drob
>             Fix For: 1.5.1, 1.6.0
>
>
> I believe this issue is similar to ACCUMULO-665. We've run into a situation where a complex
iterator tree creates a large number of decompressors from the underlying CodecPool for serving
scans. Each decompressor holds on to a large buffer and the total volume ends up killing the
tserver.
> We have verified that turning off compression makes this problem go away.



--
This message was sent by Atlassian JIRA
(v6.1#6144)

Mime
View raw message