accumulo-notifications mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Josh Elser (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (ACCUMULO-1534) Tablet Server using large number of decompressors during a scan
Date Sun, 27 Oct 2013 03:45:30 GMT

    [ https://issues.apache.org/jira/browse/ACCUMULO-1534?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13806216#comment-13806216
] 

Josh Elser commented on ACCUMULO-1534:
--------------------------------------

I would buy that there could be something internal to the GZIP (de)compressor code (native
or not) that could account for this happening with gz and not snappy. I suppose it might be
best to try to replicate this varying that TFile constants and the compression type. Perhaps
that would give a sign of what to actually look into.

> Tablet Server using large number of decompressors during a scan
> ---------------------------------------------------------------
>
>                 Key: ACCUMULO-1534
>                 URL: https://issues.apache.org/jira/browse/ACCUMULO-1534
>             Project: Accumulo
>          Issue Type: Bug
>    Affects Versions: 1.4.3
>            Reporter: Mike Drob
>            Assignee: Keith Turner
>            Priority: Critical
>             Fix For: 1.5.1, 1.6.0
>
>
> I believe this issue is similar to ACCUMULO-665. We've run into a situation where a complex
iterator tree creates a large number of decompressors from the underlying CodecPool for serving
scans. Each decompressor holds on to a large buffer and the total volume ends up killing the
tserver.
> We have verified that turning off compression makes this problem go away.



--
This message was sent by Atlassian JIRA
(v6.1#6144)

Mime
View raw message