phoenix-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Lars Hofhansl (JIRA)" <j...@apache.org>
Subject [jira] [Created] (PHOENIX-3000) Reduce memory consumption during DISTINCT aggregation
Date Thu, 16 Jun 2016 06:53:05 GMT
Lars Hofhansl created PHOENIX-3000:
--------------------------------------

             Summary: Reduce memory consumption during DISTINCT aggregation
                 Key: PHOENIX-3000
                 URL: https://issues.apache.org/jira/browse/PHOENIX-3000
             Project: Phoenix
          Issue Type: Bug
            Reporter: Lars Hofhansl


In {{DistinctValueWithCountServerAggregator.aggregate}} we hold on the ptr handed to us from
HBase.
Note that this pointer points into an HFile Block, and hence we hold onto the entire block
for the duration of the aggregation.

If the column has high cardinality we might attempt holding the entire table in memory in
the extreme case.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message