Mailing-List: contact notifications-help@asterixdb.apache.org; run by ezmlm
Precedence: bulk
Reply-To: dev@asterixdb.apache.org
Date: Mon, 8 Aug 2016 03:32:20 +0000 (UTC)
From: "Taewoo Kim (JIRA)" <jira@apache.org>
To: notifications@asterixdb.incubator.apache.org
Message-ID: <JIRA.12993363.1469739571000.245449.1470627140446@Atlassian.JIRA>
In-Reply-To: <JIRA.12993363.1469739571000@Atlassian.JIRA>
References: <JIRA.12993363.1469739571000@Atlassian.JIRA> <JIRA.12993363.1469739571600@arcas>
Subject: [jira] [Commented] (ASTERIXDB-1556) Hash Table used by External
 hash group-by doesn't conform to the budget.
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit
archived-at: Mon, 08 Aug 2016 03:32:25 -0000


    [ https://issues.apache.org/jira/browse/ASTERIXDB-1556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15411223#comment-15411223 ] 

Taewoo Kim commented on ASTERIXDB-1556:
---------------------------------------

The hash slots for the hash values in the corresponding the partition are re-initialized (capacity remains the same and # of used count becomes 0 so that future insertions can use the slot again). The only time the space is not used again is when we double the capacity of the hash slot.

> Hash Table used by External hash group-by doesn't conform to the budget.
> ------------------------------------------------------------------------
>
>                 Key: ASTERIXDB-1556
>                 URL: https://issues.apache.org/jira/browse/ASTERIXDB-1556
>             Project: Apache AsterixDB
>          Issue Type: Bug
>            Reporter: Taewoo Kim
>            Assignee: Taewoo Kim
>         Attachments: 2wayjoin.pdf, 2wayjoin.rtf, 2wayjoinplan.rtf, 3wayjoin.pdf, 3wayjoin.rtf, 3wayjoinplan.rtf
>
>
> When we enable prefix-based fuzzy-join and apply the multi-way fuzzy-join ( > 2), the system generates an out-of-memory exception. 
> Since a fuzzy-join is created using 30-40 lines of AQL codes and this AQL is translated into massive number of operators (more than 200 operators in the plan for a 3-way fuzzy join), it could generate out-of-memory exception.
> /// Update: as the discussion goes, we found that hash table in the external hash group by doesn't conform to the frame limit. So, an out of memory exception happens during the execution of an external hash group by operator.


--
This message was sent by Atlassian JIRA
(v6.3.4#6332)