Return-Path: X-Original-To: apmail-incubator-hama-dev-archive@minotaur.apache.org Delivered-To: apmail-incubator-hama-dev-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id D9E379732 for ; Wed, 18 Apr 2012 18:21:07 +0000 (UTC) Received: (qmail 17062 invoked by uid 500); 18 Apr 2012 18:21:07 -0000 Delivered-To: apmail-incubator-hama-dev-archive@incubator.apache.org Received: (qmail 17044 invoked by uid 500); 18 Apr 2012 18:21:07 -0000 Mailing-List: contact hama-dev-help@incubator.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: hama-dev@incubator.apache.org Delivered-To: mailing list hama-dev@incubator.apache.org Received: (qmail 17013 invoked by uid 99); 18 Apr 2012 18:21:07 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 18 Apr 2012 18:21:07 +0000 X-ASF-Spam-Status: No, hits=-2000.0 required=5.0 tests=ALL_TRUSTED,T_RP_MATCHES_RCVD X-Spam-Check-By: apache.org Received: from [140.211.11.116] (HELO hel.zones.apache.org) (140.211.11.116) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 18 Apr 2012 18:21:01 +0000 Received: from hel.zones.apache.org (hel.zones.apache.org [140.211.11.116]) by hel.zones.apache.org (Postfix) with ESMTP id B196E3A1F55 for ; Wed, 18 Apr 2012 18:20:40 +0000 (UTC) Date: Wed, 18 Apr 2012 18:20:40 +0000 (UTC) From: "Thomas Jungblut (Updated) (JIRA)" To: hama-dev@incubator.apache.org Message-ID: <1895134330.1820.1334773240728.JavaMail.tomcat@hel.zones.apache.org> In-Reply-To: <2014746635.1817.1334773119823.JavaMail.tomcat@hel.zones.apache.org> Subject: [jira] [Updated] (HAMA-559) Add a caching message queue MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/HAMA-559?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Jungblut updated HAMA-559: --------------------------------- Description: After HAMA-521 is done, we can add a caching queue which just holds the messages in RAM that fit into the heap space. The rest can be flushed to disk. We may call this a HybridQueue or something like that. The benefits should be that we don't have to flush to disk so often and get faster. However we may have more GC so it is always overall faster. was:After HAMA-521 is done, we can add a Heap-based queue which sorts the incoming messages by a given Comparator. So the message should be WritableComparable, note that this should be not a requirement in the generics of BSP since this is just a corner-case. > Add a caching message queue > --------------------------- > > Key: HAMA-559 > URL: https://issues.apache.org/jira/browse/HAMA-559 > Project: Hama > Issue Type: New Feature > Components: bsp > Affects Versions: 0.5.0 > Reporter: Thomas Jungblut > Priority: Minor > Fix For: 0.6.0 > > > After HAMA-521 is done, we can add a caching queue which just holds the messages in RAM that fit into the heap space. The rest can be flushed to disk. > We may call this a HybridQueue or something like that. > The benefits should be that we don't have to flush to disk so often and get faster. However we may have more GC so it is always overall faster. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira