hama-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Thomas Jungblut (Updated) (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HAMA-559) Add a caching message queue
Date Wed, 18 Apr 2012 18:20:40 GMT

     [ https://issues.apache.org/jira/browse/HAMA-559?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Thomas Jungblut updated HAMA-559:
---------------------------------

    Description: 
After HAMA-521 is done, we can add a caching queue which just holds the messages in RAM that
fit into the heap space. The rest can be flushed to disk.
We may call this a HybridQueue or something like that.

The benefits should be that we don't have to flush to disk so often and get faster. However
we may have more GC so it is always overall faster.

  was:After HAMA-521 is done, we can add a Heap-based queue which sorts the incoming messages
by a given Comparator. So the message should be WritableComparable, note that this should
be not a requirement in the generics of BSP since this is just a corner-case.

    
> Add a caching message queue
> ---------------------------
>
>                 Key: HAMA-559
>                 URL: https://issues.apache.org/jira/browse/HAMA-559
>             Project: Hama
>          Issue Type: New Feature
>          Components: bsp
>    Affects Versions: 0.5.0
>            Reporter: Thomas Jungblut
>            Priority: Minor
>             Fix For: 0.6.0
>
>
> After HAMA-521 is done, we can add a caching queue which just holds the messages in RAM
that fit into the heap space. The rest can be flushed to disk.
> We may call this a HybridQueue or something like that.
> The benefits should be that we don't have to flush to disk so often and get faster. However
we may have more GC so it is always overall faster.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Mime
View raw message