hama-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Thomas Jungblut (JIRA)" <j...@apache.org>
Subject [jira] [Comment Edited] (HAMA-593) Improve RPC scalability
Date Mon, 13 Aug 2012 13:50:38 GMT

    [ https://issues.apache.org/jira/browse/HAMA-593?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13433139#comment-13433139
] 

Thomas Jungblut edited comment on HAMA-593 at 8/14/12 12:50 AM:
----------------------------------------------------------------

We could also use the CacheBuilders from Guava. 

http://docs.guava-libraries.googlecode.com/git/javadoc/com/google/common/cache/CacheBuilder.html

Guava should be in our classpath.

bq. Sorry but I didn't got clues of using just LinkedHashSet for conceptualizing LRU cache.

When sending stuff this is a sequential operation, so caching the connections must not be
synchronized. So no need to use synchronized structures. Simply subclassing LinkedHashMap
and overriding removeEldestEntry should be enough.

See:
https://github.com/thomasjungblut/thomasjungblut-common/blob/master/src/de/jungblut/datastructure/LRUCache.java
                
      was (Author: thomas.jungblut):
    We could also use the CacheBuilders from Guava. 

http://docs.guava-libraries.googlecode.com/git/javadoc/com/google/common/cache/CacheBuilder.html

Guava should be in our classpath.

bq. Sorry but I didn't got clues of using just LinkedHashSet for conceptualizing LRU cache.

When sending stuff this is a sequential operation, so caching the connections must not be
synchronized. So no need to use synchronized structures. Simply subclassing LinkedHashMap
and overriding removeEldestEntry should be enough.
                  
> Improve RPC scalability
> -----------------------
>
>                 Key: HAMA-593
>                 URL: https://issues.apache.org/jira/browse/HAMA-593
>             Project: Hama
>          Issue Type: Sub-task
>          Components: bsp core, messaging
>    Affects Versions: 0.5.0
>            Reporter: Thomas Jungblut
>         Attachments: HAMA-593_1.patch
>
>
> To improve scalability we can start a RPC connection after another instead of keeping
all possible N connections open the whole time.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Mime
View raw message