hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Devaraj Das (JIRA)" <j...@apache.org>
Subject [jira] Commented: (HADOOP-312) Connections should not be cached
Date Tue, 04 Jul 2006 05:42:30 GMT
    [ http://issues.apache.org/jira/browse/HADOOP-312?page=comments#action_12419048 ] 

Devaraj Das commented on HADOOP-312:

Had a discussion with Eric/Owen on this subject and decided to do the following:
* Have time-based connection caching - i.e., on the client side, disconnect those connections
that have been idle for a (configurable) period of time (default is 1 sec).
* Postpone tweaking the heartbeat logic until we see a problem there.

> Connections should not be cached
> --------------------------------
>          Key: HADOOP-312
>          URL: http://issues.apache.org/jira/browse/HADOOP-312
>      Project: Hadoop
>         Type: Improvement

>   Components: ipc
>     Versions: 0.4.0
>     Reporter: Devaraj Das
>  Attachments: config_connection_cache.patch
> Servers and clients (client include datanodes, tasktrackers, DFSClients & tasks)
should not cache connections or maybe cache them for very short periods of time. Clients should
set up & tear down connections to the servers everytime they need to contact the servers
(including the heartbeats). If connection is cached, then reuse the existing connection for
a few subsequent transactions until the connection expires. The heartbeat interval should
be more so that many more clients (order of  tens of thousands) can be accomodated within
1 heartbeat interval.

This message is automatically generated by JIRA.
If you think it was sent incorrectly contact one of the administrators:
For more information on JIRA, see:

View raw message