hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From damien.co...@internode.on.net
Subject Re: Re: Lots of connections from datanodes in TIME_WAIT
Date Wed, 17 Sep 2008 01:23:39 GMT
As it tuns out this is clearly not an issue.  We have a machine here with 30,000 connections
in TIME_WAIT and the admin of that machine said 
there is little or no performance issues until the number raises over 10,000.  So my mere
400 seems quite pathetic really :)  Thanks to all those 
that assisted me.  I really appreciate it.

Best Regards

On Wed 17/09/08  6:18 AM , "Ted Dunning" ted.dunning@gmail.com sent:
> There are OS settings, but modern Linux kernels automatically adjust
> the setting if necessary.
> On Tue, Sep 16, 2008 at 8:38 AM, Raghu Angadi  wrote:
> Thats ok. Its a normal TCP state for the closed connections. There
> is probably some OS level setting to reduce the amount of time these
> connections stay in this state.
> It does not indicate a bug in application.
> Raghu.
> wrote:
> Hi all,
> We have a 10 node cluster and I noticed that there are a large
> number of connections in TIME_WAIT status,  over 400 to more precise. 
> Does anyone
> else see so many unclosed connections or have I done something wrong
> in my config.  It appears to be coming from and going to other
> datanodes.
> I was running the javasort benchmark when I noticed it.  Any advice
> appreciated.
> Regards
> Damien
> -- 
> ted

View raw message