Mailing-List: contact user-help@hbase.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@hbase.apache.org
Received-SPF: pass (athena.apache.org: domain of saint.ack@gmail.com
 designates 209.85.216.175 as permitted sender)
MIME-Version: 1.0
Sender: saint.ack@gmail.com
In-Reply-To: 
 <trinity-18b16371-633e-4f6d-b84f-5e34ef00c6a6-1397742699945@3capp-webde-bs10>
References: 
 <trinity-18b16371-633e-4f6d-b84f-5e34ef00c6a6-1397742699945@3capp-webde-bs10>
Date: Thu, 17 Apr 2014 21:50:40 -0700
Message-ID: 
 <CADcMMgGS0wAHEyotsbs-PhViFFcXjTnfbD6_0yzP=ESdh6qLRA@mail.gmail.com>
Subject: Re: taking snapshot's creates to many TCP CLOSE_WAIT handles on the
 hbase master server
From: Stack <stack@duboce.net>
To: Hbase-User <user@hbase.apache.org>
Content-Type: multipart/alternative; boundary=001a11c1157437723c04f749e4cb

--001a11c1157437723c04f749e4cb
Content-Type: text/plain; charset=UTF-8

On Thu, Apr 17, 2014 at 6:51 AM, Hansi Klose <hansi.klose@web.de> wrote:

> Hi,
>
> we use a script to take on a regular basis snapshot's and delete old one's.
>
> We recognizes that the web interface of the hbase master was not working
> any more becaues of too many open files.
>
> The master reaches his number of open file limit of 32768
>
> When I run lsof I saw that there where a lot of TCP CLOSE_WAIT handles open
> with the regionserver as target.
>
> On the regionserver there is just one connection to the hbase master.
>
> I can see that the count of the CLOSE_WAIT handles grow each time
> i take a snapshot. When i delete on nothing changes.
> Each time i take a snapshot  there are 20 - 30 new CLOSE_WAIT handles.
>
> Why does the master do not close the handles? Is there a parameter
> with a timeout we can use?
>
> We use hbase 0.94.2-cdh4.2.0.
>

Does
https://issues.apache.org/jira/browse/HBASE-9393?jql=text%20~%20%22CLOSE_WAIT%22help?
 In particular, what happens if you up the socket cache as suggested
on the end of the issue?

St.Ack

--001a11c1157437723c04f749e4cb--