impala-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Tim Armstrong <tarmstr...@cloudera.com>
Subject Re: impalad create a huge amount of IPv6 connection
Date Thu, 08 Dec 2016 18:06:29 GMT
Maybe Sailesh can confirm, but it does look like it's an instance of the
connections-not-timing-out problem.

On Wed, Dec 7, 2016 at 11:30 PM, Chan Chor Pang <chin-sh@indetail.co.jp>
wrote:

> update:
>
> this problem is fixed by restarting all impalad
>
> if i was correct, the problem is cause by
> https://issues.cloudera.org/browse/IMPALA-2799
> and all other host is trying to reconnect to the "problem host" endlessly
>
>
> On 12/8/16 2:09 PM, Chan Chor Pang wrote:
>
> some more info
>
> apparently, some host try to connect to the problem host use Ipv4
> but the problem host response as IPv6
>
> $ sudo lsof -p 14864 | grep 60827
> impalad 14864 impala 1826u  IPv6          787440313      0t0       TCP had003:snapenetio->had058:60827
(ESTABLISHED)
>
>
> $ sudo lsof -p 111823 | grep 60827
> impalad 111823 impala  442u  IPv4          472142649       0t0       TCP had058:60827->had001:snapenetio
(ESTABLISHED)
>
>
> On 12/8/16 1:37 PM, Chan Chor Pang wrote:
>
> hi everyone,
>
> one of the impalad in our cluster create a huge amount of IPv6 connection
> even i restart the impalad, the connections will just come back in 30 min
>
> any one know the reason for it to create so much IPv6 connection?
>
>
> $ ps -ef | grep impalad
> 1002      26751 104961  0 11:25 pts/0    00:00:00 grep impalad
> impala   112687   4366  8 Dec07 ?        01:31:08
> /opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/lib/impala/sbin-retail/impalad
> --flagfile=/var/run/cloudera-scm-agent/process/22177-
> impala-IMPALAD/impala-conf/impalad_flags
> $ sudo lsof -p 112687 | grep TCP | wc -l
> 24165
> $ sudo lsof -p 112687 | grep IPv6 | wc -l
> 23987
>
>
>
>

Mime
View raw message