impala-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Sailesh Mukil <sail...@cloudera.com>
Subject Re: impalad create a huge amount of IPv6 connection
Date Thu, 08 Dec 2016 18:21:39 GMT
Yes, this problem has been fixed by IMPALA-3875. It's a relatively small
patch, so you can easily apply it without conflicts if you wanted to.

On Thu, Dec 8, 2016 at 10:06 AM, Tim Armstrong <tarmstrong@cloudera.com>
wrote:

> Maybe Sailesh can confirm, but it does look like it's an instance of the
> connections-not-timing-out problem.
>
> On Wed, Dec 7, 2016 at 11:30 PM, Chan Chor Pang <chin-sh@indetail.co.jp>
> wrote:
>
>> update:
>>
>> this problem is fixed by restarting all impalad
>>
>> if i was correct, the problem is cause by
>> https://issues.cloudera.org/browse/IMPALA-2799
>> and all other host is trying to reconnect to the "problem host" endlessly
>>
>>
>> On 12/8/16 2:09 PM, Chan Chor Pang wrote:
>>
>> some more info
>>
>> apparently, some host try to connect to the problem host use Ipv4
>> but the problem host response as IPv6
>>
>> $ sudo lsof -p 14864 | grep 60827
>> impalad 14864 impala 1826u  IPv6          787440313      0t0       TCP had003:snapenetio->had058:60827
(ESTABLISHED)
>>
>>
>> $ sudo lsof -p 111823 | grep 60827
>> impalad 111823 impala  442u  IPv4          472142649       0t0       TCP had058:60827->had001:snapenetio
(ESTABLISHED)
>>
>>
>> On 12/8/16 1:37 PM, Chan Chor Pang wrote:
>>
>> hi everyone,
>>
>> one of the impalad in our cluster create a huge amount of IPv6 connection
>> even i restart the impalad, the connections will just come back in 30 min
>>
>> any one know the reason for it to create so much IPv6 connection?
>>
>>
>> $ ps -ef | grep impalad
>> 1002      26751 104961  0 11:25 pts/0    00:00:00 grep impalad
>> impala   112687   4366  8 Dec07 ?        01:31:08
>> /opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/lib/impala/sbin-retail/impalad
>> --flagfile=/var/run/cloudera-scm-agent/process/22177-impala-
>> IMPALAD/impala-conf/impalad_flags
>> $ sudo lsof -p 112687 | grep TCP | wc -l
>> 24165
>> $ sudo lsof -p 112687 | grep IPv6 | wc -l
>> 23987
>>
>>
>>
>>
>

Mime
View raw message