Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
MIME-Version: 1.0
From: Jochen Hebbrecht <jochenhebbrecht@gmail.com>
Date: Mon, 11 Jul 2016 15:33:48 +0200
Message-ID: <CAJcVXksZ_5NtNy4NF5CJGW5agiOKvoVjnYVb5i5NcexC67FqAg@mail.gmail.com>
Subject: Windows Hadoop client timeout exception connecting to Linux Hadoop cluster
To: user@hadoop.apache.org
Content-Type: multipart/alternative; boundary=001a114bde2cc8cda005375c333f
archived-at: Mon, 11 Jul 2016 13:33:57 -0000

--001a114bde2cc8cda005375c333f
Content-Type: text/plain; charset=UTF-8

Hi,

This is the situation: a Hadoop cluster running on a Linux environment
(version 2.5.0 CDH 5.3.3). We can contact the cluster on a Linux client
with no issues and perform jobs on it.

{bash}
$ hadoop --config ../etc/myenvironment fs -ls /
{bash}
=> is working fine

On a Windows machine, we use exactly the same configuration and client, but
the connection to the server takes a very longs time and eventually gets
killed.

{bash}
$ hadoop --config ../etc/myenvironment/ fs -ls /
Java config name: null
Native config name: C:\WINDOWS\krb5.ini
2016-07-11 15:25:21,138 INFO  [main] ipc.Client
(Client.java:handleConnectionTimeout(814)) - Retrying connect to server:
XXX:8020. Already tried 0 time(s); maxRetries=45
2016-07-11 15:25:41,138 INFO  [main] ipc.Client
(Client.java:handleConnectionTimeout(814)) - Retrying connect to server:
XXX:8020. Already tried 1 time(s); maxRetries=45
2016-07-11 15:26:01,156 INFO  [main] ipc.Client
(Client.java:handleConnectionTimeout(814)) - Retrying connect to server:
XXX:8020. Already tried 2 time(s); maxRetries=45
...
{bash}

I think I'm running into this issue:
https://discuss.zendesk.com/hc/en-us/articles/203758976-hdfs-dfs-ls-commands-will-hang-indefinitely-when-secure-hdfs-is-enabled
Although my principal looks OK:

{bash}
$ klist
Ticket cache: FILE:/tmp/krb5cc_1291429
Default principal: myusername@mydomain

Valid starting       Expires              Service principal
07/11/2016 15:03:00  07/12/2016 01:03:00  krbtgt/mydomain@mydomainname
        renew until 07/11/2016 15:03:00
{bash}

Any idea how I can debug this?

Kind regards,
Jochen Hebbrecht

--001a114bde2cc8cda005375c333f
Content-Type: text/html; charset=UTF-8
Content-Transfer-Encoding: quoted-printable

<div dir=3D"ltr">Hi,<div><br></div><div>This is the situation: a Hadoop clu=
ster running on a Linux environment (version=C2=A02.5.0 CDH 5.3.3). We can =
contact the cluster on a Linux client with no issues and perform jobs on it=
.</div><div><br></div><div>{bash}</div><div>$ hadoop --config ../etc/myenvi=
ronment fs -ls /</div><div>{bash}<br></div><div>=3D&gt; is working fine</di=
v><div><br></div><div>On a Windows machine, we use exactly the same configu=
ration and client, but the connection to the server takes a very longs time=
 and eventually gets killed.</div><div><br></div><div>{bash}<br></div><div>=
<div>$ hadoop --config ../etc/myenvironment/ fs -ls /</div><div>Java config=
 name: null</div><div>Native config name: C:\WINDOWS\krb5.ini</div><div>201=
6-07-11 15:25:21,138 INFO =C2=A0[main] ipc.Client (Client.java:handleConnec=
tionTimeout(814)) - Retrying connect to server: XXX:8020. Already tried 0 t=
ime(s); maxRetries=3D45</div><div>2016-07-11 15:25:41,138 INFO =C2=A0[main]=
 ipc.Client (Client.java:handleConnectionTimeout(814)) - Retrying connect t=
o server: XXX:8020. Already tried 1 time(s); maxRetries=3D45</div><div>2016=
-07-11 15:26:01,156 INFO =C2=A0[main] ipc.Client (Client.java:handleConnect=
ionTimeout(814)) - Retrying connect to server: XXX:8020. Already tried 2 ti=
me(s); maxRetries=3D45</div></div><div>...</div><div>{bash}<br></div><div><=
br></div><div>I think I&#39;m running into this issue:=C2=A0<a href=3D"http=
s://discuss.zendesk.com/hc/en-us/articles/203758976-hdfs-dfs-ls-commands-wi=
ll-hang-indefinitely-when-secure-hdfs-is-enabled">https://discuss.zendesk.c=
om/hc/en-us/articles/203758976-hdfs-dfs-ls-commands-will-hang-indefinitely-=
when-secure-hdfs-is-enabled</a></div><div>Although my principal looks OK:</=
div><div><br></div><div>{bash}<br></div><div><div>$ klist</div><div>Ticket =
cache: FILE:/tmp/krb5cc_1291429</div><div>Default principal: myusername@myd=
omain</div><div><br></div><div>Valid starting =C2=A0 =C2=A0 =C2=A0 Expires =
=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0Service principal</div><div=
>07/11/2016 15:03:00 =C2=A007/12/2016 01:03:00 =C2=A0krbtgt/mydomain@mydoma=
inname</div><div>=C2=A0 =C2=A0 =C2=A0 =C2=A0 renew until 07/11/2016 15:03:0=
0</div></div><div>{bash}<br></div><div><br></div><div>Any idea how I can de=
bug this?</div><div><br></div><div>Kind regards,</div><div>Jochen Hebbrecht=
</div><div><br></div></div>

--001a114bde2cc8cda005375c333f--