Return-Path: 
 <user-return-14706-apmail-hadoop-user-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-user-archive@minotaur.apache.org
Delivered-To: apmail-hadoop-user-archive@minotaur.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
	by minotaur.apache.org (Postfix) with SMTP id 6AAC1118E4
	for <apmail-hadoop-user-archive@minotaur.apache.org>;
 Wed,  2 Apr 2014 07:55:58 +0000 (UTC)
Received: (qmail 91062 invoked by uid 500); 2 Apr 2014 07:55:50 -0000
Delivered-To: apmail-hadoop-user-archive@hadoop.apache.org
Received: (qmail 90682 invoked by uid 500); 2 Apr 2014 07:55:49 -0000
Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:user-help@hadoop.apache.org>
List-Unsubscribe: <mailto:user-unsubscribe@hadoop.apache.org>
List-Post: <mailto:user@hadoop.apache.org>
List-Id: <user.hadoop.apache.org>
Reply-To: user@hadoop.apache.org
Delivered-To: mailing list user@hadoop.apache.org
Received: (qmail 90675 invoked by uid 99); 2 Apr 2014 07:55:49 -0000
Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136)
    by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 02 Apr 2014 07:55:49 +0000
X-ASF-Spam-Status: No, hits=1.5 required=5.0
	tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS
X-Spam-Check-By: apache.org
Received-SPF: pass (athena.apache.org: domain of gwang@gopivotal.com
 designates 209.85.216.176 as permitted sender)
Received: from [209.85.216.176] (HELO mail-qc0-f176.google.com)
 (209.85.216.176)
    by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 02 Apr 2014 07:55:43 +0000
Received: by mail-qc0-f176.google.com with SMTP id m20so11809169qcx.7
        for <user@hadoop.apache.org>; Wed, 02 Apr 2014 00:55:23 -0700 (PDT)
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
        d=1e100.net; s=20130820;
        h=x-gm-message-state:mime-version:in-reply-to:references:from:date
         :message-id:subject:to:content-type;
        bh=GNHB5M/2pARLVhHaCeh5QDlEP+CHQklTFpjaucpCWYA=;
        b=OSx5TBv0bkrr09hDFlahaU4bFPR96QjsgUGOe9NxTjpJd3gXN8P/P7ocbG6rs8vOHK
         271chFPI/O66SidPny5CXzw8MSWqx8T//si6A6wPzDzB7Krrz+QDoe365fBnAvfafoZ+
         9Q22aA1D65Goa8ZfrGM8hvm8r5dWSqyJv12IjXfoFsNPhv+tkzaJ5iiKZAoP2Ci3qCAU
         R0BQpbhWWoMDeH6lH21kCHJwEFbjbtSJFInGAjsDTC/uA3oM/8Atj1hPbblBs4G6yEuf
         mtEb6Y3SBWO63ZTzsrkC+7OJAXRVg2uwmrQxSUaNfJ54sa8Jy4dAtNx1VTIIX6i0Dj4w
         wmnw==
X-Gm-Message-State: 
 ALoCoQk5mqjQKu6b/R35+vJ07o27Nv1E96nbJ366vsdFY96eGRSWJA4TN5joSwD73JRFN8hQobB6
X-Received: by 10.140.48.199 with SMTP id o65mr38805388qga.16.1396425323289;
 Wed, 02 Apr 2014 00:55:23 -0700 (PDT)
MIME-Version: 1.0
Received: by 10.229.106.132 with HTTP; Wed, 2 Apr 2014 00:55:03 -0700 (PDT)
In-Reply-To: 
 <CAFAd71WmmErA3GGL5WtRxgBwc918pmJxRounMDK=9=_kVEExJA@mail.gmail.com>
References: 
 <CAFAd71WmmErA3GGL5WtRxgBwc918pmJxRounMDK=9=_kVEExJA@mail.gmail.com>
From: Gordon Wang <gwang@gopivotal.com>
Date: Wed, 2 Apr 2014 15:55:03 +0800
Message-ID: 
 <CAOwyor1XdXwATv0FpmCEvasBA-gzEq5wbDbeH4=nBragoP_CTQ@mail.gmail.com>
Subject: Re: why copy from localhost.localdomain failed and throw
 UnknownHostException
To: user@hadoop.apache.org
Content-Type: multipart/alternative; boundary=001a113517d859ac7204f60a9b84
X-Virus-Checked: Checked by ClamAV on apache.org

--001a113517d859ac7204f60a9b84
Content-Type: text/plain; charset=ISO-8859-1

You may want to check the /etc/hosts. The configuration of localhost may
not right.
Make sure localhost.localdomain can be resolved.


On Wed, Apr 2, 2014 at 2:15 PM, Li Li <fancyerii@gmail.com> wrote:

> the reducer hangs and the log is:
>
> 2014-04-02 14:03:57,235 WARN org.apache.hadoop.mapred.ReduceTask:
> attempt_201402271518_0260_r_000000_0 copy failed:
> attempt_201402271518_0260_m_000001_1 from localhost.localdomain
> 2014-04-02 14:03:57,235 WARN org.apache.hadoop.mapred.ReduceTask:
> java.net.UnknownHostException: localhost.localdomain
> at
> java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:178)
> at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:391)
> at java.net.Socket.connect(Socket.java:579)
> at sun.net.NetworkClient.doConnect(NetworkClient.java:175)
> at sun.net.www.http.HttpClient.openServer(HttpClient.java:388)
> at sun.net.www.http.HttpClient.openServer(HttpClient.java:483)
> at sun.net.www.http.HttpClient.<init>(HttpClient.java:213)
> at sun.net.www.http.HttpClient.New(HttpClient.java:300)
> at sun.net.www.http.HttpClient.New(HttpClient.java:316)
> at
> sun.net.www.protocol.http.HttpURLConnection.getNewHttpClient(HttpURLConnection.java:992)
> at
> sun.net.www.protocol.http.HttpURLConnection.plainConnect(HttpURLConnection.java:928)
> at
> sun.net.www.protocol.http.HttpURLConnection.connect(HttpURLConnection.java:846)
> at
> org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.getInputStream(ReduceTask.java:1636)
> at
> org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.setupSecureConnection(ReduceTask.java:1593)
> at
> org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.getMapOutput(ReduceTask.java:1493)
> at
> org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.copyOutput(ReduceTask.java:1401)
> at
> org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.run(ReduceTask.java:1333)
>
> 2014-04-02 14:03:57,236 INFO org.apache.hadoop.mapred.ReduceTask: Task
> attempt_201402271518_0260_r_000000_0: Failed fetch #16 from
> attempt_201402271518_0260_m_000001_1
> 2014-04-02 14:03:57,236 WARN org.apache.hadoop.mapred.ReduceTask:
> attempt_201402271518_0260_r_000000_0 adding host localhost.localdomain
> to penalty box, next contact in 665 seconds
> 2014-04-02 14:03:57,236 INFO org.apache.hadoop.mapred.ReduceTask:
> attempt_201402271518_0260_r_000000_0: Got 1 map-outputs from previous
> failures
> 2014-04-02 14:04:17,244 INFO org.apache.hadoop.mapred.ReduceTask:
> attempt_201402271518_0260_r_000000_0 Need another 1 map output(s)
> where 0 is already in progress
> 2014-04-02 14:04:17,244 INFO org.apache.hadoop.mapred.ReduceTask:
> attempt_201402271518_0260_r_000000_0 Scheduled 0 outputs (1 slow hosts
> and0 dup hosts)
> 2014-04-02 14:04:17,244 INFO org.apache.hadoop.mapred.ReduceTask:
> Penalized(slow) Hosts:
> 2014-04-02 14:04:17,244 INFO org.apache.hadoop.mapred.ReduceTask:
> localhost.localdomain Will be considered after: 645 seconds.
> 2014-04-02 14:05:17,269 INFO org.apache.hadoop.mapred.ReduceTask:
> attempt_201402271518_0260_r_000000_0 Need another 1 map output(s)
> where 0 is already in progress
> 2014-04-02 14:05:17,269 INFO org.apache.hadoop.mapred.ReduceTask:
> attempt_201402271518_0260_r_000000_0 Scheduled 0 outputs (1 slow hosts
> and0 dup hosts)
> 2014-04-02 14:05:17,269 INFO org.apache.hadoop.mapred.ReduceTask:
> Penalized(slow) Hosts:
> 2014-04-02 14:05:17,269 INFO org.apache.hadoop.mapred.ReduceTask:
> localhost.localdomain Will be considered after: 585 seconds.
> 2014-04-02 14:06:17,294 INFO org.apache.hadoop.mapred.ReduceTask:
> attempt_201402271518_0260_r_000000_0 Need another 1 map output(s)
> where 0 is already in progress
> 2014-04-02 14:06:17,295 INFO org.apache.hadoop.mapred.ReduceTask:
> attempt_201402271518_0260_r_000000_0 Scheduled 0 outputs (1 slow hosts
> and0 dup hosts)
> 2014-04-02 14:06:17,295 INFO org.apache.hadoop.mapred.ReduceTask:
> Penalized(slow) Hosts:
>



-- 
Regards
Gordon Wang

--001a113517d859ac7204f60a9b84
Content-Type: text/html; charset=ISO-8859-1
Content-Transfer-Encoding: quoted-printable

<div dir=3D"ltr">You may want to check the /etc/hosts. The configuration of=
 localhost may not right.<div>Make sure=A0<span style=3D"font-family:arial,=
sans-serif;font-size:18px">localhost.</span><span style=3D"font-family:aria=
l,sans-serif;font-size:18px">localdomai</span><span style=3D"font-family:ar=
ial,sans-serif;font-size:18px">n can be resolved.</span></div>

</div><div class=3D"gmail_extra"><br><br><div class=3D"gmail_quote">On Wed,=
 Apr 2, 2014 at 2:15 PM, Li Li <span dir=3D"ltr">&lt;<a href=3D"mailto:fanc=
yerii@gmail.com" target=3D"_blank">fancyerii@gmail.com</a>&gt;</span> wrote=
:<br>
<blockquote class=3D"gmail_quote" style=3D"margin:0 0 0 .8ex;border-left:1p=
x #ccc solid;padding-left:1ex">
the reducer hangs and the log is:<br>
<br>
2014-04-02 14:03:57,235 WARN org.apache.hadoop.mapred.ReduceTask:<br>
attempt_201402271518_0260_r_000000_0 copy failed:<br>
attempt_201402271518_0260_m_000001_1 from localhost.localdomain<br>
2014-04-02 14:03:57,235 WARN org.apache.hadoop.mapred.ReduceTask:<br>
java.net.UnknownHostException: localhost.localdomain<br>
at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:17=
8)<br>
at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:391)<br>
at java.net.Socket.connect(Socket.java:579)<br>
at sun.net.NetworkClient.doConnect(NetworkClient.java:175)<br>
at sun.net.www.http.HttpClient.openServer(HttpClient.java:388)<br>
at sun.net.www.http.HttpClient.openServer(HttpClient.java:483)<br>
at sun.net.www.http.HttpClient.&lt;init&gt;(HttpClient.java:213)<br>
at sun.net.www.http.HttpClient.New(HttpClient.java:300)<br>
at sun.net.www.http.HttpClient.New(HttpClient.java:316)<br>
at sun.net.www.protocol.http.HttpURLConnection.getNewHttpClient(HttpURLConn=
ection.java:992)<br>
at sun.net.www.protocol.http.HttpURLConnection.plainConnect(HttpURLConnecti=
on.java:928)<br>
at sun.net.www.protocol.http.HttpURLConnection.connect(HttpURLConnection.ja=
va:846)<br>
at org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.getInpu=
tStream(ReduceTask.java:1636)<br>
at org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.setupSe=
cureConnection(ReduceTask.java:1593)<br>
at org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.getMapO=
utput(ReduceTask.java:1493)<br>
at org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.copyOut=
put(ReduceTask.java:1401)<br>
at org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.run(Red=
uceTask.java:1333)<br>
<br>
2014-04-02 14:03:57,236 INFO org.apache.hadoop.mapred.ReduceTask: Task<br>
attempt_201402271518_0260_r_000000_0: Failed fetch #16 from<br>
attempt_201402271518_0260_m_000001_1<br>
2014-04-02 14:03:57,236 WARN org.apache.hadoop.mapred.ReduceTask:<br>
attempt_201402271518_0260_r_000000_0 adding host localhost.localdomain<br>
to penalty box, next contact in 665 seconds<br>
2014-04-02 14:03:57,236 INFO org.apache.hadoop.mapred.ReduceTask:<br>
attempt_201402271518_0260_r_000000_0: Got 1 map-outputs from previous<br>
failures<br>
2014-04-02 14:04:17,244 INFO org.apache.hadoop.mapred.ReduceTask:<br>
attempt_201402271518_0260_r_000000_0 Need another 1 map output(s)<br>
where 0 is already in progress<br>
2014-04-02 14:04:17,244 INFO org.apache.hadoop.mapred.ReduceTask:<br>
attempt_201402271518_0260_r_000000_0 Scheduled 0 outputs (1 slow hosts<br>
and0 dup hosts)<br>
2014-04-02 14:04:17,244 INFO org.apache.hadoop.mapred.ReduceTask:<br>
Penalized(slow) Hosts:<br>
2014-04-02 14:04:17,244 INFO org.apache.hadoop.mapred.ReduceTask:<br>
localhost.localdomain Will be considered after: 645 seconds.<br>
2014-04-02 14:05:17,269 INFO org.apache.hadoop.mapred.ReduceTask:<br>
attempt_201402271518_0260_r_000000_0 Need another 1 map output(s)<br>
where 0 is already in progress<br>
2014-04-02 14:05:17,269 INFO org.apache.hadoop.mapred.ReduceTask:<br>
attempt_201402271518_0260_r_000000_0 Scheduled 0 outputs (1 slow hosts<br>
and0 dup hosts)<br>
2014-04-02 14:05:17,269 INFO org.apache.hadoop.mapred.ReduceTask:<br>
Penalized(slow) Hosts:<br>
2014-04-02 14:05:17,269 INFO org.apache.hadoop.mapred.ReduceTask:<br>
localhost.localdomain Will be considered after: 585 seconds.<br>
2014-04-02 14:06:17,294 INFO org.apache.hadoop.mapred.ReduceTask:<br>
attempt_201402271518_0260_r_000000_0 Need another 1 map output(s)<br>
where 0 is already in progress<br>
2014-04-02 14:06:17,295 INFO org.apache.hadoop.mapred.ReduceTask:<br>
attempt_201402271518_0260_r_000000_0 Scheduled 0 outputs (1 slow hosts<br>
and0 dup hosts)<br>
2014-04-02 14:06:17,295 INFO org.apache.hadoop.mapred.ReduceTask:<br>
Penalized(slow) Hosts:<br>
</blockquote></div><br><br clear=3D"all"><div><br></div>-- <br><div dir=3D"=
ltr"><div>Regards</div>Gordon Wang</div>
</div>

--001a113517d859ac7204f60a9b84--