hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From hadoop hive <hadooph...@gmail.com>
Subject Problem in reduce phase(critical)
Date Fri, 03 Feb 2012 14:02:07 GMT
On Fri, Feb 3, 2012 at 4:56 PM, hadoop hive <hadoophive@gmail.com> wrote:

> hey folks,
>
> i m getting this error while running mapreduce and these comes up in
> reduce phase..
>
>
> 2012-02-03 16:41:19,780 WARN org.apache.hadoop.mapred.ReduceTask: attempt_201201271626_5282_r_000000_0
copy failed: attempt_201201271626_5282_m_000007_2 from hadoopdata3
> 2012-02-03 16:41:19,954 WARN org.apache.hadoop.mapred.ReduceTask: java.net.ConnectException:
Connection refused
> 	at sun.reflect.GeneratedConstructorAccessor8.newInstance(Unknown Source)
> 	at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:27)
> 	at java.lang.reflect.Constructor.newInstance(Constructor.java:513)
> 	at sun.net.www.protocol.http.HttpURLConnection$6.run(HttpURLConnection.java:1345)
> 	at java.security.AccessController.doPrivileged(Native Method)
> 	at sun.net.www.protocol.http.HttpURLConnection.getChainedException(HttpURLConnection.java:1339)
> 	at sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:993)
> 	at org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.getInputStream(ReduceTask.java:1447)
> 	at org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.getMapOutput(ReduceTask.java:1349)
> 	at org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.copyOutput(ReduceTask.java:1261)
> 	at org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.run(ReduceTask.java:1195)
> Caused by: java.net.ConnectException: Connection refused
> 	at java.net.PlainSocketImpl.socketConnect(Native Method)
> 	at java.net.PlainSocketImpl.doConnect(PlainSocketImpl.java:333)
> 	at java.net.PlainSocketImpl.connectToAddress(PlainSocketImpl.java:195)
> 	at java.net.PlainSocketImpl.connect(PlainSocketImpl.java:182)
> 	at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:366)
> 	at java.net.Socket.connect(Socket.java:519)
> 	at sun.net.NetworkClient.doConnect(NetworkClient.java:158)
> 	at sun.net.www.http.HttpClient.openServer(HttpClient.java:394)
> 	at sun.net.www.http.HttpClient.openServer(HttpClient.java:529)
> 	at sun.net.www.http.HttpClient.<init>(HttpClient.java:233)
> 	at sun.net.www.http.HttpClient.New(HttpClient.java:306)
> 	at sun.net.www.http.HttpClient.New(HttpClient.java:323)
> 	at sun.net.www.protocol.http.HttpURLConnection.getNewHttpClient(HttpURLConnection.java:837)
> 	at sun.net.www.protocol.http.HttpURLConnection.plainConnect(HttpURLConnection.java:778)
> 	at sun.net.www.protocol.http.HttpURLConnection.connect(HttpURLConnection.java:703)
> 	at sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1026)
> 	... 4 more
>
> 2012-02-03 16:41:19,995 INFO org.apache.hadoop.mapred.ReduceTask: Task attempt_201201271626_5282_r_000000_0:
Failed fetch #4 from attempt_201201271626_5282_m_000007_2
> 2012-02-03 16:41:19,995 INFO org.apache.hadoop.mapred.ReduceTask: Failed to fetch map-output
from attempt_201201271626_5282_m_000007_2 even after MAX_FETCH_RETRIES_PER_MAP retries...
 reporting to the JobTracker
> 2012-02-03 16:41:19,995 WARN org.apache.hadoop.mapred.ReduceTask: attempt_201201271626_5282_r_000000_0
adding host hadoopdata3 to penalty box, next contact in 150 seconds
> 2012-02-03 16:41:19,995 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201201271626_5282_r_000000_0:
Got 1 map-outputs from previous failures
> 2012-02-03 16:42:10,015 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201201271626_5282_r_000000_0
Need another 1 map output(s) where 0 is already in progress
> 2012-02-03 16:42:10,015 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201201271626_5282_r_000000_0
Scheduled 0 outputs (1 slow hosts and0 dup hosts)
> 2012-02-03 16:42:10,015 INFO org.apache.hadoop.mapred.ReduceTask: Penalized(slow) Hosts:
> 2012-02-03 16:42:10,015 INFO org.apache.hadoop.mapred.ReduceTask: hadoopdata3 Will be
considered after: 99 seconds.
> 2012-02-03 16:43:10,050 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201201271626_5282_r_000000_0
Need another 1 map output(s) where 0 is already in progress
> 2012-02-03 16:43:10,050 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201201271626_5282_r_000000_0
Scheduled 0 outputs (1 slow hosts and0 dup hosts)
> 2012-02-03 16:43:10,050 INFO org.apache.hadoop.mapred.ReduceTask: Penalized(slow) Hosts:
> 2012-02-03 16:43:10,050 INFO org.apache.hadoop.mapred.ReduceTask: hadoopdata3 Will be
considered after: 39 seconds.
>
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message