hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Onur Cenk <oto...@gmail.com>
Subject hadoop streaming random fails
Date Thu, 09 Jun 2011 09:58:58 GMT
Hello everyone,

I'm using hadoop streaming. Getting the following error for 9 reduces
of 32. The tasks are retried by hadoop and everythings fine then.

Do you have an idea, why I'm getting this.

java.io.IOException: subprocess exited with error code 141
R/W/S=237891/234843/0 in:14868=237891/16 [rec/s] out:14677=234843/16 [rec/s]
minRecWrittenToEnableSkip_=9223372036854775807 LOGNAME=null
last Hadoop input: |null|
last tool output: |68064006?838?12?1?+905303343108?9|
Date: Thu Jun 09 01:38:46 EEST 2011
Broken pipe
	at org.apache.hadoop.streaming.PipeReducer.reduce(PipeReducer.java:131)
	at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:468)
	at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:416)
	at org.apache.hadoop.mapred.Child$4.run(Child.java:268)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:396)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1115)
	at org.apache.hadoop.mapred.Child.main(Child.java:262)

View raw message