hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Guang-Nan Cheng <chen...@gmail.com>
Subject Re: Question on Streaming with RVM. Perhaps environment settings related.
Date Sat, 02 Apr 2011 05:06:16 GMT
If I manually logged in as `mapred', then yes. No matter it's interactive or
non-interactive shell.  But streaming seems launch the program differently.



I've tried to use `-mapper env' for diagnosis. It prints things below. So
right, `ruby' is not in $PATH when streaming launch it.

fs_s3n_block_size=67108864ng_impl=org.apache.hadoop.net.ScriptBasedMappinge.hadoop.io.compress.GzipCodec,org.apache.hadoop.io.compress.BZip2Codec0000_0/worke/mapred/mapred/local/taskTracker/guangnan/jobcache/job_201104020248_0013/attempt_201104020248_0013_m_000000_0/work:/usr/java/jdk1.6.0_23/jre/lib/i386/server:/usr/java/jdk1.6.0_23/jre/lib/i386:/usr/java/jdk1.6.0_23/jre/../lib/i386




Any further ideas? Maybe it's not logged in as `mapred'?


R/W/S=7689/309/0 in:NA [rec/s] out:NA [rec/s]
minRecWrittenToEnableSkip_=9223372036854775807 *LOGNAME=null*
*HOST=null
USER=mapred
HADOOP_USER=null
last Hadoop input: |null|
*last tool output:
|fs_s3n_block_size=67108864ng_impl=org.apache.hadoop.net.ScriptBasedMappinge.hadoop.io.compress.GzipCodec,org.apache.hadoop.io.compress.BZip2Codec0000_0/worke/mapred/mapred/local/taskTracker/guangnan/jobcache/job_201104020248_0013/attempt_201104020248_0013_m_000000_0/work:/usr/java/jdk1.6.0_23/jre/lib/i386/server:/usr/java/jdk1.6.0_23/jre/lib/i386:/usr/java/jdk1.6.0_23/jre/../lib/i386|
Date: Sat Apr 02 12:58:32 CST 2011
java.io.IOException: Broken pipe





On Sat, Apr 2, 2011 at 12:52 PM, Harsh J <qwertymaniac@gmail.com> wrote:
> Is the 'ruby' binary available in the $PATH for the 'mapred' user? You
> can see if it finds one using 'which ruby'.
>
> On Sat, Apr 2, 2011 at 10:17 AM, Guang-Nan Cheng <chenggn@gmail.com>
wrote:
>>   /bin/env: ruby: No such file or directory
>
> --
> Harsh J
> http://harshj.com
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message