hadoop-mapreduce-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Aaron Kimball <aa...@cloudera.com>
Subject Re: Irreproducible Streaming Jobs
Date Tue, 22 Jun 2010 02:26:01 GMT
Looking through your logs, I see this error on machine hadoop12:

Caused by: java\.io\.IOException: Cannot run program
\"/media/hd4/mapred/local/taskTracker/jobcache/job_201006141152_0165/attempt_201006141152_0165_m_000000_0/work/\./CliquerMap\":
java\.io\.IOException: error\=2, No such file or directory
                at
java\.lang\.ProcessBuilder\.start(ProcessBuilder\.java:460)
                at
org\.apache\.hadoop\.streaming\.PipeMapRed\.configure(PipeMapRed\.java:166)
                \.\.\. 19 more
Caused by: java\.io\.IOException: java\.io\.IOException: error\=2, No such
file or directory
                at java\.lang\.UNIXProcess\.<init>(UNIXProcess\.java:148)
                at java\.lang\.ProcessImpl\.start(ProcessImpl\.java:65)
                at
java\.lang\.ProcessBuilder\.start(ProcessBuilder\.java:453)
                \.\.\. 20 more


.. an error on machine hadoop31:
Caused by: java\.io\.IOException: Cannot run program
\"/media/hd2/mapred/local/taskTracker/jobcache/job_201006141152_0165/attempt_201006141152_0165_m_000001_0/work/\./CliquerMap\":
java\.io\.IOException: error\=2, No such file or directory
                at
java\.lang\.ProcessBuilder\.start(ProcessBuilder\.java:460)
                at
org\.apache\.hadoop\.streaming\.PipeMapRed\.configure(PipeMapRed\.java:166)
                \.\.\. 19 more

... and on hadoop31 again:
Caused by: java\.io\.IOException: Cannot run program
\"/tmp/hadoop-ngc/mapred/local/taskTracker/jobcache/job_201006141152_0165/attempt_201006141152_0165_m_000000_1/work/\./CliquerMap\":
java\.io\.IOException: error\=2, No such file or directory
                at
java\.lang\.ProcessBuilder\.start(ProcessBuilder\.java:460)
                at
org\.apache\.hadoop\.streaming\.PipeMapRed\.configure(PipeMapRed\.java:166)
                \.\.\. 19 more

and there are a bunch more errors of the same kind.

is /tmp/hadoop-ngc/ writable by the hadoop user? what about /media/hd2/ and
/media/hd4? Are your disks possibly full on some nodes? Somehow it's
incapable of running the CliquerMap program. Either it couldn't copy the
file over, or couldn't write it to disk on the target machine.

Are the failing nodes all of one OS type? It makes me a bit nervous that
you're running multiple Linux distributions.
What exact Hadoop version are you running? Apache 0.20.2? Or CDH2?
- Aaron


On Tue, Jun 15, 2010 at 4:54 AM, Ratner, Alan S (IS) <Alan.Ratner@ngc.com>wrote:

>  Here is more background on the problem of irreproducible streaming jobs:
>
> 1)      We are taking C code programs and converting them to run in
> Hadoop’s streaming mode.
>
> 2)      First we debug these programs by streaming them on a Windows
> laptop running a virtual machine with Ubuntu 9.10 and Hadoop 0.20.1.  We
> have done this with two C programs so far and both run correctly and
> consistently in this environment (reproducing the output of the original C
> programs).  BTW: I tried the modified command line suggested by Amareshwari
> and the program runs the same either way.
>
> 3)      Problems crop us when we move these programs to our Hadoop cluster
> which runs native Ubuntu (some servers running 9.10 and some 10.4) and
> Hadoop 0.20.2.  Sometimes these programs run and sometimes they don’t and we
> have no idea as to what is causing this inconsistency (unless it is due to
> the change from Hadoop 0.20.1 to 0.20.2).  The logs of failed jobs include
> file or directory not found errors but these aren’t especially helpful since
> they don’t specify which file or directory is missing.  I’ve included the
> log files of a successful run and a failed run in the hopes someone can tell
> me what is going wrong.
>
>
>
> *For example, here is successful Run 1:*
>
> * *
>
> ngc@hadoop1:~/hadoop-0.20.2$ bin/hadoop jar
> contrib/streaming/hadoop-0.20.2-streaming.jar -file
> /home/ngc/hadoop-0.20.2/streamingapps/Cliq2/CliquerMap -mapper CliquerMap
> -file /home/ngc/hadoop-0.20.2/streamingapps/Cliq2/ARGH1 -reducer ARGH1
> -input CliqueIn -output CliqueOut1
>
> packageJobJar: [/home/ngc/hadoop-0.20.2/streamingapps/Cliq2/CliquerMap,
> /home/ngc/hadoop-0.20.2/streamingapps/Cliq2/ARGH1,
> /tmp/hadoop-ngc/hadoop-unjar5693480053986200084/] []
> /tmp/streamjob2257941530123552427.jar tmpDir=null
>
> 10/06/14 15:49:54 INFO mapred.FileInputFormat: Total input paths to process
> : 1
>
> 10/06/14 15:49:55 INFO streaming.StreamJob: getLocalDirs():
> [/tmp/hadoop-ngc/mapred/local, /media/hd2/mapred/local,
> /media/hd3/mapred/local, /media/hd4/mapred/local]
>
> 10/06/14 15:49:55 INFO streaming.StreamJob: Running job:
> job_201006141152_0163
>
> 10/06/14 15:49:55 INFO streaming.StreamJob: To kill this job, run:
>
> 10/06/14 15:49:55 INFO streaming.StreamJob:
> /home/ngc/hadoop-0.20.2/bin/../bin/hadoop job  -Dmapred.job.tracker=
> 10.64.147.2:9002 -kill job_201006141152_0163
>
> 10/06/14 15:49:55 INFO streaming.StreamJob: Tracking URL:
> http://hadoop1.aj.c2fse.northgrum.com:50030/jobdetails.jsp?jobid=job_201006141152_0163
>
> 10/06/14 15:49:56 INFO streaming.StreamJob:  map 0%  reduce 0%
>
> 10/06/14 15:50:02 INFO streaming.StreamJob:  map 100%  reduce 0%
>
> 10/06/14 15:50:11 INFO streaming.StreamJob:  map 100%  reduce 33%
>
> 10/06/14 15:50:17 INFO streaming.StreamJob:  map 100%  reduce 100%
>
> 10/06/14 15:50:20 INFO streaming.StreamJob: Job complete:
> job_201006141152_0163
>
> 10/06/14 15:50:20 INFO streaming.StreamJob: Output: CliqueOut1
>
>
>
> *Here is failed Run 2 – only the name of the output directory has been
> changed:*
>
>
>
> ngc@hadoop1:~/hadoop-0.20.2$ bin/hadoop jar
> contrib/streaming/hadoop-0.20.2-streaming.jar -file
> /home/ngc/hadoop-0.20.2/streamingapps/Cliq2/CliquerMap -mapper CliquerMap
> -file /home/ngc/hadoop-0.20.2/streamingapps/Cliq2/ARGH1 -reducer ARGH1
> -input CliqueIn -output CliqueOut3
>
> packageJobJar: [/home/ngc/hadoop-0.20.2/streamingapps/Cliq2/CliquerMap,
> /home/ngc/hadoop-0.20.2/streamingapps/Cliq2/ARGH1,
> /tmp/hadoop-ngc/hadoop-unjar3582440643290869791/] []
> /tmp/streamjob6334481689253156407.jar tmpDir=null
>
> 10/06/14 15:52:30 INFO mapred.FileInputFormat: Total input paths to process
> : 1
>
> 10/06/14 15:52:30 INFO streaming.StreamJob: getLocalDirs():
> [/tmp/hadoop-ngc/mapred/local, /media/hd2/mapred/local,
> /media/hd3/mapred/local, /media/hd4/mapred/local]
>
> 10/06/14 15:52:30 INFO streaming.StreamJob: Running job:
> job_201006141152_0165
>
> 10/06/14 15:52:30 INFO streaming.StreamJob: To kill this job, run:
>
> 10/06/14 15:52:30 INFO streaming.StreamJob:
> /home/ngc/hadoop-0.20.2/bin/../bin/hadoop job  -Dmapred.job.tracker=
> 10.64.147.2:9002 -kill job_201006141152_0165
>
> 10/06/14 15:52:30 INFO streaming.StreamJob: Tracking URL:
> http://hadoop1.aj.c2fse.northgrum.com:50030/jobdetails.jsp?jobid=job_201006141152_0165
>
> 10/06/14 15:52:31 INFO streaming.StreamJob:  map 0%  reduce 0%
>
> 10/06/14 15:53:01 INFO streaming.StreamJob:  map 100%  reduce 100%
>
> 10/06/14 15:53:01 INFO streaming.StreamJob: To kill this job, run:
>
> 10/06/14 15:53:01 INFO streaming.StreamJob:
> /home/ngc/hadoop-0.20.2/bin/../bin/hadoop job  -Dmapred.job.tracker=
> 10.64.147.2:9002 -kill job_201006141152_0165
>
> 10/06/14 15:53:01 INFO streaming.StreamJob: Tracking URL:
> http://hadoop1.aj.c2fse.northgrum.com:50030/jobdetails.jsp?jobid=job_201006141152_0165
>
> 10/06/14 15:53:01 ERROR streaming.StreamJob: Job not Successful!
>
> 10/06/14 15:53:01 INFO streaming.StreamJob: killJob...
>
> Streaming Job Failed!
>
>
>
> *Output log with successful Run 1:*
>
>
>
> Meta VERSION="1" .
>
> Job JOBID="job_201006141152_0163"
> JOBNAME="streamjob2257941530123552427\.jar" USER="ngc"
> SUBMIT_TIME="1276544995086"
> JOBCONF="hdfs://hadoop1\.aj\.c2fse\.northgrum\.com:9000/tmp/hadoop-ngc/mapred/system/job_201006141152_0163/job\.xml"
> .
>
> Job JOBID="job_201006141152_0163" JOB_PRIORITY="NORMAL" .
>
> Job JOBID="job_201006141152_0163" LAUNCH_TIME="1276544995298"
> TOTAL_MAPS="2" TOTAL_REDUCES="1" JOB_STATUS="PREP" .
>
> Task TASKID="task_201006141152_0163_m_000003" TASK_TYPE="SETUP"
> START_TIME="1276544995355" SPLITS="" .
>
> MapAttempt TASK_TYPE="SETUP" TASKID="task_201006141152_0163_m_000003"
> TASK_ATTEMPT_ID="attempt_201006141152_0163_m_000003_0"
> START_TIME="1276544870715"
> TRACKER_NAME="tracker_hadoop7\.aj\.c2fse\.northgrum\.com:localhost/127\.0\.0\.1:42144"
> HTTP_PORT="50060" .
>
> MapAttempt TASK_TYPE="SETUP" TASKID="task_201006141152_0163_m_000003"
> TASK_ATTEMPT_ID="attempt_201006141152_0163_m_000003_0" TASK_STATUS="SUCCESS"
> FINISH_TIME="1276544871484"
> HOSTNAME="/default-rack/hadoop7\.aj\.c2fse\.northgrum\.com"
> STATE_STRING="setup"
> COUNTERS="{(org\.apache\.hadoop\.mapred\.Task$Counter)(Map-Reduce
> Framework)[(SPILLED_RECORDS)(Spilled Records)(0)]}" .
>
> Task TASKID="task_201006141152_0163_m_000003" TASK_TYPE="SETUP"
> TASK_STATUS="SUCCESS" FINISH_TIME="1276544998360"
> COUNTERS="{(org\.apache\.hadoop\.mapred\.Task$Counter)(Map-Reduce
> Framework)[(SPILLED_RECORDS)(Spilled Records)(0)]}" .
>
> Job JOBID="job_201006141152_0163" JOB_STATUS="RUNNING" .
>
> Task TASKID="task_201006141152_0163_m_000000" TASK_TYPE="MAP"
> START_TIME="1276544998360"
> SPLITS="/default-rack/hadoop38\.aj\.c2fse\.northgrum\.com,/default-rack/hadoop12\.aj\.c2fse\.northgrum\.com"
> .
>
> Task TASKID="task_201006141152_0163_m_000001" TASK_TYPE="MAP"
> START_TIME="1276544998367"
> SPLITS="/default-rack/hadoop38\.aj\.c2fse\.northgrum\.com,/default-rack/hadoop12\.aj\.c2fse\.northgrum\.com"
> .
>
> MapAttempt TASK_TYPE="MAP" TASKID="task_201006141152_0163_m_000000"
> TASK_ATTEMPT_ID="attempt_201006141152_0163_m_000000_0"
> START_TIME="1276544873560"
> TRACKER_NAME="tracker_hadoop7\.aj\.c2fse\.northgrum\.com:localhost/127\.0\.0\.1:42144"
> HTTP_PORT="50060" .
>
> MapAttempt TASK_TYPE="MAP" TASKID="task_201006141152_0163_m_000000"
> TASK_ATTEMPT_ID="attempt_201006141152_0163_m_000000_0" TASK_STATUS="SUCCESS"
> FINISH_TIME="1276544875195"
> HOSTNAME="/default-rack/hadoop7\.aj\.c2fse\.northgrum\.com"
> STATE_STRING="Records R/W\=10581/1"
> COUNTERS="{(FileSystemCounters)(FileSystemCounters)[(HDFS_BYTES_READ)(HDFS_BYTES_READ)(919067)][(FILE_BYTES_WRITTEN)(FILE_BYTES_WRITTEN)(1141467)]}{(org\.apache\.hadoop\.mapred\.Task$Counter)(Map-Reduce
> Framework)[(COMBINE_OUTPUT_RECORDS)(Combine output
> records)(0)][(MAP_INPUT_RECORDS)(Map input
> records)(74122)][(SPILLED_RECORDS)(Spilled
> Records)(74122)][(MAP_OUTPUT_BYTES)(Map output
> bytes)(993185)][(MAP_INPUT_BYTES)(Map input
> bytes)(919063)][(COMBINE_INPUT_RECORDS)(Combine input
> records)(0)][(MAP_OUTPUT_RECORDS)(Map output records)(74122)]}" .
>
> Task TASKID="task_201006141152_0163_m_000000" TASK_TYPE="MAP"
> TASK_STATUS="SUCCESS" FINISH_TIME="1276545001367"
> COUNTERS="{(FileSystemCounters)(FileSystemCounters)[(HDFS_BYTES_READ)(HDFS_BYTES_READ)(919067)][(FILE_BYTES_WRITTEN)(FILE_BYTES_WRITTEN)(1141467)]}{(org\.apache\.hadoop\.mapred\.Task$Counter)(Map-Reduce
> Framework)[(COMBINE_OUTPUT_RECORDS)(Combine output
> records)(0)][(MAP_INPUT_RECORDS)(Map input
> records)(74122)][(SPILLED_RECORDS)(Spilled
> Records)(74122)][(MAP_OUTPUT_BYTES)(Map output
> bytes)(993185)][(MAP_INPUT_BYTES)(Map input
> bytes)(919063)][(COMBINE_INPUT_RECORDS)(Combine input
> records)(0)][(MAP_OUTPUT_RECORDS)(Map output records)(74122)]}" .
>
> Task TASKID="task_201006141152_0163_r_000000" TASK_TYPE="REDUCE"
> START_TIME="1276545001367" SPLITS="" .
>
> MapAttempt TASK_TYPE="MAP" TASKID="task_201006141152_0163_m_000001"
> TASK_ATTEMPT_ID="attempt_201006141152_0163_m_000001_0"
> START_TIME="1276516505443"
> TRACKER_NAME="tracker_hadoop4\.aj\.c2fse\.northgrum\.com:localhost/127\.0\.0\.1:59097"
> HTTP_PORT="50060" .
>
> MapAttempt TASK_TYPE="MAP" TASKID="task_201006141152_0163_m_000001"
> TASK_ATTEMPT_ID="attempt_201006141152_0163_m_000001_0" TASK_STATUS="SUCCESS"
> FINISH_TIME="1276516507087"
> HOSTNAME="/default-rack/hadoop4\.aj\.c2fse\.northgrum\.com"
> STATE_STRING="Records R/W\=10490/1"
> COUNTERS="{(FileSystemCounters)(FileSystemCounters)[(HDFS_BYTES_READ)(HDFS_BYTES_READ)(1048576)][(FILE_BYTES_WRITTEN)(FILE_BYTES_WRITTEN)(1140848)]}{(org\.apache\.hadoop\.mapred\.Task$Counter)(Map-Reduce
> Framework)[(COMBINE_OUTPUT_RECORDS)(Combine output
> records)(0)][(MAP_INPUT_RECORDS)(Map input
> records)(73914)][(SPILLED_RECORDS)(Spilled
> Records)(73914)][(MAP_OUTPUT_BYTES)(Map output
> bytes)(992982)][(MAP_INPUT_BYTES)(Map input
> bytes)(919068)][(COMBINE_INPUT_RECORDS)(Combine input
> records)(0)][(MAP_OUTPUT_RECORDS)(Map output records)(73914)]}" .
>
> Task TASKID="task_201006141152_0163_m_000001" TASK_TYPE="MAP"
> TASK_STATUS="SUCCESS" FINISH_TIME="1276545001372"
> COUNTERS="{(FileSystemCounters)(FileSystemCounters)[(HDFS_BYTES_READ)(HDFS_BYTES_READ)(1048576)][(FILE_BYTES_WRITTEN)(FILE_BYTES_WRITTEN)(1140848)]}{(org\.apache\.hadoop\.mapred\.Task$Counter)(Map-Reduce
> Framework)[(COMBINE_OUTPUT_RECORDS)(Combine output
> records)(0)][(MAP_INPUT_RECORDS)(Map input
> records)(73914)][(SPILLED_RECORDS)(Spilled
> Records)(73914)][(MAP_OUTPUT_BYTES)(Map output
> bytes)(992982)][(MAP_INPUT_BYTES)(Map input
> bytes)(919068)][(COMBINE_INPUT_RECORDS)(Combine input
> records)(0)][(MAP_OUTPUT_RECORDS)(Map output records)(73914)]}" .
>
> ReduceAttempt TASK_TYPE="REDUCE" TASKID="task_201006141152_0163_r_000000"
> TASK_ATTEMPT_ID="attempt_201006141152_0163_r_000000_0"
> START_TIME="1276544876558"
> TRACKER_NAME="tracker_hadoop7\.aj\.c2fse\.northgrum\.com:localhost/127\.0\.0\.1:42144"
> HTTP_PORT="50060" .
>
> ReduceAttempt TASK_TYPE="REDUCE" TASKID="task_201006141152_0163_r_000000"
> TASK_ATTEMPT_ID="attempt_201006141152_0163_r_000000_0" TASK_STATUS="SUCCESS"
> SHUFFLE_FINISHED="1276544883268" SORT_FINISHED="1276544883562"
> FINISH_TIME="1276544889011"
> HOSTNAME="/default-rack/hadoop7\.aj\.c2fse\.northgrum\.com"
> STATE_STRING="Records R/W\=148036/1 > reduce"
> COUNTERS="{(FileSystemCounters)(FileSystemCounters)[(FILE_BYTES_READ)(FILE_BYTES_READ)(2282245)][(FILE_BYTES_WRITTEN)(FILE_BYTES_WRITTEN)(2282245)][(HDFS_BYTES_WRITTEN)(HDFS_BYTES_WRITTEN)(7259)]}{(org\.apache\.hadoop\.mapred\.Task$Counter)(Map-Reduce
> Framework)[(REDUCE_INPUT_GROUPS)(Reduce input
> groups)(148036)][(COMBINE_OUTPUT_RECORDS)(Combine output
> records)(0)][(REDUCE_SHUFFLE_BYTES)(Reduce shuffle
> bytes)(2282251)][(REDUCE_OUTPUT_RECORDS)(Reduce output
> records)(46)][(SPILLED_RECORDS)(Spilled
> Records)(148036)][(COMBINE_INPUT_RECORDS)(Combine input
> records)(0)][(REDUCE_INPUT_RECORDS)(Reduce input records)(148036)]}" .
>
> Task TASKID="task_201006141152_0163_r_000000" TASK_TYPE="REDUCE"
> TASK_STATUS="SUCCESS" FINISH_TIME="1276545016389"
> COUNTERS="{(FileSystemCounters)(FileSystemCounters)[(FILE_BYTES_READ)(FILE_BYTES_READ)(2282245)][(FILE_BYTES_WRITTEN)(FILE_BYTES_WRITTEN)(2282245)][(HDFS_BYTES_WRITTEN)(HDFS_BYTES_WRITTEN)(7259)]}{(org\.apache\.hadoop\.mapred\.Task$Counter)(Map-Reduce
> Framework)[(REDUCE_INPUT_GROUPS)(Reduce input
> groups)(148036)][(COMBINE_OUTPUT_RECORDS)(Combine output
> records)(0)][(REDUCE_SHUFFLE_BYTES)(Reduce shuffle
> bytes)(2282251)][(REDUCE_OUTPUT_RECORDS)(Reduce output
> records)(46)][(SPILLED_RECORDS)(Spilled
> Records)(148036)][(COMBINE_INPUT_RECORDS)(Combine input
> records)(0)][(REDUCE_INPUT_RECORDS)(Reduce input records)(148036)]}" .
>
> Task TASKID="task_201006141152_0163_m_000002" TASK_TYPE="CLEANUP"
> START_TIME="1276545016389" SPLITS="" .
>
> MapAttempt TASK_TYPE="CLEANUP" TASKID="task_201006141152_0163_m_000002"
> TASK_ATTEMPT_ID="attempt_201006141152_0163_m_000002_0"
> START_TIME="1276544891567"
> TRACKER_NAME="tracker_hadoop7\.aj\.c2fse\.northgrum\.com:localhost/127\.0\.0\.1:42144"
> HTTP_PORT="50060" .
>
> MapAttempt TASK_TYPE="CLEANUP" TASKID="task_201006141152_0163_m_000002"
> TASK_ATTEMPT_ID="attempt_201006141152_0163_m_000002_0" TASK_STATUS="SUCCESS"
> FINISH_TIME="1276544892421"
> HOSTNAME="/default-rack/hadoop7\.aj\.c2fse\.northgrum\.com"
> STATE_STRING="cleanup"
> COUNTERS="{(org\.apache\.hadoop\.mapred\.Task$Counter)(Map-Reduce
> Framework)[(SPILLED_RECORDS)(Spilled Records)(0)]}" .
>
> Task TASKID="task_201006141152_0163_m_000002" TASK_TYPE="CLEANUP"
> TASK_STATUS="SUCCESS" FINISH_TIME="1276545019393"
> COUNTERS="{(org\.apache\.hadoop\.mapred\.Task$Counter)(Map-Reduce
> Framework)[(SPILLED_RECORDS)(Spilled Records)(0)]}" .
>
> Job JOBID="job_201006141152_0163" FINISH_TIME="1276545019394"
> JOB_STATUS="SUCCESS" FINISHED_MAPS="2" FINISHED_REDUCES="1" FAILED_MAPS="0"
> FAILED_REDUCES="0"
> COUNTERS="{(org\.apache\.hadoop\.mapred\.JobInProgress$Counter)(Job Counters
> )[(TOTAL_LAUNCHED_REDUCES)(Launched reduce
> tasks)(1)][(RACK_LOCAL_MAPS)(Rack-local map
> tasks)(2)][(TOTAL_LAUNCHED_MAPS)(Launched map
> tasks)(2)]}{(FileSystemCounters)(FileSystemCounters)[(FILE_BYTES_READ)(FILE_BYTES_READ)(2282245)][(HDFS_BYTES_READ)(HDFS_BYTES_READ)(1967643)][(FILE_BYTES_WRITTEN)(FILE_BYTES_WRITTEN)(4564560)][(HDFS_BYTES_WRITTEN)(HDFS_BYTES_WRITTEN)(7259)]}{(org\.apache\.hadoop\.mapred\.Task$Counter)(Map-Reduce
> Framework)[(REDUCE_INPUT_GROUPS)(Reduce input
> groups)(148036)][(COMBINE_OUTPUT_RECORDS)(Combine output
> records)(0)][(MAP_INPUT_RECORDS)(Map input
> records)(148036)][(REDUCE_SHUFFLE_BYTES)(Reduce shuffle
> bytes)(2282251)][(REDUCE_OUTPUT_RECORDS)(Reduce output
> records)(46)][(SPILLED_RECORDS)(Spilled
> Records)(296072)][(MAP_OUTPUT_BYTES)(Map output
> bytes)(1986167)][(MAP_INPUT_BYTES)(Map input
> bytes)(1838131)][(MAP_OUTPUT_RECORDS)(Map output
> records)(148036)][(COMBINE_INPUT_RECORDS)(Combine input
> records)(0)][(REDUCE_INPUT_RECORDS)(Reduce input records)(148036)]}" .
>
>
>
> *Output log with failed Run 2:*
>
>
>
> Meta VERSION="1" .
>
> Job JOBID="job_201006141152_0165"
> JOBNAME="streamjob6334481689253156407\.jar" USER="ngc"
> SUBMIT_TIME="1276545150464"
> JOBCONF="hdfs://hadoop1\.aj\.c2fse\.northgrum\.com:9000/tmp/hadoop-ngc/mapred/system/job_201006141152_0165/job\.xml"
> .
>
> Job JOBID="job_201006141152_0165" JOB_PRIORITY="NORMAL" .
>
> Job JOBID="job_201006141152_0165" LAUNCH_TIME="1276545150594"
> TOTAL_MAPS="2" TOTAL_REDUCES="1" JOB_STATUS="PREP" .
>
> Task TASKID="task_201006141152_0165_m_000003" TASK_TYPE="SETUP"
> START_TIME="1276545150786" SPLITS="" .
>
> MapAttempt TASK_TYPE="SETUP" TASKID="task_201006141152_0165_m_000003"
> TASK_ATTEMPT_ID="attempt_201006141152_0165_m_000003_0"
> START_TIME="1276516268757"
> TRACKER_NAME="tracker_hadoop11\.aj\.c2fse\.northgrum\.com:localhost/127\.0\.0\.1:47520"
> HTTP_PORT="50060" .
>
> MapAttempt TASK_TYPE="SETUP" TASKID="task_201006141152_0165_m_000003"
> TASK_ATTEMPT_ID="attempt_201006141152_0165_m_000003_0" TASK_STATUS="SUCCESS"
> FINISH_TIME="1276516269394"
> HOSTNAME="/default-rack/hadoop11\.aj\.c2fse\.northgrum\.com"
> STATE_STRING="setup"
> COUNTERS="{(org\.apache\.hadoop\.mapred\.Task$Counter)(Map-Reduce
> Framework)[(SPILLED_RECORDS)(Spilled Records)(0)]}" .
>
> Task TASKID="task_201006141152_0165_m_000003" TASK_TYPE="SETUP"
> TASK_STATUS="SUCCESS" FINISH_TIME="1276545153792"
> COUNTERS="{(org\.apache\.hadoop\.mapred\.Task$Counter)(Map-Reduce
> Framework)[(SPILLED_RECORDS)(Spilled Records)(0)]}" .
>
> Job JOBID="job_201006141152_0165" JOB_STATUS="RUNNING" .
>
> Task TASKID="task_201006141152_0165_m_000000" TASK_TYPE="MAP"
> START_TIME="1276545153792"
> SPLITS="/default-rack/hadoop12\.aj\.c2fse\.northgrum\.com,/default-rack/hadoop38\.aj\.c2fse\.northgrum\.com"
> .
>
> Task TASKID="task_201006141152_0165_m_000001" TASK_TYPE="MAP"
> START_TIME="1276545153886"
> SPLITS="/default-rack/hadoop12\.aj\.c2fse\.northgrum\.com,/default-rack/hadoop38\.aj\.c2fse\.northgrum\.com"
> .
>
> MapAttempt TASK_TYPE="MAP" TASKID="task_201006141152_0165_m_000000"
> TASK_ATTEMPT_ID="attempt_201006141152_0165_m_000000_0"
> START_TIME="1276516271602"
> TRACKER_NAME="tracker_hadoop11\.aj\.c2fse\.northgrum\.com:localhost/127\.0\.0\.1:47520"
> HTTP_PORT="50060" .
>
> MapAttempt TASK_TYPE="MAP" TASKID="task_201006141152_0165_m_000000"
> TASK_ATTEMPT_ID="attempt_201006141152_0165_m_000000_0" TASK_STATUS="FAILED"
> FINISH_TIME="1276516275655" HOSTNAME="hadoop11\.aj\.c2fse\.northgrum\.com"
> ERROR="java\.lang\.RuntimeException: Error in configuring object
>
>                 at
> org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.java:93)
>
>                 at
> org\.apache\.hadoop\.util\.ReflectionUtils\.setConf(ReflectionUtils\.java:64)
>
>                 at
> org\.apache\.hadoop\.util\.ReflectionUtils\.newInstance(ReflectionUtils\.java:117)
>
>                 at
> org\.apache\.hadoop\.mapred\.MapTask\.runOldMapper(MapTask\.java:354)
>
>                 at
> org\.apache\.hadoop\.mapred\.MapTask\.run(MapTask\.java:307)
>
>                 at
> org\.apache\.hadoop\.mapred\.Child\.main(Child\.java:170)
>
> Caused by: java\.lang\.reflect\.InvocationTargetException
>
>                 at sun\.reflect\.NativeMethodAccessorImpl\.invoke0(Native
> Method)
>
>                 at
> sun\.reflect\.NativeMethodAccessorImpl\.invoke(NativeMethodAccessorImpl\.java:39)
>
>                 at
> sun\.reflect\.DelegatingMethodAccessorImpl\.invoke(DelegatingMethodAccessorImpl\.java:25)
>
>                 at java\.lang\.reflect\.Method\.invoke(Method\.java:597)
>
>                 at
> org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.java:88)
>
>                 \.\.\. 5 more
>
> Caused by: java\.lang\.RuntimeException: Error in configuring object
>
>                 at
> org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.java:93)
>
>                 at
> org\.apache\.hadoop\.util\.ReflectionUtils\.setConf(ReflectionUtils\.java:64)
>
>                 at
> org\.apache\.hadoop\.util\.ReflectionUtils\.newInstance(ReflectionUtils\.java:117)
>
>                 at
> org\.apache\.hadoop\.mapred\.MapRunner\.configure(MapRunner\.java:34)
>
>                 \.\.\. 10 more
>
> Caused by: java\.lang\.reflect\.InvocationTargetException
>
>                 at sun\.reflect\.NativeMethodAccessorImpl\.invoke0(Native
> Method)
>
>                 at
> sun\.reflect\.NativeMethodAccessorImpl\.invoke(NativeMethodAccessorImpl\.java:39)
>
>                 at
> sun\.reflect\.DelegatingMethodAccessorImpl\.invoke(DelegatingMethodAccessorImpl\.java:25)
>
>                 at java\.lang\.reflect\.Method\.invoke(Method\.java:597)
>
>                 at
> org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.java:88)
>
>                 \.\.\. 13 more
>
> Caused by: java\.lang\.RuntimeException: configuration exception
>
>                 at
> org\.apache\.hadoop\.streaming\.PipeMapRed\.configure(PipeMapRed\.java:182)
>
>                 at
> org\.apache\.hadoop\.streaming\.PipeMapper\.configure(PipeMapper\.java:63)
>
>                 \.\.\. 18 more
>
> Caused by: java\.io\.IOException: Cannot run program
> \"/media/hd4/mapred/local/taskTracker/jobcache/job_201006141152_0165/attempt_201006141152_0165_m_000000_0/work/\./CliquerMap\":
> java\.io\.IOException: error\=2, No such file or directory
>
>                 at
> java\.lang\.ProcessBuilder\.start(ProcessBuilder\.java:460)
>
>                 at
> org\.apache\.hadoop\.streaming\.PipeMapRed\.configure(PipeMapRed\.java:166)
>
>                 \.\.\. 19 more
>
> Caused by: java\.io\.IOException: java\.io\.IOException: error\=2, No such
> file or directory
>
>                 at java\.lang\.UNIXProcess\.<init>(UNIXProcess\.java:148)
>
>                 at java\.lang\.ProcessImpl\.start(ProcessImpl\.java:65)
>
>                 at
> java\.lang\.ProcessBuilder\.start(ProcessBuilder\.java:453)
>
>                 \.\.\. 20 more
>
> " .
>
> MapAttempt TASK_TYPE="MAP" TASKID="task_201006141152_0165_m_000001"
> TASK_ATTEMPT_ID="attempt_201006141152_0165_m_000001_0"
> START_TIME="1276602962723"
> TRACKER_NAME="tracker_hadoop31\.aj\.c2fse\.northgrum\.com:localhost/127\.0\.0\.1:40869"
> HTTP_PORT="50060" .
>
> MapAttempt TASK_TYPE="MAP" TASKID="task_201006141152_0165_m_000001"
> TASK_ATTEMPT_ID="attempt_201006141152_0165_m_000001_0" TASK_STATUS="FAILED"
> FINISH_TIME="1276602966774" HOSTNAME="hadoop31\.aj\.c2fse\.northgrum\.com"
> ERROR="java\.lang\.RuntimeException: Error in configuring object
>
>                 at
> org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.java:93)
>
>                 at
> org\.apache\.hadoop\.util\.ReflectionUtils\.setConf(ReflectionUtils\.java:64)
>
>                 at
> org\.apache\.hadoop\.util\.ReflectionUtils\.newInstance(ReflectionUtils\.java:117)
>
>                 at
> org\.apache\.hadoop\.mapred\.MapTask\.runOldMapper(MapTask\.java:354)
>
>                 at
> org\.apache\.hadoop\.mapred\.MapTask\.run(MapTask\.java:307)
>
>                 at
> org\.apache\.hadoop\.mapred\.Child\.main(Child\.java:170)
>
> Caused by: java\.lang\.reflect\.InvocationTargetException
>
>                 at sun\.reflect\.NativeMethodAccessorImpl\.invoke0(Native
> Method)
>
>                 at
> sun\.reflect\.NativeMethodAccessorImpl\.invoke(NativeMethodAccessorImpl\.java:39)
>
>                 at
> sun\.reflect\.DelegatingMethodAccessorImpl\.invoke(DelegatingMethodAccessorImpl\.java:25)
>
>                 at java\.lang\.reflect\.Method\.invoke(Method\.java:597)
>
>                 at
> org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.java:88)
>
>                 \.\.\. 5 more
>
> Caused by: java\.lang\.RuntimeException: Error in configuring object
>
>                 at
> org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.java:93)
>
>                 at
> org\.apache\.hadoop\.util\.ReflectionUtils\.setConf(ReflectionUtils\.java:64)
>
>                 at
> org\.apache\.hadoop\.util\.ReflectionUtils\.newInstance(ReflectionUtils\.java:117)
>
>                 at
> org\.apache\.hadoop\.mapred\.MapRunner\.configure(MapRunner\.java:34)
>
>                 \.\.\. 10 more
>
> Caused by: java\.lang\.reflect\.InvocationTargetException
>
>                 at sun\.reflect\.NativeMethodAccessorImpl\.invoke0(Native
> Method)
>
>                 at
> sun\.reflect\.NativeMethodAccessorImpl\.invoke(NativeMethodAccessorImpl\.java:39)
>
>                 at
> sun\.reflect\.DelegatingMethodAccessorImpl\.invoke(DelegatingMethodAccessorImpl\.java:25)
>
>                 at java\.lang\.reflect\.Method\.invoke(Method\.java:597)
>
>                 at
> org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.java:88)
>
>                 \.\.\. 13 more
>
> Caused by: java\.lang\.RuntimeException: configuration exception
>
>                 at
> org\.apache\.hadoop\.streaming\.PipeMapRed\.configure(PipeMapRed\.java:182)
>
>                 at
> org\.apache\.hadoop\.streaming\.PipeMapper\.configure(PipeMapper\.java:63)
>
>                 \.\.\. 18 more
>
> Caused by: java\.io\.IOException: Cannot run program
> \"/media/hd2/mapred/local/taskTracker/jobcache/job_201006141152_0165/attempt_201006141152_0165_m_000001_0/work/\./CliquerMap\":
> java\.io\.IOException: error\=2, No such file or directory
>
>                 at
> java\.lang\.ProcessBuilder\.start(ProcessBuilder\.java:460)
>
>                 at
> org\.apache\.hadoop\.streaming\.PipeMapRed\.configure(PipeMapRed\.java:166)
>
>                 \.\.\. 19 more
>
> Caused by: java\.io\.IOException: java\.io\.IOException: error\=2, No such
> file or directory
>
>                 at java\.lang\.UNIXProcess\.<init>(UNIXProcess\.java:148)
>
>                 at java\.lang\.ProcessImpl\.start(ProcessImpl\.java:65)
>
>                 at
> java\.lang\.ProcessBuilder\.start(ProcessBuilder\.java:453)
>
>                 \.\.\. 20 more
>
> " .
>
> MapAttempt TASK_TYPE="MAP" TASKID="task_201006141152_0165_m_000000"
> TASK_ATTEMPT_ID="attempt_201006141152_0165_m_000000_1"
> START_TIME="1276602968589"
> TRACKER_NAME="tracker_hadoop31\.aj\.c2fse\.northgrum\.com:localhost/127\.0\.0\.1:40869"
> HTTP_PORT="50060" .
>
> MapAttempt TASK_TYPE="MAP" TASKID="task_201006141152_0165_m_000000"
> TASK_ATTEMPT_ID="attempt_201006141152_0165_m_000000_1" TASK_STATUS="FAILED"
> FINISH_TIME="1276602972635" HOSTNAME="hadoop31\.aj\.c2fse\.northgrum\.com"
> ERROR="java\.lang\.RuntimeException: Error in configuring object
>
>                 at
> org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.java:93)
>
>                 at
> org\.apache\.hadoop\.util\.ReflectionUtils\.setConf(ReflectionUtils\.java:64)
>
>                 at
> org\.apache\.hadoop\.util\.ReflectionUtils\.newInstance(ReflectionUtils\.java:117)
>
>                 at
> org\.apache\.hadoop\.mapred\.MapTask\.runOldMapper(MapTask\.java:354)
>
>                 at
> org\.apache\.hadoop\.mapred\.MapTask\.run(MapTask\.java:307)
>
>                 at
> org\.apache\.hadoop\.mapred\.Child\.main(Child\.java:170)
>
> Caused by: java\.lang\.reflect\.InvocationTargetException
>
>                 at sun\.reflect\.NativeMethodAccessorImpl\.invoke0(Native
> Method)
>
>                 at
> sun\.reflect\.NativeMethodAccessorImpl\.invoke(NativeMethodAccessorImpl\.java:39)
>
>                 at
> sun\.reflect\.DelegatingMethodAccessorImpl\.invoke(DelegatingMethodAccessorImpl\.java:25)
>
>                 at java\.lang\.reflect\.Method\.invoke(Method\.java:597)
>
>                 at
> org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.java:88)
>
>                 \.\.\. 5 more
>
> Caused by: java\.lang\.RuntimeException: Error in configuring object
>
>                 at
> org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.java:93)
>
>                 at
> org\.apache\.hadoop\.util\.ReflectionUtils\.setConf(ReflectionUtils\.java:64)
>
>                 at
> org\.apache\.hadoop\.util\.ReflectionUtils\.newInstance(ReflectionUtils\.java:117)
>
>                 at
> org\.apache\.hadoop\.mapred\.MapRunner\.configure(MapRunner\.java:34)
>
>                 \.\.\. 10 more
>
> Caused by: java\.lang\.reflect\.InvocationTargetException
>
>                 at sun\.reflect\.NativeMethodAccessorImpl\.invoke0(Native
> Method)
>
>                 at
> sun\.reflect\.NativeMethodAccessorImpl\.invoke(NativeMethodAccessorImpl\.java:39)
>
>                 at
> sun\.reflect\.DelegatingMethodAccessorImpl\.invoke(DelegatingMethodAccessorImpl\.java:25)
>
>                 at java\.lang\.reflect\.Method\.invoke(Method\.java:597)
>
>                 at
> org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.java:88)
>
>                 \.\.\. 13 more
>
> Caused by: java\.lang\.RuntimeException: configuration exception
>
>                 at
> org\.apache\.hadoop\.streaming\.PipeMapRed\.configure(PipeMapRed\.java:182)
>
>                 at
> org\.apache\.hadoop\.streaming\.PipeMapper\.configure(PipeMapper\.java:63)
>
>                 \.\.\. 18 more
>
> Caused by: java\.io\.IOException: Cannot run program
> \"/tmp/hadoop-ngc/mapred/local/taskTracker/jobcache/job_201006141152_0165/attempt_201006141152_0165_m_000000_1/work/\./CliquerMap\":
> java\.io\.IOException: error\=2, No such file or directory
>
>                 at
> java\.lang\.ProcessBuilder\.start(ProcessBuilder\.java:460)
>
>                 at
> org\.apache\.hadoop\.streaming\.PipeMapRed\.configure(PipeMapRed\.java:166)
>
>                 \.\.\. 19 more
>
> Caused by: java\.io\.IOException: java\.io\.IOException: error\=2, No such
> file or directory
>
>                 at java\.lang\.UNIXProcess\.<init>(UNIXProcess\.java:148)
>
>                 at java\.lang\.ProcessImpl\.start(ProcessImpl\.java:65)
>
>                 at
> java\.lang\.ProcessBuilder\.start(ProcessBuilder\.java:453)
>
>                 \.\.\. 20 more
>
> " .
>
> MapAttempt TASK_TYPE="MAP" TASKID="task_201006141152_0165_m_000001"
> TASK_ATTEMPT_ID="attempt_201006141152_0165_m_000001_1"
> START_TIME="1276516428044"
> TRACKER_NAME="tracker_hadoop10\.aj\.c2fse\.northgrum\.com:localhost/127\.0\.0\.1:54798"
> HTTP_PORT="50060" .
>
> MapAttempt TASK_TYPE="MAP" TASKID="task_201006141152_0165_m_000001"
> TASK_ATTEMPT_ID="attempt_201006141152_0165_m_000001_1" TASK_STATUS="FAILED"
> FINISH_TIME="1276516432095" HOSTNAME="hadoop10\.aj\.c2fse\.northgrum\.com"
> ERROR="java\.lang\.RuntimeException: Error in configuring object
>
>                 at
> org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.java:93)
>
>                 at
> org\.apache\.hadoop\.util\.ReflectionUtils\.setConf(ReflectionUtils\.java:64)
>
>                 at
> org\.apache\.hadoop\.util\.ReflectionUtils\.newInstance(ReflectionUtils\.java:117)
>
>                 at
> org\.apache\.hadoop\.mapred\.MapTask\.runOldMapper(MapTask\.java:354)
>
>                 at
> org\.apache\.hadoop\.mapred\.MapTask\.run(MapTask\.java:307)
>
>                 at
> org\.apache\.hadoop\.mapred\.Child\.main(Child\.java:170)
>
> Caused by: java\.lang\.reflect\.InvocationTargetException
>
>                 at sun\.reflect\.NativeMethodAccessorImpl\.invoke0(Native
> Method)
>
>                 at
> sun\.reflect\.NativeMethodAccessorImpl\.invoke(NativeMethodAccessorImpl\.java:39)
>
>                 at
> sun\.reflect\.DelegatingMethodAccessorImpl\.invoke(DelegatingMethodAccessorImpl\.java:25)
>
>                 at java\.lang\.reflect\.Method\.invoke(Method\.java:597)
>
>                 at
> org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.java:88)
>
>                 \.\.\. 5 more
>
> Caused by: java\.lang\.RuntimeException: Error in configuring object
>
>                 at
> org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.java:93)
>
>                 at
> org\.apache\.hadoop\.util\.ReflectionUtils\.setConf(ReflectionUtils\.java:64)
>
>                 at
> org\.apache\.hadoop\.util\.ReflectionUtils\.newInstance(ReflectionUtils\.java:117)
>
>                 at
> org\.apache\.hadoop\.mapred\.MapRunner\.configure(MapRunner\.java:34)
>
>                 \.\.\. 10 more
>
> Caused by: java\.lang\.reflect\.InvocationTargetException
>
>                 at sun\.reflect\.NativeMethodAccessorImpl\.invoke0(Native
> Method)
>
>                 at
> sun\.reflect\.NativeMethodAccessorImpl\.invoke(NativeMethodAccessorImpl\.java:39)
>
>                 at
> sun\.reflect\.DelegatingMethodAccessorImpl\.invoke(DelegatingMethodAccessorImpl\.java:25)
>
>                 at java\.lang\.reflect\.Method\.invoke(Method\.java:597)
>
>                 at
> org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.java:88)
>
>                 \.\.\. 13 more
>
> Caused by: java\.lang\.RuntimeException: configuration exception
>
>                 at
> org\.apache\.hadoop\.streaming\.PipeMapRed\.configure(PipeMapRed\.java:182)
>
>                 at
> org\.apache\.hadoop\.streaming\.PipeMapper\.configure(PipeMapper\.java:63)
>
>                 \.\.\. 18 more
>
> Caused by: java\.io\.IOException: Cannot run program
> \"/media/hd4/mapred/local/taskTracker/jobcache/job_201006141152_0165/attempt_201006141152_0165_m_000001_1/work/\./CliquerMap\":
> java\.io\.IOException: error\=2, No such file or directory
>
>                 at
> java\.lang\.ProcessBuilder\.start(ProcessBuilder\.java:460)
>
>                 at
> org\.apache\.hadoop\.streaming\.PipeMapRed\.configure(PipeMapRed\.java:166)
>
>                 \.\.\. 19 more
>
> Caused by: java\.io\.IOException: java\.io\.IOException: error\=2, No such
> file or directory
>
>                 at java\.lang\.UNIXProcess\.<init>(UNIXProcess\.java:148)
>
>                 at java\.lang\.ProcessImpl\.start(ProcessImpl\.java:65)
>
>                 at
> java\.lang\.ProcessBuilder\.start(ProcessBuilder\.java:453)
>
>                 \.\.\. 20 more
>
> " .
>
> MapAttempt TASK_TYPE="MAP" TASKID="task_201006141152_0165_m_000000"
> TASK_ATTEMPT_ID="attempt_201006141152_0165_m_000000_2"
> START_TIME="1276516433881"
> TRACKER_NAME="tracker_hadoop10\.aj\.c2fse\.northgrum\.com:localhost/127\.0\.0\.1:54798"
> HTTP_PORT="50060" .
>
> MapAttempt TASK_TYPE="MAP" TASKID="task_201006141152_0165_m_000000"
> TASK_ATTEMPT_ID="attempt_201006141152_0165_m_000000_2" TASK_STATUS="FAILED"
> FINISH_TIME="1276516437931" HOSTNAME="hadoop10\.aj\.c2fse\.northgrum\.com"
> ERROR="java\.lang\.RuntimeException: Error in configuring object
>
>                 at
> org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.java:93)
>
>                 at
> org\.apache\.hadoop\.util\.ReflectionUtils\.setConf(ReflectionUtils\.java:64)
>
>                 at
> org\.apache\.hadoop\.util\.ReflectionUtils\.newInstance(ReflectionUtils\.java:117)
>
>                 at
> org\.apache\.hadoop\.mapred\.MapTask\.runOldMapper(MapTask\.java:354)
>
>                 at
> org\.apache\.hadoop\.mapred\.MapTask\.run(MapTask\.java:307)
>
>                 at
> org\.apache\.hadoop\.mapred\.Child\.main(Child\.java:170)
>
> Caused by: java\.lang\.reflect\.InvocationTargetException
>
>                 at sun\.reflect\.NativeMethodAccessorImpl\.invoke0(Native
> Method)
>
>                 at
> sun\.reflect\.NativeMethodAccessorImpl\.invoke(NativeMethodAccessorImpl\.java:39)
>
>                 at
> sun\.reflect\.DelegatingMethodAccessorImpl\.invoke(DelegatingMethodAccessorImpl\.java:25)
>
>                 at java\.lang\.reflect\.Method\.invoke(Method\.java:597)
>
>                 at
> org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.java:88)
>
>                 \.\.\. 5 more
>
> Caused by: java\.lang\.RuntimeException: Error in configuring object
>
>                 at
> org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.java:93)
>
>                 at
> org\.apache\.hadoop\.util\.ReflectionUtils\.setConf(ReflectionUtils\.java:64)
>
>                 at
> org\.apache\.hadoop\.util\.ReflectionUtils\.newInstance(ReflectionUtils\.java:117)
>
>                 at
> org\.apache\.hadoop\.mapred\.MapRunner\.configure(MapRunner\.java:34)
>
>                 \.\.\. 10 more
>
> Caused by: java\.lang\.reflect\.InvocationTargetException
>
>                 at sun\.reflect\.NativeMethodAccessorImpl\.invoke0(Native
> Method)
>
>                 at
> sun\.reflect\.NativeMethodAccessorImpl\.invoke(NativeMethodAccessorImpl\.java:39)
>
>                 at
> sun\.reflect\.DelegatingMethodAccessorImpl\.invoke(DelegatingMethodAccessorImpl\.java:25)
>
>                 at java\.lang\.reflect\.Method\.invoke(Method\.java:597)
>
>                 at
> org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.java:88)
>
>                 \.\.\. 13 more
>
> Caused by: java\.lang\.RuntimeException: configuration exception
>
>                 at
> org\.apache\.hadoop\.streaming\.PipeMapRed\.configure(PipeMapRed\.java:182)
>
>                 at
> org\.apache\.hadoop\.streaming\.PipeMapper\.configure(PipeMapper\.java:63)
>
>                 \.\.\. 18 more
>
> Caused by: java\.io\.IOException: Cannot run program
> \"/media/hd4/mapred/local/taskTracker/jobcache/job_201006141152_0165/attempt_201006141152_0165_m_000000_2/work/\./CliquerMap\":
> java\.io\.IOException: error\=2, No such file or directory
>
>                 at
> java\.lang\.ProcessBuilder\.start(ProcessBuilder\.java:460)
>
>                 at
> org\.apache\.hadoop\.streaming\.PipeMapRed\.configure(PipeMapRed\.java:166)
>
>                 \.\.\. 19 more
>
> Caused by: java\.io\.IOException: java\.io\.IOException: error\=2, No such
> file or directory
>
>                 at java\.lang\.UNIXProcess\.<init>(UNIXProcess\.java:148)
>
>                 at java\.lang\.ProcessImpl\.start(ProcessImpl\.java:65)
>
>                 at
> java\.lang\.ProcessBuilder\.start(ProcessBuilder\.java:453)
>
>                 \.\.\. 20 more
>
> " .
>
> MapAttempt TASK_TYPE="MAP" TASKID="task_201006141152_0165_m_000001"
> TASK_ATTEMPT_ID="attempt_201006141152_0165_m_000001_2"
> START_TIME="1276574021030"
> TRACKER_NAME="tracker_hadoop38\.aj\.c2fse\.northgrum\.com:localhost/127\.0\.0\.1:45065"
> HTTP_PORT="50060" .
>
> MapAttempt TASK_TYPE="MAP" TASKID="task_201006141152_0165_m_000001"
> TASK_ATTEMPT_ID="attempt_201006141152_0165_m_000001_2" TASK_STATUS="FAILED"
> FINISH_TIME="1276574024976" HOSTNAME="hadoop38\.aj\.c2fse\.northgrum\.com"
> ERROR="java\.lang\.RuntimeException: Error in configuring object
>
>                 at
> org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.java:93)
>
>                 at
> org\.apache\.hadoop\.util\.ReflectionUtils\.setConf(ReflectionUtils\.java:64)
>
>                 at
> org\.apache\.hadoop\.util\.ReflectionUtils\.newInstance(ReflectionUtils\.java:117)
>
>                 at
> org\.apache\.hadoop\.mapred\.MapTask\.runOldMapper(MapTask\.java:354)
>
>                 at
> org\.apache\.hadoop\.mapred\.MapTask\.run(MapTask\.java:307)
>
>                 at
> org\.apache\.hadoop\.mapred\.Child\.main(Child\.java:170)
>
> Caused by: java\.lang\.reflect\.InvocationTargetException
>
>                 at sun\.reflect\.NativeMethodAccessorImpl\.invoke0(Native
> Method)
>
>                 at
> sun\.reflect\.NativeMethodAccessorImpl\.invoke(NativeMethodAccessorImpl\.java:39)
>
>                 at
> sun\.reflect\.DelegatingMethodAccessorImpl\.invoke(DelegatingMethodAccessorImpl\.java:25)
>
>                 at java\.lang\.reflect\.Method\.invoke(Method\.java:597)
>
>                 at
> org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.java:88)
>
>                 \.\.\. 5 more
>
> Caused by: java\.lang\.RuntimeException: Error in configuring object
>
>                 at
> org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.java:93)
>
>                 at
> org\.apache\.hadoop\.util\.ReflectionUtils\.setConf(ReflectionUtils\.java:64)
>
>                 at
> org\.apache\.hadoop\.util\.ReflectionUtils\.newInstance(ReflectionUtils\.java:117)
>
>                 at
> org\.apache\.hadoop\.mapred\.MapRunner\.configure(MapRunner\.java:34)
>
>                 \.\.\. 10 more
>
> Caused by: java\.lang\.reflect\.InvocationTargetException
>
>                 at sun\.reflect\.NativeMethodAccessorImpl\.invoke0(Native
> Method)
>
>                 at
> sun\.reflect\.NativeMethodAccessorImpl\.invoke(NativeMethodAccessorImpl\.java:39)
>
>                 at
> sun\.reflect\.DelegatingMethodAccessorImpl\.invoke(DelegatingMethodAccessorImpl\.java:25)
>
>                 at java\.lang\.reflect\.Method\.invoke(Method\.java:597)
>
>                 at
> org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.java:88)
>
>                 \.\.\. 13 more
>
> Caused by: java\.lang\.RuntimeException: configuration exception
>
>                 at
> org\.apache\.hadoop\.streaming\.PipeMapRed\.configure(PipeMapRed\.java:182)
>
>                 at
> org\.apache\.hadoop\.streaming\.PipeMapper\.configure(PipeMapper\.java:63)
>
>                 \.\.\. 18 more
>
> Caused by: java\.io\.IOException: Cannot run program
> \"/tmp/hadoop-ngc/mapred/local/taskTracker/jobcache/job_201006141152_0165/attempt_201006141152_0165_m_000001_2/work/\./CliquerMap\":
> java\.io\.IOException: error\=2, No such file or directory
>
>                 at
> java\.lang\.ProcessBuilder\.start(ProcessBuilder\.java:460)
>
>                 at
> org\.apache\.hadoop\.streaming\.PipeMapRed\.configure(PipeMapRed\.java:166)
>
>                 \.\.\. 19 more
>
> Caused by: java\.io\.IOException: java\.io\.IOException: error\=2, No such
> file or directory
>
>                 at java\.lang\.UNIXProcess\.<init>(UNIXProcess\.java:148)
>
>                 at java\.lang\.ProcessImpl\.start(ProcessImpl\.java:65)
>
>                 at
> java\.lang\.ProcessBuilder\.start(ProcessBuilder\.java:453)
>
>                 \.\.\. 20 more
>
> " .
>
> MapAttempt TASK_TYPE="MAP" TASKID="task_201006141152_0165_m_000000"
> TASK_ATTEMPT_ID="attempt_201006141152_0165_m_000000_3"
> START_TIME="1276574026882"
> TRACKER_NAME="tracker_hadoop38\.aj\.c2fse\.northgrum\.com:localhost/127\.0\.0\.1:45065"
> HTTP_PORT="50060" .
>
> MapAttempt TASK_TYPE="MAP" TASKID="task_201006141152_0165_m_000000"
> TASK_ATTEMPT_ID="attempt_201006141152_0165_m_000000_3" TASK_STATUS="FAILED"
> FINISH_TIME="1276574030934" HOSTNAME="hadoop38\.aj\.c2fse\.northgrum\.com"
> ERROR="java\.lang\.RuntimeException: Error in configuring object
>
>                 at
> org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.java:93)
>
>                 at
> org\.apache\.hadoop\.util\.ReflectionUtils\.setConf(ReflectionUtils\.java:64)
>
>                 at
> org\.apache\.hadoop\.util\.ReflectionUtils\.newInstance(ReflectionUtils\.java:117)
>
>                 at
> org\.apache\.hadoop\.mapred\.MapTask\.runOldMapper(MapTask\.java:354)
>
>                 at
> org\.apache\.hadoop\.mapred\.MapTask\.run(MapTask\.java:307)
>
>                 at
> org\.apache\.hadoop\.mapred\.Child\.main(Child\.java:170)
>
> Caused by: java\.lang\.reflect\.InvocationTargetException
>
>                 at sun\.reflect\.NativeMethodAccessorImpl\.invoke0(Native
> Method)
>
>                 at
> sun\.reflect\.NativeMethodAccessorImpl\.invoke(NativeMethodAccessorImpl\.java:39)
>
>                 at
> sun\.reflect\.DelegatingMethodAccessorImpl\.invoke(DelegatingMethodAccessorImpl\.java:25)
>
>                 at java\.lang\.reflect\.Method\.invoke(Method\.java:597)
>
>                 at
> org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.java:88)
>
>                 \.\.\. 5 more
>
> Caused by: java\.lang\.RuntimeException: Error in configuring object
>
>                 at
> org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.java:93)
>
>                 at
> org\.apache\.hadoop\.util\.ReflectionUtils\.setConf(ReflectionUtils\.java:64)
>
>                 at
> org\.apache\.hadoop\.util\.ReflectionUtils\.newInstance(ReflectionUtils\.java:117)
>
>                 at
> org\.apache\.hadoop\.mapred\.MapRunner\.configure(MapRunner\.java:34)
>
>                 \.\.\. 10 more
>
> Caused by: java\.lang\.reflect\.InvocationTargetException
>
>                 at sun\.reflect\.NativeMethodAccessorImpl\.invoke0(Native
> Method)
>
>                 at
> sun\.reflect\.NativeMethodAccessorImpl\.invoke(NativeMethodAccessorImpl\.java:39)
>
>                 at
> sun\.reflect\.DelegatingMethodAccessorImpl\.invoke(DelegatingMethodAccessorImpl\.java:25)
>
>                 at java\.lang\.reflect\.Method\.invoke(Method\.java:597)
>
>                 at
> org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.java:88)
>
>                 \.\.\. 13 more
>
> Caused by: java\.lang\.RuntimeException: configuration exception
>
>                 at
> org\.apache\.hadoop\.streaming\.PipeMapRed\.configure(PipeMapRed\.java:182)
>
>                 at
> org\.apache\.hadoop\.streaming\.PipeMapper\.configure(PipeMapper\.java:63)
>
>                 \.\.\. 18 more
>
> Caused by: java\.io\.IOException: Cannot run program
> \"/media/hd3/mapred/local/taskTracker/jobcache/job_201006141152_0165/attempt_201006141152_0165_m_000000_3/work/\./CliquerMap\":
> java\.io\.IOException: error\=2, No such file or directory
>
>                 at
> java\.lang\.ProcessBuilder\.start(ProcessBuilder\.java:460)
>
>                 at
> org\.apache\.hadoop\.streaming\.PipeMapRed\.configure(PipeMapRed\.java:166)
>
>                 \.\.\. 19 more
>
> Caused by: java\.io\.IOException: java\.io\.IOException: error\=2, No such
> file or directory
>
>                 at java\.lang\.UNIXProcess\.<init>(UNIXProcess\.java:148)
>
>                 at java\.lang\.ProcessImpl\.start(ProcessImpl\.java:65)
>
>                 at
> java\.lang\.ProcessBuilder\.start(ProcessBuilder\.java:453)
>
>                 \.\.\. 20 more
>
> " .
>
> Task TASKID="task_201006141152_0165_m_000000" TASK_TYPE="MAP"
> TASK_STATUS="FAILED" FINISH_TIME="1276574030934"
> ERROR="java\.lang\.RuntimeException: Error in configuring object
>
>                 at
> org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.java:93)
>
>                 at
> org\.apache\.hadoop\.util\.ReflectionUtils\.setConf(ReflectionUtils\.java:64)
>
>                 at
> org\.apache\.hadoop\.util\.ReflectionUtils\.newInstance(ReflectionUtils\.java:117)
>
>                 at
> org\.apache\.hadoop\.mapred\.MapTask\.runOldMapper(MapTask\.java:354)
>
>                 at
> org\.apache\.hadoop\.mapred\.MapTask\.run(MapTask\.java:307)
>
>                 at
> org\.apache\.hadoop\.mapred\.Child\.main(Child\.java:170)
>
> Caused by: java\.lang\.reflect\.InvocationTargetException
>
>                 at sun\.reflect\.NativeMethodAccessorImpl\.invoke0(Native
> Method)
>
>                 at
> sun\.reflect\.NativeMethodAccessorImpl\.invoke(NativeMethodAccessorImpl\.java:39)
>
>                 at
> sun\.reflect\.DelegatingMethodAccessorImpl\.invoke(DelegatingMethodAccessorImpl\.java:25)
>
>                 at java\.lang\.reflect\.Method\.invoke(Method\.java:597)
>
>                 at
> org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.java:88)
>
>                 \.\.\. 5 more
>
> Caused by: java\.lang\.RuntimeException: Error in configuring object
>
>                 at
> org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.java:93)
>
>                 at
> org\.apache\.hadoop\.util\.ReflectionUtils\.setConf(ReflectionUtils\.java:64)
>
>                 at
> org\.apache\.hadoop\.util\.ReflectionUtils\.newInstance(ReflectionUtils\.java:117)
>
>                 at
> org\.apache\.hadoop\.mapred\.MapRunner\.configure(MapRunner\.java:34)
>
>                 \.\.\. 10 more
>
> Caused by: java\.lang\.reflect\.InvocationTargetException
>
>                 at sun\.reflect\.NativeMethodAccessorImpl\.invoke0(Native
> Method)
>
>                 at
> sun\.reflect\.NativeMethodAccessorImpl\.invoke(NativeMethodAccessorImpl\.java:39)
>
>                 at
> sun\.reflect\.DelegatingMethodAccessorImpl\.invoke(DelegatingMethodAccessorImpl\.java:25)
>
>                 at java\.lang\.reflect\.Method\.invoke(Method\.java:597)
>
>                 at
> org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.java:88)
>
>                 \.\.\. 13 more
>
> Caused by: java\.lang\.RuntimeException: configuration exception
>
>                 at
> org\.apache\.hadoop\.streaming\.PipeMapRed\.configure(PipeMapRed\.java:182)
>
>                 at
> org\.apache\.hadoop\.streaming\.PipeMapper\.configure(PipeMapper\.java:63)
>
>                 \.\.\. 18 more
>
> Caused by: java\.io\.IOException: Cannot run program
> \"/media/hd3/mapred/local/taskTracker/jobcache/job_201006141152_0165/attempt_201006141152_0165_m_000000_3/work/\./CliquerMap\":
> java\.io\.IOException: error\=2, No such file or directory
>
>                 at
> java\.lang\.ProcessBuilder\.start(ProcessBuilder\.java:460)
>
>                 at
> org\.apache\.hadoop\.streaming\.PipeMapRed\.configure(PipeMapRed\.java:166)
>
>                 \.\.\. 19 more
>
> Caused by: java\.io\.IOException: java\.io\.IOException: error\=2, No such
> file or directory
>
>                 at java\.lang\.UNIXProcess\.<init>(UNIXProcess\.java:148)
>
>                 at java\.lang\.ProcessImpl\.start(ProcessImpl\.java:65)
>
>                 at
> java\.lang\.ProcessBuilder\.start(ProcessBuilder\.java:453)
>
>                 \.\.\. 20 more
>
> " TASK_ATTEMPT_ID="" .
>
> Task TASKID="task_201006141152_0165_m_000002" TASK_TYPE="CLEANUP"
> START_TIME="1276545178009" SPLITS="" .
>
> MapAttempt TASK_TYPE="MAP" TASKID="task_201006141152_0165_m_000001"
> TASK_ATTEMPT_ID="attempt_201006141152_0165_m_000001_3"
> START_TIME="1276516443646"
> TRACKER_NAME="tracker_hadoop8\.aj\.c2fse\.northgrum\.com:localhost/127\.0\.0\.1:46295"
> HTTP_PORT="50060" .
>
> MapAttempt TASK_TYPE="MAP" TASKID="task_201006141152_0165_m_000001"
> TASK_ATTEMPT_ID="attempt_201006141152_0165_m_000001_3" TASK_STATUS="FAILED"
> FINISH_TIME="1276516447699" HOSTNAME="hadoop8\.aj\.c2fse\.northgrum\.com"
> ERROR="java\.lang\.RuntimeException: Error in configuring object
>
>                 at
> org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.java:93)
>
>                 at
> org\.apache\.hadoop\.util\.ReflectionUtils\.setConf(ReflectionUtils\.java:64)
>
>                 at
> org\.apache\.hadoop\.util\.ReflectionUtils\.newInstance(ReflectionUtils\.java:117)
>
>                 at
> org\.apache\.hadoop\.mapred\.MapTask\.runOldMapper(MapTask\.java:354)
>
>                 at
> org\.apache\.hadoop\.mapred\.MapTask\.run(MapTask\.java:307)
>
>                 at
> org\.apache\.hadoop\.mapred\.Child\.main(Child\.java:170)
>
> Caused by: java\.lang\.reflect\.InvocationTargetException
>
>                 at sun\.reflect\.NativeMethodAccessorImpl\.invoke0(Native
> Method)
>
>                 at
> sun\.reflect\.NativeMethodAccessorImpl\.invoke(NativeMethodAccessorImpl\.java:39)
>
>                 at
> sun\.reflect\.DelegatingMethodAccessorImpl\.invoke(DelegatingMethodAccessorImpl\.java:25)
>
>                 at java\.lang\.reflect\.Method\.invoke(Method\.java:597)
>
>                 at
> org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.java:88)
>
>                 \.\.\. 5 more
>
> Caused by: java\.lang\.RuntimeException: Error in configuring object
>
>                 at
> org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.java:93)
>
>                 at
> org\.apache\.hadoop\.util\.ReflectionUtils\.setConf(ReflectionUtils\.java:64)
>
>                 at
> org\.apache\.hadoop\.util\.ReflectionUtils\.newInstance(ReflectionUtils\.java:117)
>
>                 at
> org\.apache\.hadoop\.mapred\.MapRunner\.configure(MapRunner\.java:34)
>
>                 \.\.\. 10 more
>
> Caused by: java\.lang\.reflect\.InvocationTargetException
>
>                 at sun\.reflect\.NativeMethodAccessorImpl\.invoke0(Native
> Method)
>
>                 at
> sun\.reflect\.NativeMethodAccessorImpl\.invoke(NativeMethodAccessorImpl\.java:39)
>
>                 at
> sun\.reflect\.DelegatingMethodAccessorImpl\.invoke(DelegatingMethodAccessorImpl\.java:25)
>
>                 at java\.lang\.reflect\.Method\.invoke(Method\.java:597)
>
>                 at
> org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.java:88)
>
>                 \.\.\. 13 more
>
> Caused by: java\.lang\.RuntimeException: configuration exception
>
>                 at
> org\.apache\.hadoop\.streaming\.PipeMapRed\.configure(PipeMapRed\.java:182)
>
>                 at
> org\.apache\.hadoop\.streaming\.PipeMapper\.configure(PipeMapper\.java:63)
>
>                 \.\.\. 18 more
>
> Caused by: java\.io\.IOException: Cannot run program
> \"/media/hd2/mapred/local/taskTracker/jobcache/job_201006141152_0165/attempt_201006141152_0165_m_000001_3/work/\./CliquerMap\":
> java\.io\.IOException: error\=2, No such file or directory
>
>                 at
> java\.lang\.ProcessBuilder\.start(ProcessBuilder\.java:460)
>
>                 at
> org\.apache\.hadoop\.streaming\.PipeMapRed\.configure(PipeMapRed\.java:166)
>
>                 \.\.\. 19 more
>
> Caused by: java\.io\.IOException: java\.io\.IOException: error\=2, No such
> file or directory
>
>                 at java\.lang\.UNIXProcess\.<init>(UNIXProcess\.java:148)
>
>                 at java\.lang\.ProcessImpl\.start(ProcessImpl\.java:65)
>
>                 at
> java\.lang\.ProcessBuilder\.start(ProcessBuilder\.java:453)
>
>                 \.\.\. 20 more
>
> " .
>
> MapAttempt TASK_TYPE="CLEANUP" TASKID="task_201006141152_0165_m_000002"
> TASK_ATTEMPT_ID="attempt_201006141152_0165_m_000002_0"
> START_TIME="1276574032921"
> TRACKER_NAME="tracker_hadoop38\.aj\.c2fse\.northgrum\.com:localhost/127\.0\.0\.1:45065"
> HTTP_PORT="50060" .
>
> MapAttempt TASK_TYPE="CLEANUP" TASKID="task_201006141152_0165_m_000002"
> TASK_ATTEMPT_ID="attempt_201006141152_0165_m_000002_0" TASK_STATUS="SUCCESS"
> FINISH_TIME="1276574033570"
> HOSTNAME="/default-rack/hadoop38\.aj\.c2fse\.northgrum\.com"
> STATE_STRING="cleanup"
> COUNTERS="{(org\.apache\.hadoop\.mapred\.Task$Counter)(Map-Reduce
> Framework)[(SPILLED_RECORDS)(Spilled Records)(0)]}" .
>
> Task TASKID="task_201006141152_0165_m_000002" TASK_TYPE="CLEANUP"
> TASK_STATUS="SUCCESS" FINISH_TIME="1276545181014"
> COUNTERS="{(org\.apache\.hadoop\.mapred\.Task$Counter)(Map-Reduce
> Framework)[(SPILLED_RECORDS)(Spilled Records)(0)]}" .
>
> Job JOBID="job_201006141152_0165" FINISH_TIME="1276545181014"
> JOB_STATUS="FAILED" FINISHED_MAPS="0" FINISHED_REDUCES="0"
>
>
>
> *Alan *
>
>
>
> *From:* Amareshwari Sri Ramadasu [mailto:amarsri@yahoo-inc.com]
> *Sent:* Monday, June 14, 2010 12:44 AM
> *To:* mapreduce-user@hadoop.apache.org
> *Subject:* Re: Irreproducible Streaming Jobs
>
>
>
> I don’t know how your first run passed, but your streaming command should
> be :
>  bin/hadoop jar contrib/streaming/hadoop-0.20.2-streaming.jar -file
> streamingapps/Steg/SDMapper -mapper SDMapper -file streamingapps/Steg/Test2
> -reducer Test2 -input ImageList -output StegOut1
>
> Your mapper/reducer should be the command to run. The paths
> streamingapps/Steg/SDMapper and streamingapps/Steg/Test2 would be present on
> your local filesystem (on client machine), not on compute nodes.
>
> Thanks
> Amareshwari
> On 6/11/10 7:05 PM, "Ratner, Alan S (IS)" <Alan.Ratner@ngc.com> wrote:
>
> Our Hadoop streaming jobs are unpredictable.  The following illustrates
> this problem.  I reset the system first to start with a clean slate
> (deleting tmp files on master and all slaves, reformatting name node, etc.).
>  I then ran a streaming job which gave the expected results.  I then ran the
> exact same job again (using a different output file name) and it bombed.
>  Curiously although the second run generated “no such file or directory”
> errors in the log file but so did the first run.  I suspect that our
> streaming job is doing something wrong (despite the correct results) and
> corrupting the tmp files.  (These jobs were run on 40 servers configured as
> 1 master and 39 slaves.)  Any suggestions?
>
> *FIRST RUN
> *
> ngc@hadoop1:~/hadoop-0.20.2$ bin/hadoop jar
> contrib/streaming/hadoop-0.20.2-streaming.jar -file
> streamingapps/Steg/SDMapper -mapper streamingapps/Steg/SDMapper -file
> streamingapps/Steg/Test2 -reducer streamingapps/Steg/Test2 -input ImageList
> -output StegOut1
>
> packageJobJar: [streamingapps/Steg/SDMapper, streamingapps/Steg/Test2,
> /tmp/hadoop-ngc/hadoop-unjar1378560104000865091/] []
> /tmp/streamjob1574130777925793571.jar tmpDir=null
>
> 10/06/11 08:15:09 INFO mapred.FileInputFormat: Total input paths to process
> : 1
>
> 10/06/11 08:15:09 INFO streaming.StreamJob: getLocalDirs():
> [/tmp/hadoop-ngc/mapred/local, /media/hd2/mapred/local,
> /media/hd3/mapred/local, /media/hd4/mapred/local]
>
> 10/06/11 08:15:09 INFO streaming.StreamJob: Running job:
> job_201006110802_0013
>
> 10/06/11 08:15:09 INFO streaming.StreamJob: To kill this job, run:
>
> 10/06/11 08:15:09 INFO streaming.StreamJob:
> /home/ngc/hadoop-0.20.2/bin/../bin/hadoop job  -Dmapred.job.tracker=
> 10.64.147.2:9002 -kill job_201006110802_0013
>
> 10/06/11 08:15:09 INFO streaming.StreamJob: Tracking URL:
> http://hadoop1.aj.c2fse.northgrum.com:50030/jobdetails.jsp?jobid=job_201006110802_0013
>
> 10/06/11 08:15:10 INFO streaming.StreamJob:  map 0%  reduce 0%
>
> 10/06/11 08:15:22 INFO streaming.StreamJob:  map 50%  reduce 0%
>
> 10/06/11 08:15:28 INFO streaming.StreamJob:  map 100%  reduce 0%
>
> 10/06/11 08:15:31 INFO streaming.StreamJob:  map 100%  reduce 17%
>
> 10/06/11 08:15:40 INFO streaming.StreamJob:  map 100%  reduce 100%
>
> 10/06/11 08:15:43 INFO streaming.StreamJob: Job complete:
> job_201006110802_0013
>
> 10/06/11 08:15:43 INFO streaming.StreamJob: Output: StegOut1
>
> *SECOND RUN
> *
> ngc@hadoop1:~/hadoop-0.20.2$ bin/hadoop jar
> contrib/streaming/hadoop-0.20.2-streaming.jar -file
> streamingapps/Steg/SDMapper -mapper streamingapps/Steg/SDMapper -file
> streamingapps/Steg/Test2 -reducer streamingapps/Steg/Test2 -input ImageList
> -output StegOut2
>
> packageJobJar: [streamingapps/Steg/SDMapper, streamingapps/Steg/Test2,
> /tmp/hadoop-ngc/hadoop-unjar7292727069710530665/] []
> /tmp/streamjob8749080748645718359.jar tmpDir=null
>
> 10/06/11 08:16:00 INFO mapred.FileInputFormat: Total input paths to process
> : 1
>
> 10/06/11 08:16:00 INFO streaming.StreamJob: getLocalDirs():
> [/tmp/hadoop-ngc/mapred/local, /media/hd2/mapred/local,
> /media/hd3/mapred/local, /media/hd4/mapred/local]
>
> 10/06/11 08:16:00 INFO streaming.StreamJob: Running job:
> job_201006110802_0016
>
> 10/06/11 08:16:00 INFO streaming.StreamJob: To kill this job, run:
>
> 10/06/11 08:16:00 INFO streaming.StreamJob:
> /home/ngc/hadoop-0.20.2/bin/../bin/hadoop job  -Dmapred.job.tracker=
> 10.64.147.2:9002 -kill job_201006110802_0016
>
> 10/06/11 08:16:00 INFO streaming.StreamJob: Tracking URL:
> http://hadoop1.aj.c2fse.northgrum.com:50030/jobdetails.jsp?jobid=job_201006110802_0016
>
> 10/06/11 08:16:01 INFO streaming.StreamJob:  map 0%  reduce 0%
>
> 10/06/11 08:16:19 INFO streaming.StreamJob:  map 50%  reduce 0%
>
> 10/06/11 08:16:28 INFO streaming.StreamJob:  map 50%  reduce 17%
>
> 10/06/11 08:16:32 INFO streaming.StreamJob:  map 100%  reduce 100%
>
> 10/06/11 08:16:32 INFO streaming.StreamJob: To kill this job, run:
>
> 10/06/11 08:16:32 INFO streaming.StreamJob:
> /home/ngc/hadoop-0.20.2/bin/../bin/hadoop job  -Dmapred.job.tracker=
> 10.64.147.2:9002 -kill job_201006110802_0016
>
> 10/06/11 08:16:32 INFO streaming.StreamJob: Tracking URL:
> http://hadoop1.aj.c2fse.northgrum.com:50030/jobdetails.jsp?jobid=job_201006110802_0016
>
> 10/06/11 08:16:32 ERROR streaming.StreamJob: Job not Successful!
>
> 10/06/11 08:16:32 INFO streaming.StreamJob: killJob...
>
> Streaming Job Failed!
>
> *MAP LOG FILE OF SECOND RUN
> *
> Meta VERSION="1" .
>
> Job JOBID="job_201006110802_0016"
> JOBNAME="streamjob8749080748645718359\.jar" USER="ngc"
> SUBMIT_TIME="1276258560297"
> JOBCONF="hdfs://hadoop1\.aj\.c2fse\.northgrum\.com:9000/tmp/hadoop-ngc/mapred/system/job_201006110802_0016/job\.xml"
> .
>
> Job JOBID="job_201006110802_0016" JOB_PRIORITY="NORMAL" .
>
> Job JOBID="job_201006110802_0016" LAUNCH_TIME="1276258560564"
> TOTAL_MAPS="2" TOTAL_REDUCES="1" JOB_STATUS="PREP" .
>
> Task TASKID="task_201006110802_0016_m_000003" TASK_TYPE="SETUP"
> START_TIME="1276258560932" SPLITS="" .
>
> MapAttempt TASK_TYPE="SETUP" TASKID="task_201006110802_0016_m_000003"
> TASK_ATTEMPT_ID="attempt_201006110802_0016_m_000003_0"
> START_TIME="1276229924181"
> TRACKER_NAME="tracker_hadoop6\.aj\.c2fse\.northgrum\.com:localhost/127\.0\.0\.1:49372"
> HTTP_PORT="50060" .
>
> MapAttempt TASK_TYPE="SETUP" TASKID="task_201006110802_0016_m_000003"
> TASK_ATTEMPT_ID="attempt_201006110802_0016_m_000003_0" TASK_STATUS="SUCCESS"
> FINISH_TIME="1276229924886"
> HOSTNAME="/default-rack/hadoop6\.aj\.c2fse\.northgrum\.com"
> STATE_STRING="setup"
> COUNTERS="{(org\.apache\.hadoop\.mapred\.Task$Counter)(Map-Reduce
> Framework)[(SPILLED_RECORDS)(Spilled Records)(0)]}" .
>
> Task TASKID="task_201006110802_0016_m_000003" TASK_TYPE="SETUP"
> TASK_STATUS="SUCCESS" FINISH_TIME="1276258563937"
> COUNTERS="{(org\.apache\.hadoop\.mapred\.Task$Counter)(Map-Reduce
> Framework)[(SPILLED_RECORDS)(Spilled Records)(0)]}" .
>
> Job JOBID="job_201006110802_0016" JOB_STATUS="RUNNING" .
>
> Task TASKID="task_201006110802_0016_m_000000" TASK_TYPE="MAP"
> START_TIME="1276258563937"
> SPLITS="/default-rack/hadoop20\.aj\.c2fse\.northgrum\.com,/default-rack/hadoop17\.aj\.c2fse\.northgrum\.com"
> .
>
> Task TASKID="task_201006110802_0016_m_000001" TASK_TYPE="MAP"
> START_TIME="1276258564747"
> SPLITS="/default-rack/hadoop20\.aj\.c2fse\.northgrum\.com,/default-rack/hadoop17\.aj\.c2fse\.northgrum\.com"
> .
>
> MapAttempt TASK_TYPE="MAP" TASKID="task_201006110802_0016_m_000000"
> TASK_ATTEMPT_ID="attempt_201006110802_0016_m_000000_0"
> START_TIME="1276229927063"
> TRACKER_NAME="tracker_hadoop6\.aj\.c2fse\.northgrum\.com:localhost/127\.0\.0\.1:49372"
> HTTP_PORT="50060" .
>
> MapAttempt TASK_TYPE="MAP" TASKID="task_201006110802_0016_m_000000"
> TASK_ATTEMPT_ID="attempt_201006110802_0016_m_000000_0" TASK_STATUS="FAILED"
> FINISH_TIME="1276229931379" HOSTNAME="hadoop6\.aj\.c2fse\.northgrum\.com"
> ERROR="java\.lang\.RuntimeException: Error in configuring object
>
>         at
> org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.java:93)
>
>         at
> org\.apache\.hadoop\.util\.ReflectionUtils\.setConf(ReflectionUtils\.java:64)
>
>         at
> org\.apache\.hadoop\.util\.ReflectionUtils\.newInstance(ReflectionUtils\.java:117)
>
>         at
> org\.apache\.hadoop\.mapred\.MapTask\.runOldMapper(MapTask\.java:354)
>
>         at org\.apache\.hadoop\.mapred\.MapTask\.run(MapTask\.java:307)
>
>         at org\.apache\.hadoop\.mapred\.Child\.main(Child\.java:170)
>
> Caused by: java\.lang\.reflect\.InvocationTargetException
>
>         at sun\.reflect\.NativeMethodAccessorImpl\.invoke0(Native Method)
>
>         at
> sun\.reflect\.NativeMethodAccessorImpl\.invoke(NativeMethodAccessorImpl\.java:39)
>
>         at
> sun\.reflect\.DelegatingMethodAccessorImpl\.invoke(DelegatingMethodAccessorImpl\.java:25)
>
>         at java\.lang\.reflect\.Method\.invoke(Method\.java:597)
>
>         at
> org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.java:88)
>
>         \.\.\. 5 more
>
> Caused by: java\.lang\.RuntimeException: Error in configuring object
>
>         at
> org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.java:93)
>
>         at
> org\.apache\.hadoop\.util\.ReflectionUtils\.setConf(ReflectionUtils\.java:64)
>
>         at
> org\.apache\.hadoop\.util\.ReflectionUtils\.newInstance(ReflectionUtils\.java:117)
>
>         at
> org\.apache\.hadoop\.mapred\.MapRunner\.configure(MapRunner\.java:34)
>
>         \.\.\. 10 more
>
> Caused by: java\.lang\.reflect\.InvocationTargetException
>
>         at sun\.reflect\.NativeMethodAccessorImpl\.invoke0(Native Method)
>
>         at
> sun\.reflect\.NativeMethodAccessorImpl\.invoke(NativeMethodAccessorImpl\.java:39)
>
>         at
> sun\.reflect\.DelegatingMethodAccessorImpl\.invoke(DelegatingMethodAccessorImpl\.java:25)
>
>         at java\.lang\.reflect\.Method\.invoke(Method\.java:597)
>
>         at
> org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.java:88)
>
>         \.\.\. 13 more
>
> Caused by: java\.lang\.RuntimeException: configuration exception
>
>         at
> org\.apache\.hadoop\.streaming\.PipeMapRed\.configure(PipeMapRed\.java:182)
>
>         at
> org\.apache\.hadoop\.streaming\.PipeMapper\.configure(PipeMapper\.java:63)
>
>         \.\.\. 18 more
>
> Caused by: java\.io\.IOException: Cannot run program
> \"/tmp/hadoop-ngc/mapred/local/taskTracker/jobcache/job_201006110802_0016/attempt_201006110802_0016_m_000000_0/work/\./SDMapper\":
> java\.io\.IOException: error\=2, No such file or directory
>
>         at java\.lang\.ProcessBuilder\.start(ProcessBuilder\.java:460)
>
>         at
> org\.apache\.hadoop\.streaming\.PipeMapRed\.configure(PipeMapRed\.java:166)
>
>         \.\.\. 19 more
>
> Caused by: java\.io\.IOException: java\.io\.IOException: error\=2, No such
> file or directory
>
>         at java\.lang\.UNIXProcess\.<init>(UNIXProcess\.java:148)
>
>         at java\.lang\.ProcessImpl\.start(ProcessImpl\.java:65)
>
>         at java\.lang\.ProcessBuilder\.start(ProcessBuilder\.java:453)
>
>         \.\.\. 20 more
>
> " .
>
> MapAttempt TASK_TYPE="MAP" TASKID="task_201006110802_0016_m_000001"
> TASK_ATTEMPT_ID="attempt_201006110802_0016_m_000001_0"
> START_TIME="1276229819233"
> TRACKER_NAME="tracker_hadoop8\.aj\.c2fse\.northgrum\.com:localhost/127\.0\.0\.1:35631"
> HTTP_PORT="50060" .
>
> MapAttempt TASK_TYPE="MAP" TASKID="task_201006110802_0016_m_000001"
> TASK_ATTEMPT_ID="attempt_201006110802_0016_m_000001_0" TASK_STATUS="FAILED"
> FINISH_TIME="1276229823283" HOSTNAME="hadoop8\.aj\.c2fse\.northgrum\.com"
> ERROR="java\.lang\.RuntimeException: Error in configuring object
>
>         at
> org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.java:93)
>
>         at
> org\.apache\.hadoop\.util\.ReflectionUtils\.setConf(ReflectionUtils\.java:64)
>
>         at
> org\.apache\.hadoop\.util\.ReflectionUtils\.newInstance(ReflectionUtils\.java:117)
>
>         at
> org\.apache\.hadoop\.mapred\.MapTask\.runOldMapper(MapTask\.java:354)
>
>         at org\.apache\.hadoop\.mapred\.MapTask\.run(MapTask\.java:307)
>
>         at org\.apache\.hadoop\.mapred\.Child\.main(Child\.java:170)
>
> Caused by: java\.lang\.reflect\.InvocationTargetException
>
>         at sun\.reflect\.NativeMethodAccessorImpl\.invoke0(Native Method)
>
>         at
> sun\.reflect\.NativeMethodAccessorImpl\.invoke(NativeMethodAccessorImpl\.java:39)
>
>         at
> sun\.reflect\.DelegatingMethodAccessorImpl\.invoke(DelegatingMethodAccessorImpl\.java:25)
>
>         at java\.lang\.reflect\.Method\.invoke(Method\.java:597)
>
>         at
> org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.java:88)
>
>         \.\.\. 5 more
>
> Caused by: java\.lang\.RuntimeException: Error in configuring object
>
>         at
> org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.java:93)
>
>         at
> org\.apache\.hadoop\.util\.ReflectionUtils\.setConf(ReflectionUtils\.java:64)
>
>         at
> org\.apache\.hadoop\.util\.ReflectionUtils\.newInstance(ReflectionUtils\.java:117)
>
>         at
> org\.apache\.hadoop\.mapred\.MapRunner\.configure(MapRunner\.java:34)
>
>         \.\.\. 10 more
>
> Caused by: java\.lang\.reflect\.InvocationTargetException
>
>         at sun\.reflect\.NativeMethodAccessorImpl\.invoke0(Native Method)
>
>         at
> sun\.reflect\.NativeMethodAccessorImpl\.invoke(NativeMethodAccessorImpl\.java:39)
>
>         at
> sun\.reflect\.DelegatingMethodAccessorImpl\.invoke(DelegatingMethodAccessorImpl\.java:25)
>
>         at java\.lang\.reflect\.Method\.invoke(Method\.java:597)
>
>         at
> org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.java:88)
>
>         \.\.\. 13 more
>
> Caused by: java\.lang\.RuntimeException: configuration exception
>
>         at
> org\.apache\.hadoop\.streaming\.PipeMapRed\.configure(PipeMapRed\.java:182)
>
>         at
> org\.apache\.hadoop\.streaming\.PipeMapper\.configure(PipeMapper\.java:63)
>
>         \.\.\. 18 more
>
> Caused by: java\.io\.IOException: Cannot run program
> \"/media/hd3/mapred/local/taskTracker/jobcache/job_201006110802_0016/attempt_201006110802_0016_m_000001_0/work/\./SDMapper\":
> java\.io\.IOException: error\=2, No such file or directory
>
>         at java\.lang\.ProcessBuilder\.start(ProcessBuilder\.java:460)
>
>         at
> org\.apache\.hadoop\.streaming\.PipeMapRed\.configure(PipeMapRed\.java:166)
>
>         \.\.\. 19 more
>
> Caused by: java\.io\.IOException: java\.io\.IOException: error\=2, No such
> file or directory
>
>         at java\.lang\.UNIXProcess\.<init>(UNIXProcess\.java:148)
>
>         at java\.lang\.ProcessImpl\.start(ProcessImpl\.java:65)
>
>         at java\.lang\.ProcessBuilder\.start(ProcessBuilder\.java:453)
>
>         \.\.\. 20 more
>
> " .
>
> MapAttempt TASK_TYPE="MAP" TASKID="task_201006110802_0016_m_000000"
> TASK_ATTEMPT_ID="attempt_201006110802_0016_m_000000_1"
> START_TIME="1276230008685"
> TRACKER_NAME="tracker_hadoop3\.aj\.c2fse\.northgrum\.com:localhost/127\.0\.0\.1:34294"
> HTTP_PORT="50060" .
>
> MapAttempt TASK_TYPE="MAP" TASKID="task_201006110802_0016_m_000000"
> TASK_ATTEMPT_ID="attempt_201006110802_0016_m_000000_1" TASK_STATUS="FAILED"
> FINISH_TIME="1276230012735" HOSTNAME="hadoop3\.aj\.c2fse\.northgrum\.com"
> ERROR="java\.lang\.RuntimeException: Error in configuring object
>
>         at
> org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.java:93)
>
>         at
> org\.apache\.hadoop\.util\.ReflectionUtils\.setConf(ReflectionUtils\.java:64)
>
>         at
> org\.apache\.hadoop\.util\.ReflectionUtils\.newInstance(ReflectionUtils\.java:117)
>
>         at
> org\.apache\.hadoop\.mapred\.MapTask\.runOldMapper(MapTask\.java:354)
>
>         at org\.apache\.hadoop\.mapred\.MapTask\.run(MapTask\.java:307)
>
>         at org\.apache\.hadoop\.mapred\.Child\.main(Child\.java:170)
>
> Caused by: java\.lang\.reflect\.InvocationTargetException
>
>         at sun\.reflect\.NativeMethodAccessorImpl\.invoke0(Native Method)
>
>         at
> sun\.reflect\.NativeMethodAccessorImpl\.invoke(NativeMethodAccessorImpl\.java:39)
>
>         at
> sun\.reflect\.DelegatingMethodAccessorImpl\.invoke(DelegatingMethodAccessorImpl\.java:25)
>
>         at java\.lang\.reflect\.Method\.invoke(Method\.java:597)
>
>         at
> org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.java:88)
>
>         \.\.\. 5 more
>
> Caused by: java\.lang\.RuntimeException: Error in configuring object
>
>         at
> org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.java:93)
>
>         at
> org\.apache\.hadoop\.util\.ReflectionUtils\.setConf(ReflectionUtils\.java:64)
>
>         at
> org\.apache\.hadoop\.util\.ReflectionUtils\.newInstance(ReflectionUtils\.java:117)
>
>         at
> org\.apache\.hadoop\.mapred\.MapRunner\.configure(MapRunner\.java:34)
>
>         \.\.\. 10 more
>
> Caused by: java\.lang\.reflect\.InvocationTargetException
>
>         at sun\.reflect\.NativeMethodAccessorImpl\.invoke0(Native Method)
>
>         at
> sun\.reflect\.NativeMethodAccessorImpl\.invoke(NativeMethodAccessorImpl\.java:39)
>
>         at
> sun\.reflect\.DelegatingMethodAccessorImpl\.invoke(DelegatingMethodAccessorImpl\.java:25)
>
>         at java\.lang\.reflect\.Method\.invoke(Method\.java:597)
>
>         at
> org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.java:88)
>
>         \.\.\. 13 more
>
> Caused by: java\.lang\.RuntimeException: configuration exception
>
>         at
> org\.apache\.hadoop\.streaming\.PipeMapRed\.configure(PipeMapRed\.java:182)
>
>         at
> org\.apache\.hadoop\.streaming\.PipeMapper\.configure(PipeMapper\.java:63)
>
>         \.\.\. 18 more
>
> Caused by: java\.io\.IOException: Cannot run program
> \"/media/hd2/mapred/local/taskTracker/jobcache/job_201006110802_0016/attempt_201006110802_0016_m_000000_1/work/\./SDMapper\":
> java\.io\.IOException: error\=2, No such file or directory
>
>         at java\.lang\.ProcessBuilder\.start(ProcessBuilder\.java:460)
>
>         at
> org\.apache\.hadoop\.streaming\.PipeMapRed\.configure(PipeMapRed\.java:166)
>
>         \.\.\. 19 more
>
> Caused by: java\.io\.IOException: java\.io\.IOException: error\=2, No such
> file or directory
>
>         at java\.lang\.UNIXProcess\.<init>(UNIXProcess\.java:148)
>
>         at java\.lang\.ProcessImpl\.start(ProcessImpl\.java:65)
>
>         at java\.lang\.ProcessBuilder\.start(ProcessBuilder\.java:453)
>
>         \.\.\. 20 more
>
> " .
>
> MapAttempt TASK_TYPE="MAP" TASKID="task_201006110802_0016_m_000001"
> TASK_ATTEMPT_ID="attempt_201006110802_0016_m_000001_1"
> START_TIME="1276229520733"
> TRACKER_NAME="tracker_hadoop23\.aj\.c2fse\.northgrum\.com:localhost/127\.0\.0\.1:58025"
> HTTP_PORT="50060" .
>
> MapAttempt TASK_TYPE="MAP" TASKID="task_201006110802_0016_m_000001"
> TASK_ATTEMPT_ID="attempt_201006110802_0016_m_000001_1" TASK_STATUS="FAILED"
> FINISH_TIME="1276229524784" HOSTNAME="hadoop23\.aj\.c2fse\.northgrum\.com"
> ERROR="java\.lang\.RuntimeException: Error in configuring object
>
>         at
> org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.java:93)
>
>         at
> org\.apache\.hadoop\.util\.ReflectionUtils\.setConf(ReflectionUtils\.java:64)
>
>         at
> org\.apache\.hadoop\.util\.ReflectionUtils\.newInstance(ReflectionUtils\.java:117)
>
>         at
> org\.apache\.hadoop\.mapred\.MapTask\.runOldMapper(MapTask\.java:354)
>
>         at org\.apache\.hadoop\.mapred\.MapTask\.run(MapTask\.java:307)
>
>         at org\.apache\.hadoop\.mapred\.Child\.main(Child\.java:170)
>
> Caused by: java\.lang\.reflect\.InvocationTargetException
>
>         at sun\.reflect\.NativeMethodAccessorImpl\.invoke0(Native Method)
>
>         at
> sun\.reflect\.NativeMethodAccessorImpl\.invoke(NativeMethodAccessorImpl\.java:39)
>
>         at
> sun\.reflect\.DelegatingMethodAccessorImpl\.invoke(DelegatingMethodAccessorImpl\.java:25)
>
>         at java\.lang\.reflect\.Method\.invoke(Method\.java:597)
>
>         at
> org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.java:88)
>
>         \.\.\. 5 more
>
> Caused by: java\.lang\.RuntimeException: Error in configuring object
>
>         at
> org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.java:93)
>
>         at
> org\.apache\.hadoop\.util\.ReflectionUtils\.setConf(ReflectionUtils\.java:64)
>
>         at
> org\.apache\.hadoop\.util\.ReflectionUtils\.newInstance(ReflectionUtils\.java:117)
>
>         at
> org\.apache\.hadoop\.mapred\.MapRunner\.configure(MapRunner\.java:34)
>
>         \.\.\. 10 more
>
> Caused by: java\.lang\.reflect\.InvocationTargetException
>
>         at sun\.reflect\.NativeMethodAccessorImpl\.invoke0(Native Method)
>
>         at
> sun\.reflect\.NativeMethodAccessorImpl\.invoke(NativeMethodAccessorImpl\.java:39)
>
>         at
> sun\.reflect\.DelegatingMethodAccessorImpl\.invoke(DelegatingMethodAccessorImpl\.java:25)
>
>         at java\.lang\.reflect\.Method\.invoke(Method\.java:597)
>
>         at
> org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.java:88)
>
>         \.\.\. 13 more
>
> Caused by: java\.lang\.RuntimeException: configuration exception
>
>         at
> org\.apache\.hadoop\.streaming\.PipeMapRed\.configure(PipeMapRed\.java:182)
>
>         at
> org\.apache\.hadoop\.streaming\.PipeMapper\.configure(PipeMapper\.java:63)
>
>         \.\.\. 18 more
>
> Caused by: java\.io\.IOException: Cannot run program
> \"/tmp/hadoop-ngc/mapred/local/taskTracker/jobcache/job_201006110802_0016/attempt_201006110802_0016_m_000001_1/work/\./SDMapper\":
> java\.io\.IOException: error\=2, No such file or directory
>
>         at java\.lang\.ProcessBuilder\.start(ProcessBuilder\.java:460)
>
>         at
> org\.apache\.hadoop\.streaming\.PipeMapRed\.configure(PipeMapRed\.java:166)
>
>         \.\.\. 19 more
>
> Caused by: java\.io\.IOException: java\.io\.IOException: error\=2, No such
> file or directory
>
>         at java\.lang\.UNIXProcess\.<init>(UNIXProcess\.java:148)
>
>         at java\.lang\.ProcessImpl\.start(ProcessImpl\.java:65)
>
>         at java\.lang\.ProcessBuilder\.start(ProcessBuilder\.java:453)
>
>         \.\.\. 20 more
>
> " .
>
> MapAttempt TASK_TYPE="MAP" TASKID="task_201006110802_0016_m_000000"
> TASK_ATTEMPT_ID="attempt_201006110802_0016_m_000000_2"
> START_TIME="1276229773743"
> TRACKER_NAME="tracker_hadoop2\.aj\.c2fse\.northgrum\.com:localhost/127\.0\.0\.1:51829"
> HTTP_PORT="50060" .
>
> MapAttempt TASK_TYPE="MAP" TASKID="task_201006110802_0016_m_000000"
> TASK_ATTEMPT_ID="attempt_201006110802_0016_m_000000_2" TASK_STATUS="SUCCESS"
> FINISH_TIME="1276229774851"
> HOSTNAME="/default-rack/hadoop2\.aj\.c2fse\.northgrum\.com"
> STATE_STRING="Records R/W\=1/1"
> COUNTERS="{(FileSystemCounters)(FileSystemCounters)[(HDFS_BYTES_READ)(HDFS_BYTES_READ)(18)][(FILE_BYTES_WRITTEN)(FILE_BYTES_WRITTEN)(94)]}{(org\.apache\.hadoop\.mapred\.Task$Counter)(Map-Reduce
> Framework)[(COMBINE_OUTPUT_RECORDS)(Combine output
> records)(0)][(MAP_INPUT_RECORDS)(Map input
> records)(1)][(SPILLED_RECORDS)(Spilled Records)(1)][(MAP_OUTPUT_BYTES)(Map
> output bytes)(54)][(MAP_INPUT_BYTES)(Map input
> bytes)(18)][(COMBINE_INPUT_RECORDS)(Combine input
> records)(0)][(MAP_OUTPUT_RECORDS)(Map output records)(1)]}" .
>
> Task TASKID="task_201006110802_0016_m_000000" TASK_TYPE="MAP"
> TASK_STATUS="SUCCESS" FINISH_TIME="1276258579350"
> COUNTERS="{(FileSystemCounters)(FileSystemCounters)[(HDFS_BYTES_READ)(HDFS_BYTES_READ)(18)][(FILE_BYTES_WRITTEN)(FILE_BYTES_WRITTEN)(94)]}{(org\.apache\.hadoop\.mapred\.Task$Counter)(Map-Reduce
> Framework)[(COMBINE_OUTPUT_RECORDS)(Combine output
> records)(0)][(MAP_INPUT_RECORDS)(Map input
> records)(1)][(SPILLED_RECORDS)(Spilled Records)(1)][(MAP_OUTPUT_BYTES)(Map
> output bytes)(54)][(MAP_INPUT_BYTES)(Map input
> bytes)(18)][(COMBINE_INPUT_RECORDS)(Combine input
> records)(0)][(MAP_OUTPUT_RECORDS)(Map output records)(1)]}" .
>
> Task TASKID="task_201006110802_0016_r_000000" TASK_TYPE="REDUCE"
> START_TIME="1276258579351" SPLITS="" .
>
> MapAttempt TASK_TYPE="MAP" TASKID="task_201006110802_0016_m_000001"
> TASK_ATTEMPT_ID="attempt_201006110802_0016_m_000001_2"
> START_TIME="1276316358506"
> TRACKER_NAME="tracker_hadoop24\.aj\.c2fse\.northgrum\.com:localhost/127\.0\.0\.1:38111"
> HTTP_PORT="50060" .
>
> MapAttempt TASK_TYPE="MAP" TASKID="task_201006110802_0016_m_000001"
> TASK_ATTEMPT_ID="attempt_201006110802_0016_m_000001_2" TASK_STATUS="FAILED"
> FINISH_TIME="1276316362553" HOSTNAME="hadoop24\.aj\.c2fse\.northgrum\.com"
> ERROR="java\.lang\.RuntimeException: Error in configuring object
>
>         at
> org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.java:93)
>
>         at
> org\.apache\.hadoop\.util\.ReflectionUtils\.setConf(ReflectionUtils\.java:64)
>
>         at
> org\.apache\.hadoop\.util\.ReflectionUtils\.newInstance(ReflectionUtils\.java:117)
>
>         at
> org\.apache\.hadoop\.mapred\.MapTask\.runOldMapper(MapTask\.java:354)
>
>         at org\.apache\.hadoop\.mapred\.MapTask\.run(MapTask\.java:307)
>
>         at org\.apache\.hadoop\.mapred\.Child\.main(Child\.java:170)
>
> Caused by: java\.lang\.reflect\.InvocationTargetException
>
>         at sun\.reflect\.NativeMethodAccessorImpl\.invoke0(Native Method)
>
>         at
> sun\.reflect\.NativeMethodAccessorImpl\.invoke(NativeMethodAccessorImpl\.java:39)
>
>         at
> sun\.reflect\.DelegatingMethodAccessorImpl\.invoke(DelegatingMethodAccessorImpl\.java:25)
>
>         at java\.lang\.reflect\.Method\.invoke(Method\.java:597)
>
>         at
> org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.java:88)
>
>         \.\.\. 5 more
>
> Caused by: java\.lang\.RuntimeException: Error in configuring object
>
>         at
> org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.java:93)
>
>         at
> org\.apache\.hadoop\.util\.ReflectionUtils\.setConf(ReflectionUtils\.java:64)
>
>         at
> org\.apache\.hadoop\.util\.ReflectionUtils\.newInstance(ReflectionUtils\.java:117)
>
>         at
> org\.apache\.hadoop\.mapred\.MapRunner\.configure(MapRunner\.java:34)
>
>         \.\.\. 10 more
>
> Caused by: java\.lang\.reflect\.InvocationTargetException
>
>         at sun\.reflect\.NativeMethodAccessorImpl\.invoke0(Native Method)
>
>         at
> sun\.reflect\.NativeMethodAccessorImpl\.invoke(NativeMethodAccessorImpl\.java:39)
>
>         at
> sun\.reflect\.DelegatingMethodAccessorImpl\.invoke(DelegatingMethodAccessorImpl\.java:25)
>
>         at java\.lang\.reflect\.Method\.invoke(Method\.java:597)
>
>         at
> org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.java:88)
>
>         \.\.\. 13 more
>
> Caused by: java\.lang\.RuntimeException: configuration exception
>
>         at
> org\.apache\.hadoop\.streaming\.PipeMapRed\.configure(PipeMapRed\.java:182)
>
>         at
> org\.apache\.hadoop\.streaming\.PipeMapper\.configure(PipeMapper\.java:63)
>
>         \.\.\. 18 more
>
> Caused by: java\.io\.IOException: Cannot run program
> \"/tmp/hadoop-ngc/mapred/local/taskTracker/jobcache/job_201006110802_0016/attempt_201006110802_0016_m_000001_2/work/\./SDMapper\":
> java\.io\.IOException: error\=2, No such file or directory
>
>         at java\.lang\.ProcessBuilder\.start(ProcessBuilder\.java:460)
>
>         at
> org\.apache\.hadoop\.streaming\.PipeMapRed\.configure(PipeMapRed\.java:166)
>
>         \.\.\. 19 more
>
> Caused by: java\.io\.IOException: java\.io\.IOException: error\=2, No such
> file or directory
>
>         at java\.lang\.UNIXProcess\.<init>(UNIXProcess\.java:148)
>
>         at java\.lang\.ProcessImpl\.start(ProcessImpl\.java:65)
>
>         at java\.lang\.ProcessBuilder\.start(ProcessBuilder\.java:453)
>
>         \.\.\. 20 more
>
> " .
>
> MapAttempt TASK_TYPE="MAP" TASKID="task_201006110802_0016_m_000001"
> TASK_ATTEMPT_ID="attempt_201006110802_0016_m_000001_3"
> START_TIME="1276229596341"
> TRACKER_NAME="tracker_hadoop19\.aj\.c2fse\.northgrum\.com:localhost/127\.0\.0\.1:56345"
> HTTP_PORT="50060" .
>
> MapAttempt TASK_TYPE="MAP" TASKID="task_201006110802_0016_m_000001"
> TASK_ATTEMPT_ID="attempt_201006110802_0016_m_000001_3" TASK_STATUS="FAILED"
> FINISH_TIME="1276229600392" HOSTNAME="hadoop19\.aj\.c2fse\.northgrum\.com"
> ERROR="java\.lang\.RuntimeException: Error in configuring object
>
>         at
> org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.java:93)
>
>         at
> org\.apache\.hadoop\.util\.ReflectionUtils\.setConf(ReflectionUtils\.java:64)
>
>         at
> org\.apache\.hadoop\.util\.ReflectionUtils\.newInstance(ReflectionUtils\.java:117)
>
>         at
> org\.apache\.hadoop\.mapred\.MapTask\.runOldMapper(MapTask\.java:354)
>
>         at org\.apache\.hadoop\.mapred\.MapTask\.run(MapTask\.java:307)
>
>         at org\.apache\.hadoop\.mapred\.Child\.main(Child\.java:170)
>
> Caused by: java\.lang\.reflect\.InvocationTargetException
>
>         at sun\.reflect\.NativeMethodAccessorImpl\.invoke0(Native Method)
>
>         at
> sun\.reflect\.NativeMethodAccessorImpl\.invoke(NativeMethodAccessorImpl\.java:39)
>
>         at
> sun\.reflect\.DelegatingMethodAccessorImpl\.invoke(DelegatingMethodAccessorImpl\.java:25)
>
>         at java\.lang\.reflect\.Method\.invoke(Method\.java:597)
>
>         at
> org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.java:88)
>
>         \.\.\. 5 more
>
> Caused by: java\.lang\.RuntimeException: Error in configuring object
>
>         at
> org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.java:93)
>
>         at
> org\.apache\.hadoop\.util\.ReflectionUtils\.setConf(ReflectionUtils\.java:64)
>
>         at
> org\.apache\.hadoop\.util\.ReflectionUtils\.newInstance(ReflectionUtils\.java:117)
>
>         at
> org\.apache\.hadoop\.mapred\.MapRunner\.configure(MapRunner\.java:34)
>
>         \.\.\. 10 more
>
> Caused by: java\.lang\.reflect\.InvocationTargetException
>
>         at sun\.reflect\.NativeMethodAccessorImpl\.invoke0(Native Method)
>
>         at
> sun\.reflect\.NativeMethodAccessorImpl\.invoke(NativeMethodAccessorImpl\.java:39)
>
>         at
> sun\.reflect\.DelegatingMethodAccessorImpl\.invoke(DelegatingMethodAccessorImpl\.java:25)
>
>         at java\.lang\.reflect\.Method\.invoke(Method\.java:597)
>
>         at
> org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.java:88)
>
>         \.\.\. 13 more
>
> Caused by: java\.lang\.RuntimeException: configuration exception
>
>         at
> org\.apache\.hadoop\.streaming\.PipeMapRed\.configure(PipeMapRed\.java:182)
>
>         at
> org\.apache\.hadoop\.streaming\.PipeMapper\.configure(PipeMapper\.java:63)
>
>         \.\.\. 18 more
>
> Caused by: java\.io\.IOException: Cannot run program
> \"/media/hd2/mapred/local/taskTracker/jobcache/job_201006110802_0016/attempt_201006110802_0016_m_000001_3/work/\./SDMapper\":
> java\.io\.IOException: error\=2, No such file or directory
>
>         at java\.lang\.ProcessBuilder\.start(ProcessBuilder\.java:460)
>
>         at
> org\.apache\.hadoop\.streaming\.PipeMapRed\.configure(PipeMapRed\.java:166)
>
>         \.\.\. 19 more
>
> Caused by: java\.io\.IOException: java\.io\.IOException: error\=2, No such
> file or directory
>
>         at java\.lang\.UNIXProcess\.<init>(UNIXProcess\.java:148)
>
>         at java\.lang\.ProcessImpl\.start(ProcessImpl\.java:65)
>
>         at java\.lang\.ProcessBuilder\.start(ProcessBuilder\.java:453)
>
>         \.\.\. 20 more
>
> " .
>
> Task TASKID="task_201006110802_0016_m_000001" TASK_TYPE="MAP"
> TASK_STATUS="FAILED" FINISH_TIME="1276229600392"
> ERROR="java\.lang\.RuntimeException: Error in configuring object
>
>         at
> org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.java:93)
>
>         at
> org\.apache\.hadoop\.util\.ReflectionUtils\.setConf(ReflectionUtils\.java:64)
>
>         at
> org\.apache\.hadoop\.util\.ReflectionUtils\.newInstance(ReflectionUtils\.java:117)
>
>         at
> org\.apache\.hadoop\.mapred\.MapTask\.runOldMapper(MapTask\.java:354)
>
>         at org\.apache\.hadoop\.mapred\.MapTask\.run(MapTask\.java:307)
>
>         at org\.apache\.hadoop\.mapred\.Child\.main(Child\.java:170)
>
> Caused by: java\.lang\.reflect\.InvocationTargetException
>
>         at sun\.reflect\.NativeMethodAccessorImpl\.invoke0(Native Method)
>
>         at
> sun\.reflect\.NativeMethodAccessorImpl\.invoke(NativeMethodAccessorImpl\.java:39)
>
>         at
> sun\.reflect\.DelegatingMethodAccessorImpl\.invoke(DelegatingMethodAccessorImpl\.java:25)
>
>         at java\.lang\.reflect\.Method\.invoke(Method\.java:597)
>
>         at
> org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.java:88)
>
>         \.\.\. 5 more
>
> Caused by: java\.lang\.RuntimeException: Error in configuring object
>
>         at
> org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.java:93)
>
>         at
> org\.apache\.hadoop\.util\.ReflectionUtils\.setConf(ReflectionUtils\.java:64)
>
>         at
> org\.apache\.hadoop\.util\.ReflectionUtils\.newInstance(ReflectionUtils\.java:117)
>
>         at
> org\.apache\.hadoop\.mapred\.MapRunner\.configure(MapRunner\.java:34)
>
>         \.\.\. 10 more
>
> Caused by: java\.lang\.reflect\.InvocationTargetException
>
>         at sun\.reflect\.NativeMethodAccessorImpl\.invoke0(Native Method)
>
>         at
> sun\.reflect\.NativeMethodAccessorImpl\.invoke(NativeMethodAccessorImpl\.java:39)
>
>         at
> sun\.reflect\.DelegatingMethodAccessorImpl\.invoke(DelegatingMethodAccessorImpl\.java:25)
>
>         at java\.lang\.reflect\.Method\.invoke(Method\.java:597)
>
>         at
> org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.java:88)
>
>         \.\.\. 13 more
>
> Caused by: java\.lang\.RuntimeException: configuration exception
>
>         at
> org\.apache\.hadoop\.streaming\.PipeMapRed\.configure(PipeMapRed\.java:182)
>
>         at
> org\.apache\.hadoop\.streaming\.PipeMapper\.configure(PipeMapper\.java:63)
>
>         \.\.\. 18 more
>
> Caused by: java\.io\.IOException: Cannot run program
> \"/media/hd2/mapred/local/taskTracker/jobcache/job_201006110802_0016/attempt_201006110802_0016_m_000001_3/work/\./SDMapper\":
> java\.io\.IOException: error\=2, No such file or directory
>
>         at java\.lang\.ProcessBuilder\.start(ProcessBuilder\.java:460)
>
>         at
> org\.apache\.hadoop\.streaming\.PipeMapRed\.configure(PipeMapRed\.java:166)
>
>         \.\.\. 19 more
>
> Caused by: java\.io\.IOException: java\.io\.IOException: error\=2, No such
> file or directory
>
>         at java\.lang\.UNIXProcess\.<init>(UNIXProcess\.java:148)
>
>         at java\.lang\.ProcessImpl\.start(ProcessImpl\.java:65)
>
>         at java\.lang\.ProcessBuilder\.start(ProcessBuilder\.java:453)
>
>         \.\.\. 20 more
>
> " TASK_ATTEMPT_ID="" .
>
> Task TASKID="task_201006110802_0016_m_000002" TASK_TYPE="CLEANUP"
> START_TIME="1276258589119" SPLITS="" .
>
> MapAttempt TASK_TYPE="CLEANUP" TASKID="task_201006110802_0016_m_000002"
> TASK_ATTEMPT_ID="attempt_201006110802_0016_m_000002_0"
> START_TIME="1276229602209"
> TRACKER_NAME="tracker_hadoop19\.aj\.c2fse\.northgrum\.com:localhost/127\.0\.0\.1:56345"
> HTTP_PORT="50060" .
>
> MapAttempt TASK_TYPE="CLEANUP" TASKID="task_201006110802_0016_m_000002"
> TASK_ATTEMPT_ID="attempt_201006110802_0016_m_000002_0" TASK_STATUS="SUCCESS"
> FINISH_TIME="1276229602877"
> HOSTNAME="/default-rack/hadoop19\.aj\.c2fse\.northgrum\.com"
> STATE_STRING="cleanup"
> COUNTERS="{(org\.apache\.hadoop\.mapred\.Task$Counter)(Map-Reduce
> Framework)[(SPILLED_RECORDS)(Spilled Records)(0)]}" .
>
> Task TASKID="task_201006110802_0016_m_000002" TASK_TYPE="CLEANUP"
> TASK_STATUS="SUCCESS" FINISH_TIME="1276258592124"
> COUNTERS="{(org\.apache\.hadoop\.mapred\.Task$Counter)(Map-Reduce
> Framework)[(SPILLED_RECORDS)(Spilled Records)(0)]}" .
>
> Job JOBID="job_201006110802_0016" FINISH_TIME="1276258592124"
> JOB_STATUS="FAILED" FINISHED_MAPS="1" FINISHED_REDUCES="0" .
>
> *MAP LOG FILE OF FIRST RUN
> *
> eta VERSION="1" .
>
> Job JOBID="job_201006110802_0013"
> JOBNAME="streamjob1574130777925793571\.jar" USER="ngc"
> SUBMIT_TIME="1276258509559"
> JOBCONF="hdfs://hadoop1\.aj\.c2fse\.northgrum\.com:9000/tmp/hadoop-ngc/mapred/system/job_201006110802_0013/job\.xml"
> .
>
> Job JOBID="job_201006110802_0013" JOB_PRIORITY="NORMAL" .
>
> Job JOBID="job_201006110802_0013" LAUNCH_TIME="1276258509729"
> TOTAL_MAPS="2" TOTAL_REDUCES="1" JOB_STATUS="PREP" .
>
> Task TASKID="task_201006110802_0013_m_000003" TASK_TYPE="SETUP"
> START_TIME="1276258509836" SPLITS="" .
>
> MapAttempt TASK_TYPE="SETUP" TASKID="task_201006110802_0013_m_000003"
> TASK_ATTEMPT_ID="attempt_201006110802_0013_m_000003_0"
> START_TIME="1276229873134"
> TRACKER_NAME="tracker_hadoop6\.aj\.c2fse\.northgrum\.com:localhost/127\.0\.0\.1:49372"
> HTTP_PORT="50060" .
>
> MapAttempt TASK_TYPE="SETUP" TASKID="task_201006110802_0013_m_000003"
> TASK_ATTEMPT_ID="attempt_201006110802_0013_m_000003_0" TASK_STATUS="SUCCESS"
> FINISH_TIME="1276229873917"
> HOSTNAME="/default-rack/hadoop6\.aj\.c2fse\.northgrum\.com"
> STATE_STRING="setup"
> COUNTERS="{(org\.apache\.hadoop\.mapred\.Task$Counter)(Map-Reduce
> Framework)[(SPILLED_RECORDS)(Spilled Records)(0)]}" .
>
> Task TASKID="task_201006110802_0013_m_000003" TASK_TYPE="SETUP"
> TASK_STATUS="SUCCESS" FINISH_TIME="1276258512842"
> COUNTERS="{(org\.apache\.hadoop\.mapred\.Task$Counter)(Map-Reduce
> Framework)[(SPILLED_RECORDS)(Spilled Records)(0)]}" .
>
> Job JOBID="job_201006110802_0013" JOB_STATUS="RUNNING" .
>
> Task TASKID="task_201006110802_0013_m_000000" TASK_TYPE="MAP"
> START_TIME="1276258512842"
> SPLITS="/default-rack/hadoop20\.aj\.c2fse\.northgrum\.com,/default-rack/hadoop17\.aj\.c2fse\.northgrum\.com"
> .
>
> Task TASKID="task_201006110802_0013_m_000001" TASK_TYPE="MAP"
> START_TIME="1276258512946"
> SPLITS="/default-rack/hadoop20\.aj\.c2fse\.northgrum\.com,/default-rack/hadoop17\.aj\.c2fse\.northgrum\.com"
> .
>
> MapAttempt TASK_TYPE="MAP" TASKID="task_201006110802_0013_m_000000"
> TASK_ATTEMPT_ID="attempt_201006110802_0013_m_000000_0"
> START_TIME="1276229875959"
> TRACKER_NAME="tracker_hadoop6\.aj\.c2fse\.northgrum\.com:localhost/127\.0\.0\.1:49372"
> HTTP_PORT="50060" .
>
> MapAttempt TASK_TYPE="MAP" TASKID="task_201006110802_0013_m_000000"
> TASK_ATTEMPT_ID="attempt_201006110802_0013_m_000000_0" TASK_STATUS="FAILED"
> FINISH_TIME="1276229880125" HOSTNAME="hadoop6\.aj\.c2fse\.northgrum\.com"
> ERROR="java\.lang\.RuntimeException: Error in configuring object
>
>         at
> org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.java:93)
>
>         at
> org\.apache\.hadoop\.util\.ReflectionUtils\.setConf(ReflectionUtils\.java:64)
>
>         at
> org\.apache\.hadoop\.util\.ReflectionUtils\.newInstance(ReflectionUtils\.java:117)
>
>         at
> org\.apache\.hadoop\.mapred\.MapTask\.runOldMapper(MapTask\.java:354)
>
>         at org\.apache\.hadoop\.mapred\.MapTask\.run(MapTask\.java:307)
>
>         at org\.apache\.hadoop\.mapred\.Child\.main(Child\.java:170)
>
> Caused by: java\.lang\.reflect\.InvocationTargetException
>
>         at sun\.reflect\.NativeMethodAccessorImpl\.invoke0(Native Method)
>
>         at
> sun\.reflect\.NativeMethodAccessorImpl\.invoke(NativeMethodAccessorImpl\.java:39)
>
>         at
> sun\.reflect\.DelegatingMethodAccessorImpl\.invoke(DelegatingMethodAccessorImpl\.java:25)
>
>         at java\.lang\.reflect\.Method\.invoke(Method\.java:597)
>
>         at
> org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.java:88)
>
>         \.\.\. 5 more
>
> Caused by: java\.lang\.RuntimeException: Error in configuring object
>
>         at
> org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.java:93)
>
>         at
> org\.apache\.hadoop\.util\.ReflectionUtils\.setConf(ReflectionUtils\.java:64)
>
>         at
> org\.apache\.hadoop\.util\.ReflectionUtils\.newInstance(ReflectionUtils\.java:117)
>
>         at
> org\.apache\.hadoop\.mapred\.MapRunner\.configure(MapRunner\.java:34)
>
>         \.\.\. 10 more
>
> Caused by: java\.lang\.reflect\.InvocationTargetException
>
>         at sun\.reflect\.NativeMethodAccessorImpl\.invoke0(Native Method)
>
>         at
> sun\.reflect\.NativeMethodAccessorImpl\.invoke(NativeMethodAccessorImpl\.java:39)
>
>         at
> sun\.reflect\.DelegatingMethodAccessorImpl\.invoke(DelegatingMethodAccessorImpl\.java:25)
>
>         at java\.lang\.reflect\.Method\.invoke(Method\.java:597)
>
>         at
> org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.java:88)
>
>         \.\.\. 13 more
>
> Caused by: java\.lang\.RuntimeException: configuration exception
>
>         at
> org\.apache\.hadoop\.streaming\.PipeMapRed\.configure(PipeMapRed\.java:182)
>
>         at
> org\.apache\.hadoop\.streaming\.PipeMapper\.configure(PipeMapper\.java:63)
>
>         \.\.\. 18 more
>
> Caused by: java\.io\.IOException: Cannot run program
> \"/tmp/hadoop-ngc/mapred/local/taskTracker/jobcache/job_201006110802_0013/attempt_201006110802_0013_m_000000_0/work/\./SDMapper\":
> java\.io\.IOException: error\=2, No such file or directory
>
>         at java\.lang\.ProcessBuilder\.start(ProcessBuilder\.java:460)
>
>         at
> org\.apache\.hadoop\.streaming\.PipeMapRed\.configure(PipeMapRed\.java:166)
>
>         \.\.\. 19 more
>
> Caused by: java\.io\.IOException: java\.io\.IOException: error\=2, No such
> file or directory
>
>         at java\.lang\.UNIXProcess\.<init>(UNIXProcess\.java:148)
>
>         at java\.lang\.ProcessImpl\.start(ProcessImpl\.java:65)
>
>         at java\.lang\.ProcessBuilder\.start(ProcessBuilder\.java:453)
>
>         \.\.\. 20 more
>
> " .
>
> MapAttempt TASK_TYPE="MAP" TASKID="task_201006110802_0013_m_000001"
> TASK_ATTEMPT_ID="attempt_201006110802_0013_m_000001_0"
> START_TIME="1276229951632"
> TRACKER_NAME="tracker_hadoop3\.aj\.c2fse\.northgrum\.com:localhost/127\.0\.0\.1:34294"
> HTTP_PORT="50060" .
>
> MapAttempt TASK_TYPE="MAP" TASKID="task_201006110802_0013_m_000001"
> TASK_ATTEMPT_ID="attempt_201006110802_0013_m_000001_0" TASK_STATUS="FAILED"
> FINISH_TIME="1276229955681" HOSTNAME="hadoop3\.aj\.c2fse\.northgrum\.com"
> ERROR="java\.lang\.RuntimeException: Error in configuring object
>
>         at
> org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.java:93)
>
>         at
> org\.apache\.hadoop\.util\.ReflectionUtils\.setConf(ReflectionUtils\.java:64)
>
>         at
> org\.apache\.hadoop\.util\.ReflectionUtils\.newInstance(ReflectionUtils\.java:117)
>
>         at
> org\.apache\.hadoop\.mapred\.MapTask\.runOldMapper(MapTask\.java:354)
>
>         at org\.apache\.hadoop\.mapred\.MapTask\.run(MapTask\.java:307)
>
>         at org\.apache\.hadoop\.mapred\.Child\.main(Child\.java:170)
>
> Caused by: java\.lang\.reflect\.InvocationTargetException
>
>         at sun\.reflect\.NativeMethodAccessorImpl\.invoke0(Native Method)
>
>         at
> sun\.reflect\.NativeMethodAccessorImpl\.invoke(NativeMethodAccessorImpl\.java:39)
>
>         at
> sun\.reflect\.DelegatingMethodAccessorImpl\.invoke(DelegatingMethodAccessorImpl\.java:25)
>
>         at java\.lang\.reflect\.Method\.invoke(Method\.java:597)
>
>         at
> org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.java:88)
>
>         \.\.\. 5 more
>
> Caused by: java\.lang\.RuntimeException: Error in configuring object
>
>         at
> org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.java:93)
>
>         at
> org\.apache\.hadoop\.util\.ReflectionUtils\.setConf(ReflectionUtils\.java:64)
>
>         at
> org\.apache\.hadoop\.util\.ReflectionUtils\.newInstance(ReflectionUtils\.java:117)
>
>         at
> org\.apache\.hadoop\.mapred\.MapRunner\.configure(MapRunner\.java:34)
>
>         \.\.\. 10 more
>
> Caused by: java\.lang\.reflect\.InvocationTargetException
>
>         at sun\.reflect\.NativeMethodAccessorImpl\.invoke0(Native Method)
>
>         at
> sun\.reflect\.NativeMethodAccessorImpl\.invoke(NativeMethodAccessorImpl\.java:39)
>
>         at
> sun\.reflect\.DelegatingMethodAccessorImpl\.invoke(DelegatingMethodAccessorImpl\.java:25)
>
>         at java\.lang\.reflect\.Method\.invoke(Method\.java:597)
>
>         at
> org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.java:88)
>
>         \.\.\. 13 more
>
> Caused by: java\.lang\.RuntimeException: configuration exception
>
>         at
> org\.apache\.hadoop\.streaming\.PipeMapRed\.configure(PipeMapRed\.java:182)
>
>         at
> org\.apache\.hadoop\.streaming\.PipeMapper\.configure(PipeMapper\.java:63)
>
>         \.\.\. 18 more
>
> Caused by: java\.io\.IOException: Cannot run program
> \"/media/hd4/mapred/local/taskTracker/jobcache/job_201006110802_0013/attempt_201006110802_0013_m_000001_0/work/\./SDMapper\":
> java\.io\.IOException: error\=2, No such file or directory
>
>         at java\.lang\.ProcessBuilder\.start(ProcessBuilder\.java:460)
>
>         at
> org\.apache\.hadoop\.streaming\.PipeMapRed\.configure(PipeMapRed\.java:166)
>
>         \.\.\. 19 more
>
> Caused by: java\.io\.IOException: java\.io\.IOException: error\=2, No such
> file or directory
>
>         at java\.lang\.UNIXProcess\.<init>(UNIXProcess\.java:148)
>
>         at java\.lang\.ProcessImpl\.start(ProcessImpl\.java:65)
>
>         at java\.lang\.ProcessBuilder\.start(ProcessBuilder\.java:453)
>
>         \.\.\. 20 more
>
> " .
>
> MapAttempt TASK_TYPE="MAP" TASKID="task_201006110802_0013_m_000001"
> TASK_ATTEMPT_ID="attempt_201006110802_0013_m_000001_1"
> START_TIME="1276229716711"
> TRACKER_NAME="tracker_hadoop2\.aj\.c2fse\.northgrum\.com:localhost/127\.0\.0\.1:51829"
> HTTP_PORT="50060" .
>
> MapAttempt TASK_TYPE="MAP" TASKID="task_201006110802_0013_m_000001"
> TASK_ATTEMPT_ID="attempt_201006110802_0013_m_000001_1" TASK_STATUS="SUCCESS"
> FINISH_TIME="1276229717868"
> HOSTNAME="/default-rack/hadoop2\.aj\.c2fse\.northgrum\.com"
> STATE_STRING="hdfs://hadoop1\.aj\.c2fse\.northgrum\.com:9000/user/ngc/ImageList/imagelist:9+9"
> COUNTERS="{(FileSystemCounters)(FileSystemCounters)[(HDFS_BYTES_READ)(HDFS_BYTES_READ)(10)][(FILE_BYTES_WRITTEN)(FILE_BYTES_WRITTEN)(38)]}{(org\.apache\.hadoop\.mapred\.Task$Counter)(Map-Reduce
> Framework)[(COMBINE_OUTPUT_RECORDS)(Combine output
> records)(0)][(MAP_INPUT_RECORDS)(Map input
> records)(0)][(SPILLED_RECORDS)(Spilled Records)(0)][(MAP_OUTPUT_BYTES)(Map
> output bytes)(0)][(MAP_INPUT_BYTES)(Map input
> bytes)(0)][(COMBINE_INPUT_RECORDS)(Combine input
> records)(0)][(MAP_OUTPUT_RECORDS)(Map output records)(0)]}" .
>
> Task TASKID="task_201006110802_0013_m_000001" TASK_TYPE="MAP"
> TASK_STATUS="SUCCESS" FINISH_TIME="1276258522269"
> COUNTERS="{(FileSystemCounters)(FileSystemCounters)[(HDFS_BYTES_READ)(HDFS_BYTES_READ)(10)][(FILE_BYTES_WRITTEN)(FILE_BYTES_WRITTEN)(38)]}{(org\.apache\.hadoop\.mapred\.Task$Counter)(Map-Reduce
> Framework)[(COMBINE_OUTPUT_RECORDS)(Combine output
> records)(0)][(MAP_INPUT_RECORDS)(Map input
> records)(0)][(SPILLED_RECORDS)(Spilled Records)(0)][(MAP_OUTPUT_BYTES)(Map
> output bytes)(0)][(MAP_INPUT_BYTES)(Map input
> bytes)(0)][(COMBINE_INPUT_RECORDS)(Combine input
> records)(0)][(MAP_OUTPUT_RECORDS)(Map output records)(0)]}" .
>
> Task TASKID="task_201006110802_0013_r_000000" TASK_TYPE="REDUCE"
> START_TIME="1276258522270" SPLITS="" .
>
> MapAttempt TASK_TYPE="MAP" TASKID="task_201006110802_0013_m_000000"
> TASK_ATTEMPT_ID="attempt_201006110802_0013_m_000000_1"
> START_TIME="1276229957552"
> TRACKER_NAME="tracker_hadoop3\.aj\.c2fse\.northgrum\.com:localhost/127\.0\.0\.1:34294"
> HTTP_PORT="50060" .
>
> MapAttempt TASK_TYPE="MAP" TASKID="task_201006110802_0013_m_000000"
> TASK_ATTEMPT_ID="attempt_201006110802_0013_m_000000_1" TASK_STATUS="FAILED"
> FINISH_TIME="1276229961598" HOSTNAME="hadoop3\.aj\.c2fse\.northgrum\.com"
> ERROR="java\.lang\.RuntimeException: Error in configuring object
>
>         at
> org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.java:93)
>
>         at
> org\.apache\.hadoop\.util\.ReflectionUtils\.setConf(ReflectionUtils\.java:64)
>
>         at
> org\.apache\.hadoop\.util\.ReflectionUtils\.newInstance(ReflectionUtils\.java:117)
>
>         at
> org\.apache\.hadoop\.mapred\.MapTask\.runOldMapper(MapTask\.java:354)
>
>         at org\.apache\.hadoop\.mapred\.MapTask\.run(MapTask\.java:307)
>
>         at org\.apache\.hadoop\.mapred\.Child\.main(Child\.java:170)
>
> Caused by: java\.lang\.reflect\.InvocationTargetException
>
>         at sun\.reflect\.NativeMethodAccessorImpl\.invoke0(Native Method)
>
>         at
> sun\.reflect\.NativeMethodAccessorImpl\.invoke(NativeMethodAccessorImpl\.java:39)
>
>         at
> sun\.reflect\.DelegatingMethodAccessorImpl\.invoke(DelegatingMethodAccessorImpl\.java:25)
>
>         at java\.lang\.reflect\.Method\.invoke(Method\.java:597)
>
>         at
> org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.java:88)
>
>         \.\.\. 5 more
>
> Caused by: java\.lang\.RuntimeException: Error in configuring object
>
>         at
> org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.java:93)
>
>         at
> org\.apache\.hadoop\.util\.ReflectionUtils\.setConf(ReflectionUtils\.java:64)
>
>         at
> org\.apache\.hadoop\.util\.ReflectionUtils\.newInstance(ReflectionUtils\.java:117)
>
>         at
> org\.apache\.hadoop\.mapred\.MapRunner\.configure(MapRunner\.java:34)
>
>         \.\.\. 10 more
>
> Caused by: java\.lang\.reflect\.InvocationTargetException
>
>         at sun\.reflect\.NativeMethodAccessorImpl\.invoke0(Native Method)
>
>         at
> sun\.reflect\.NativeMethodAccessorImpl\.invoke(NativeMethodAccessorImpl\.java:39)
>
>         at
> sun\.reflect\.DelegatingMethodAccessorImpl\.invoke(DelegatingMethodAccessorImpl\.java:25)
>
>         at java\.lang\.reflect\.Method\.invoke(Method\.java:597)
>
>         at
> org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.java:88)
>
>         \.\.\. 13 more
>
> Caused by: java\.lang\.RuntimeException: configuration exception
>
>         at
> org\.apache\.hadoop\.streaming\.PipeMapRed\.configure(PipeMapRed\.java:182)
>
>         at
> org\.apache\.hadoop\.streaming\.PipeMapper\.configure(PipeMapper\.java:63)
>
>         \.\.\. 18 more
>
> Caused by: java\.io\.IOException: Cannot run program
> \"/media/hd3/mapred/local/taskTracker/jobcache/job_201006110802_0013/attempt_201006110802_0013_m_000000_1/work/\./SDMapper\":
> java\.io\.IOException: error\=2, No such file or directory
>
>         at java\.lang\.ProcessBuilder\.start(ProcessBuilder\.java:460)
>
>         at
> org\.apache\.hadoop\.streaming\.PipeMapRed\.configure(PipeMapRed\.java:166)
>
>         \.\.\. 19 more
>
> Caused by: java\.io\.IOException: java\.io\.IOException: error\=2, No such
> file or directory
>
>         at java\.lang\.UNIXProcess\.<init>(UNIXProcess\.java:148)
>
>         at java\.lang\.ProcessImpl\.start(ProcessImpl\.java:65)
>
>         at java\.lang\.ProcessBuilder\.start(ProcessBuilder\.java:453)
>
>         \.\.\. 20 more
>
> " .
>
> MapAttempt TASK_TYPE="MAP" TASKID="task_201006110802_0013_m_000000"
> TASK_ATTEMPT_ID="attempt_201006110802_0013_m_000000_2"
> START_TIME="1276229722583"
> TRACKER_NAME="tracker_hadoop2\.aj\.c2fse\.northgrum\.com:localhost/127\.0\.0\.1:51829"
> HTTP_PORT="50060" .
>
> MapAttempt TASK_TYPE="MAP" TASKID="task_201006110802_0013_m_000000"
> TASK_ATTEMPT_ID="attempt_201006110802_0013_m_000000_2" TASK_STATUS="SUCCESS"
> FINISH_TIME="1276229723735"
> HOSTNAME="/default-rack/hadoop2\.aj\.c2fse\.northgrum\.com"
> STATE_STRING="Records R/W\=1/1"
> COUNTERS="{(FileSystemCounters)(FileSystemCounters)[(HDFS_BYTES_READ)(HDFS_BYTES_READ)(18)][(FILE_BYTES_WRITTEN)(FILE_BYTES_WRITTEN)(94)]}{(org\.apache\.hadoop\.mapred\.Task$Counter)(Map-Reduce
> Framework)[(COMBINE_OUTPUT_RECORDS)(Combine output
> records)(0)][(MAP_INPUT_RECORDS)(Map input
> records)(1)][(SPILLED_RECORDS)(Spilled Records)(1)][(MAP_OUTPUT_BYTES)(Map
> output bytes)(54)][(MAP_INPUT_BYTES)(Map input
> bytes)(18)][(COMBINE_INPUT_RECORDS)(Combine input
> records)(0)][(MAP_OUTPUT_RECORDS)(Map output records)(1)]}" .
>
> Task TASKID="task_201006110802_0013_m_000000" TASK_TYPE="MAP"
> TASK_STATUS="SUCCESS" FINISH_TIME="1276258528279"
> COUNTERS="{(FileSystemCounters)(FileSystemCounters)[(HDFS_BYTES_READ)(HDFS_BYTES_READ)(18)][(FILE_BYTES_WRITTEN)(FILE_BYTES_WRITTEN)(94)]}{(org\.apache\.hadoop\.mapred\.Task$Counter)(Map-Reduce
> Framework)[(COMBINE_OUTPUT_RECORDS)(Combine output
> records)(0)][(MAP_INPUT_RECORDS)(Map input
> records)(1)][(SPILLED_RECORDS)(Spilled Records)(1)][(MAP_OUTPUT_BYTES)(Map
> output bytes)(54)][(MAP_INPUT_BYTES)(Map input
> bytes)(18)][(COMBINE_INPUT_RECORDS)(Combine input
> records)(0)][(MAP_OUTPUT_RECORDS)(Map output records)(1)]}" .
>
> ReduceAttempt TASK_TYPE="REDUCE" TASKID="task_201006110802_0013_r_000000"
> TASK_ATTEMPT_ID="attempt_201006110802_0013_r_000000_0"
> START_TIME="1276229719549"
> TRACKER_NAME="tracker_hadoop2\.aj\.c2fse\.northgrum\.com:localhost/127\.0\.0\.1:51829"
> HTTP_PORT="50060" .
>
> ReduceAttempt TASK_TYPE="REDUCE" TASKID="task_201006110802_0013_r_000000"
> TASK_ATTEMPT_ID="attempt_201006110802_0013_r_000000_0" TASK_STATUS="SUCCESS"
> SHUFFLE_FINISHED="1276229731481" SORT_FINISHED="1276229731538"
> FINISH_TIME="1276229734818"
> HOSTNAME="/default-rack/hadoop2\.aj\.c2fse\.northgrum\.com"
> STATE_STRING="Records R/W\=1/1 > reduce"
> COUNTERS="{(FileSystemCounters)(FileSystemCounters)[(FILE_BYTES_READ)(FILE_BYTES_READ)(62)][(FILE_BYTES_WRITTEN)(FILE_BYTES_WRITTEN)(62)][(HDFS_BYTES_WRITTEN)(HDFS_BYTES_WRITTEN)(63)]}{(org\.apache\.hadoop\.mapred\.Task$Counter)(Map-Reduce
> Framework)[(REDUCE_INPUT_GROUPS)(Reduce input
> groups)(1)][(COMBINE_OUTPUT_RECORDS)(Combine output
> records)(0)][(REDUCE_SHUFFLE_BYTES)(Reduce shuffle
> bytes)(6)][(REDUCE_OUTPUT_RECORDS)(Reduce output
> records)(2)][(SPILLED_RECORDS)(Spilled
> Records)(1)][(COMBINE_INPUT_RECORDS)(Combine input
> records)(0)][(REDUCE_INPUT_RECORDS)(Reduce input records)(1)]}" .
>
> Task TASKID="task_201006110802_0013_r_000000" TASK_TYPE="REDUCE"
> TASK_STATUS="SUCCESS" FINISH_TIME="1276258540288"
> COUNTERS="{(FileSystemCounters)(FileSystemCounters)[(FILE_BYTES_READ)(FILE_BYTES_READ)(62)][(FILE_BYTES_WRITTEN)(FILE_BYTES_WRITTEN)(62)][(HDFS_BYTES_WRITTEN)(HDFS_BYTES_WRITTEN)(63)]}{(org\.apache\.hadoop\.mapred\.Task$Counter)(Map-Reduce
> Framework)[(REDUCE_INPUT_GROUPS)(Reduce input
> groups)(1)][(COMBINE_OUTPUT_RECORDS)(Combine output
> records)(0)][(REDUCE_SHUFFLE_BYTES)(Reduce shuffle
> bytes)(6)][(REDUCE_OUTPUT_RECORDS)(Reduce output
> records)(2)][(SPILLED_RECORDS)(Spilled
> Records)(1)][(COMBINE_INPUT_RECORDS)(Combine input
> records)(0)][(REDUCE_INPUT_RECORDS)(Reduce input records)(1)]}" .
>
> Task TASKID="task_201006110802_0013_m_000002" TASK_TYPE="CLEANUP"
> START_TIME="1276258540289" SPLITS="" .
>
> MapAttempt TASK_TYPE="CLEANUP" TASKID="task_201006110802_0013_m_000002"
> TASK_ATTEMPT_ID="attempt_201006110802_0013_m_000002_0"
> START_TIME="1276229737575"
> TRACKER_NAME="tracker_hadoop2\.aj\.c2fse\.northgrum\.com:localhost/127\.0\.0\.1:51829"
> HTTP_PORT="50060" .
>
> MapAttempt TASK_TYPE="CLEANUP" TASKID="task_201006110802_0013_m_000002"
> TASK_ATTEMPT_ID="attempt_201006110802_0013_m_000002_0" TASK_STATUS="SUCCESS"
> FINISH_TIME="1276229738283"
> HOSTNAME="/default-rack/hadoop2\.aj\.c2fse\.northgrum\.com"
> STATE_STRING="cleanup"
> COUNTERS="{(org\.apache\.hadoop\.mapred\.Task$Counter)(Map-Reduce
> Framework)[(SPILLED_RECORDS)(Spilled Records)(0)]}" .
>
> Task TASKID="task_201006110802_0013_m_000002" TASK_TYPE="CLEANUP"
> TASK_STATUS="SUCCESS" FINISH_TIME="1276258543294"
> COUNTERS="{(org\.apache\.hadoop\.mapred\.Task$Counter)(Map-Reduce
> Framework)[(SPILLED_RECORDS)(Spilled Records)(0)]}" .
>
> Job JOBID="job_201006110802_0013" FINISH_TIME="1276258543294"
> JOB_STATUS="SUCCESS" FINISHED_MAPS="2" FINISHED_REDUCES="1" FAILED_MAPS="3"
> FAILED_REDUCES="0"
> COUNTERS="{(org\.apache\.hadoop\.mapred\.JobInProgress$Counter)(Job Counters
> )[(TOTAL_LAUNCHED_REDUCES)(Launched reduce
> tasks)(1)][(RACK_LOCAL_MAPS)(Rack-local map
> tasks)(5)][(TOTAL_LAUNCHED_MAPS)(Launched map
> tasks)(5)]}{(FileSystemCounters)(FileSystemCounters)[(FILE_BYTES_READ)(FILE_BYTES_READ)(62)][(HDFS_BYTES_READ)(HDFS_BYTES_READ)(28)][(FILE_BYTES_WRITTEN)(FILE_BYTES_WRITTEN)(194)][(HDFS_BYTES_WRITTEN)(HDFS_BYTES_WRITTEN)(63)]}{(org\.apache\.hadoop\.mapred\.Task$Counter)(Map-Reduce
> Framework)[(REDUCE_INPUT_GROUPS)(Reduce input
> groups)(1)][(COMBINE_OUTPUT_RECORDS)(Combine output
> records)(0)][(MAP_INPUT_RECORDS)(Map input
> records)(1)][(REDUCE_SHUFFLE_BYTES)(Reduce shuffle
> bytes)(6)][(REDUCE_OUTPUT_RECORDS)(Reduce output
> records)(2)][(SPILLED_RECORDS)(Spilled Records)(2)][(MAP_OUTPUT_BYTES)(Map
> output bytes)(54)][(MAP_INPUT_BYTES)(Map input
> bytes)(18)][(MAP_OUTPUT_RECORDS)(Map output
> records)(1)][(COMBINE_INPUT_RECORDS)(Combine input
> records)(0)][(REDUCE_INPUT_RECORDS)(Reduce input records)(1)]}" .
>

Mime
View raw message