hadoop-mapreduce-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ratner, Alan S (IS)" <Alan.Rat...@ngc.com>
Subject RE: Irreproducible Streaming Jobs
Date Tue, 15 Jun 2010 11:54:17 GMT
Here is more background on the problem of irreproducible streaming jobs:

1)      We are taking C code programs and converting them to run in
Hadoop's streaming mode.

2)      First we debug these programs by streaming them on a Windows
laptop running a virtual machine with Ubuntu 9.10 and Hadoop 0.20.1.  We
have done this with two C programs so far and both run correctly and
consistently in this environment (reproducing the output of the original
C programs).  BTW: I tried the modified command line suggested by
Amareshwari and the program runs the same either way.

3)      Problems crop us when we move these programs to our Hadoop
cluster which runs native Ubuntu (some servers running 9.10 and some
10.4) and Hadoop 0.20.2.  Sometimes these programs run and sometimes
they don't and we have no idea as to what is causing this inconsistency
(unless it is due to the change from Hadoop 0.20.1 to 0.20.2).  The logs
of failed jobs include file or directory not found errors but these
aren't especially helpful since they don't specify which file or
directory is missing.  I've included the log files of a successful run
and a failed run in the hopes someone can tell me what is going wrong.  

 

For example, here is successful Run 1:

 

ngc@hadoop1:~/hadoop-0.20.2$ bin/hadoop jar
contrib/streaming/hadoop-0.20.2-streaming.jar -file
/home/ngc/hadoop-0.20.2/streamingapps/Cliq2/CliquerMap -mapper
CliquerMap -file /home/ngc/hadoop-0.20.2/streamingapps/Cliq2/ARGH1
-reducer ARGH1 -input CliqueIn -output CliqueOut1

packageJobJar: [/home/ngc/hadoop-0.20.2/streamingapps/Cliq2/CliquerMap,
/home/ngc/hadoop-0.20.2/streamingapps/Cliq2/ARGH1,
/tmp/hadoop-ngc/hadoop-unjar5693480053986200084/] []
/tmp/streamjob2257941530123552427.jar tmpDir=null

10/06/14 15:49:54 INFO mapred.FileInputFormat: Total input paths to
process : 1

10/06/14 15:49:55 INFO streaming.StreamJob: getLocalDirs():
[/tmp/hadoop-ngc/mapred/local, /media/hd2/mapred/local,
/media/hd3/mapred/local, /media/hd4/mapred/local]

10/06/14 15:49:55 INFO streaming.StreamJob: Running job:
job_201006141152_0163

10/06/14 15:49:55 INFO streaming.StreamJob: To kill this job, run:

10/06/14 15:49:55 INFO streaming.StreamJob:
/home/ngc/hadoop-0.20.2/bin/../bin/hadoop job
-Dmapred.job.tracker=10.64.147.2:9002 -kill job_201006141152_0163

10/06/14 15:49:55 INFO streaming.StreamJob: Tracking URL:
http://hadoop1.aj.c2fse.northgrum.com:50030/jobdetails.jsp?jobid=job_201
006141152_0163

10/06/14 15:49:56 INFO streaming.StreamJob:  map 0%  reduce 0%

10/06/14 15:50:02 INFO streaming.StreamJob:  map 100%  reduce 0%

10/06/14 15:50:11 INFO streaming.StreamJob:  map 100%  reduce 33%

10/06/14 15:50:17 INFO streaming.StreamJob:  map 100%  reduce 100%

10/06/14 15:50:20 INFO streaming.StreamJob: Job complete:
job_201006141152_0163

10/06/14 15:50:20 INFO streaming.StreamJob: Output: CliqueOut1

 

Here is failed Run 2 - only the name of the output directory has been
changed:

 

ngc@hadoop1:~/hadoop-0.20.2$ bin/hadoop jar
contrib/streaming/hadoop-0.20.2-streaming.jar -file
/home/ngc/hadoop-0.20.2/streamingapps/Cliq2/CliquerMap -mapper
CliquerMap -file /home/ngc/hadoop-0.20.2/streamingapps/Cliq2/ARGH1
-reducer ARGH1 -input CliqueIn -output CliqueOut3

packageJobJar: [/home/ngc/hadoop-0.20.2/streamingapps/Cliq2/CliquerMap,
/home/ngc/hadoop-0.20.2/streamingapps/Cliq2/ARGH1,
/tmp/hadoop-ngc/hadoop-unjar3582440643290869791/] []
/tmp/streamjob6334481689253156407.jar tmpDir=null

10/06/14 15:52:30 INFO mapred.FileInputFormat: Total input paths to
process : 1

10/06/14 15:52:30 INFO streaming.StreamJob: getLocalDirs():
[/tmp/hadoop-ngc/mapred/local, /media/hd2/mapred/local,
/media/hd3/mapred/local, /media/hd4/mapred/local]

10/06/14 15:52:30 INFO streaming.StreamJob: Running job:
job_201006141152_0165

10/06/14 15:52:30 INFO streaming.StreamJob: To kill this job, run:

10/06/14 15:52:30 INFO streaming.StreamJob:
/home/ngc/hadoop-0.20.2/bin/../bin/hadoop job
-Dmapred.job.tracker=10.64.147.2:9002 -kill job_201006141152_0165

10/06/14 15:52:30 INFO streaming.StreamJob: Tracking URL:
http://hadoop1.aj.c2fse.northgrum.com:50030/jobdetails.jsp?jobid=job_201
006141152_0165

10/06/14 15:52:31 INFO streaming.StreamJob:  map 0%  reduce 0%

10/06/14 15:53:01 INFO streaming.StreamJob:  map 100%  reduce 100%

10/06/14 15:53:01 INFO streaming.StreamJob: To kill this job, run:

10/06/14 15:53:01 INFO streaming.StreamJob:
/home/ngc/hadoop-0.20.2/bin/../bin/hadoop job
-Dmapred.job.tracker=10.64.147.2:9002 -kill job_201006141152_0165

10/06/14 15:53:01 INFO streaming.StreamJob: Tracking URL:
http://hadoop1.aj.c2fse.northgrum.com:50030/jobdetails.jsp?jobid=job_201
006141152_0165

10/06/14 15:53:01 ERROR streaming.StreamJob: Job not Successful!

10/06/14 15:53:01 INFO streaming.StreamJob: killJob...

Streaming Job Failed!

 

Output log with successful Run 1:

 

Meta VERSION="1" .

Job JOBID="job_201006141152_0163"
JOBNAME="streamjob2257941530123552427\.jar" USER="ngc"
SUBMIT_TIME="1276544995086"
JOBCONF="hdfs://hadoop1\.aj\.c2fse\.northgrum\.com:9000/tmp/hadoop-ngc/m
apred/system/job_201006141152_0163/job\.xml" .

Job JOBID="job_201006141152_0163" JOB_PRIORITY="NORMAL" .

Job JOBID="job_201006141152_0163" LAUNCH_TIME="1276544995298"
TOTAL_MAPS="2" TOTAL_REDUCES="1" JOB_STATUS="PREP" .

Task TASKID="task_201006141152_0163_m_000003" TASK_TYPE="SETUP"
START_TIME="1276544995355" SPLITS="" .

MapAttempt TASK_TYPE="SETUP" TASKID="task_201006141152_0163_m_000003"
TASK_ATTEMPT_ID="attempt_201006141152_0163_m_000003_0"
START_TIME="1276544870715"
TRACKER_NAME="tracker_hadoop7\.aj\.c2fse\.northgrum\.com:localhost/127\.
0\.0\.1:42144" HTTP_PORT="50060" .

MapAttempt TASK_TYPE="SETUP" TASKID="task_201006141152_0163_m_000003"
TASK_ATTEMPT_ID="attempt_201006141152_0163_m_000003_0"
TASK_STATUS="SUCCESS" FINISH_TIME="1276544871484"
HOSTNAME="/default-rack/hadoop7\.aj\.c2fse\.northgrum\.com"
STATE_STRING="setup"
COUNTERS="{(org\.apache\.hadoop\.mapred\.Task$Counter)(Map-Reduce
Framework)[(SPILLED_RECORDS)(Spilled Records)(0)]}" .

Task TASKID="task_201006141152_0163_m_000003" TASK_TYPE="SETUP"
TASK_STATUS="SUCCESS" FINISH_TIME="1276544998360"
COUNTERS="{(org\.apache\.hadoop\.mapred\.Task$Counter)(Map-Reduce
Framework)[(SPILLED_RECORDS)(Spilled Records)(0)]}" .

Job JOBID="job_201006141152_0163" JOB_STATUS="RUNNING" .

Task TASKID="task_201006141152_0163_m_000000" TASK_TYPE="MAP"
START_TIME="1276544998360"
SPLITS="/default-rack/hadoop38\.aj\.c2fse\.northgrum\.com,/default-rack/
hadoop12\.aj\.c2fse\.northgrum\.com" .

Task TASKID="task_201006141152_0163_m_000001" TASK_TYPE="MAP"
START_TIME="1276544998367"
SPLITS="/default-rack/hadoop38\.aj\.c2fse\.northgrum\.com,/default-rack/
hadoop12\.aj\.c2fse\.northgrum\.com" .

MapAttempt TASK_TYPE="MAP" TASKID="task_201006141152_0163_m_000000"
TASK_ATTEMPT_ID="attempt_201006141152_0163_m_000000_0"
START_TIME="1276544873560"
TRACKER_NAME="tracker_hadoop7\.aj\.c2fse\.northgrum\.com:localhost/127\.
0\.0\.1:42144" HTTP_PORT="50060" .

MapAttempt TASK_TYPE="MAP" TASKID="task_201006141152_0163_m_000000"
TASK_ATTEMPT_ID="attempt_201006141152_0163_m_000000_0"
TASK_STATUS="SUCCESS" FINISH_TIME="1276544875195"
HOSTNAME="/default-rack/hadoop7\.aj\.c2fse\.northgrum\.com"
STATE_STRING="Records R/W\=10581/1"
COUNTERS="{(FileSystemCounters)(FileSystemCounters)[(HDFS_BYTES_READ)(HD
FS_BYTES_READ)(919067)][(FILE_BYTES_WRITTEN)(FILE_BYTES_WRITTEN)(1141467
)]}{(org\.apache\.hadoop\.mapred\.Task$Counter)(Map-Reduce
Framework)[(COMBINE_OUTPUT_RECORDS)(Combine output
records)(0)][(MAP_INPUT_RECORDS)(Map input
records)(74122)][(SPILLED_RECORDS)(Spilled
Records)(74122)][(MAP_OUTPUT_BYTES)(Map output
bytes)(993185)][(MAP_INPUT_BYTES)(Map input
bytes)(919063)][(COMBINE_INPUT_RECORDS)(Combine input
records)(0)][(MAP_OUTPUT_RECORDS)(Map output records)(74122)]}" .

Task TASKID="task_201006141152_0163_m_000000" TASK_TYPE="MAP"
TASK_STATUS="SUCCESS" FINISH_TIME="1276545001367"
COUNTERS="{(FileSystemCounters)(FileSystemCounters)[(HDFS_BYTES_READ)(HD
FS_BYTES_READ)(919067)][(FILE_BYTES_WRITTEN)(FILE_BYTES_WRITTEN)(1141467
)]}{(org\.apache\.hadoop\.mapred\.Task$Counter)(Map-Reduce
Framework)[(COMBINE_OUTPUT_RECORDS)(Combine output
records)(0)][(MAP_INPUT_RECORDS)(Map input
records)(74122)][(SPILLED_RECORDS)(Spilled
Records)(74122)][(MAP_OUTPUT_BYTES)(Map output
bytes)(993185)][(MAP_INPUT_BYTES)(Map input
bytes)(919063)][(COMBINE_INPUT_RECORDS)(Combine input
records)(0)][(MAP_OUTPUT_RECORDS)(Map output records)(74122)]}" .

Task TASKID="task_201006141152_0163_r_000000" TASK_TYPE="REDUCE"
START_TIME="1276545001367" SPLITS="" .

MapAttempt TASK_TYPE="MAP" TASKID="task_201006141152_0163_m_000001"
TASK_ATTEMPT_ID="attempt_201006141152_0163_m_000001_0"
START_TIME="1276516505443"
TRACKER_NAME="tracker_hadoop4\.aj\.c2fse\.northgrum\.com:localhost/127\.
0\.0\.1:59097" HTTP_PORT="50060" .

MapAttempt TASK_TYPE="MAP" TASKID="task_201006141152_0163_m_000001"
TASK_ATTEMPT_ID="attempt_201006141152_0163_m_000001_0"
TASK_STATUS="SUCCESS" FINISH_TIME="1276516507087"
HOSTNAME="/default-rack/hadoop4\.aj\.c2fse\.northgrum\.com"
STATE_STRING="Records R/W\=10490/1"
COUNTERS="{(FileSystemCounters)(FileSystemCounters)[(HDFS_BYTES_READ)(HD
FS_BYTES_READ)(1048576)][(FILE_BYTES_WRITTEN)(FILE_BYTES_WRITTEN)(114084
8)]}{(org\.apache\.hadoop\.mapred\.Task$Counter)(Map-Reduce
Framework)[(COMBINE_OUTPUT_RECORDS)(Combine output
records)(0)][(MAP_INPUT_RECORDS)(Map input
records)(73914)][(SPILLED_RECORDS)(Spilled
Records)(73914)][(MAP_OUTPUT_BYTES)(Map output
bytes)(992982)][(MAP_INPUT_BYTES)(Map input
bytes)(919068)][(COMBINE_INPUT_RECORDS)(Combine input
records)(0)][(MAP_OUTPUT_RECORDS)(Map output records)(73914)]}" .

Task TASKID="task_201006141152_0163_m_000001" TASK_TYPE="MAP"
TASK_STATUS="SUCCESS" FINISH_TIME="1276545001372"
COUNTERS="{(FileSystemCounters)(FileSystemCounters)[(HDFS_BYTES_READ)(HD
FS_BYTES_READ)(1048576)][(FILE_BYTES_WRITTEN)(FILE_BYTES_WRITTEN)(114084
8)]}{(org\.apache\.hadoop\.mapred\.Task$Counter)(Map-Reduce
Framework)[(COMBINE_OUTPUT_RECORDS)(Combine output
records)(0)][(MAP_INPUT_RECORDS)(Map input
records)(73914)][(SPILLED_RECORDS)(Spilled
Records)(73914)][(MAP_OUTPUT_BYTES)(Map output
bytes)(992982)][(MAP_INPUT_BYTES)(Map input
bytes)(919068)][(COMBINE_INPUT_RECORDS)(Combine input
records)(0)][(MAP_OUTPUT_RECORDS)(Map output records)(73914)]}" .

ReduceAttempt TASK_TYPE="REDUCE"
TASKID="task_201006141152_0163_r_000000"
TASK_ATTEMPT_ID="attempt_201006141152_0163_r_000000_0"
START_TIME="1276544876558"
TRACKER_NAME="tracker_hadoop7\.aj\.c2fse\.northgrum\.com:localhost/127\.
0\.0\.1:42144" HTTP_PORT="50060" .

ReduceAttempt TASK_TYPE="REDUCE"
TASKID="task_201006141152_0163_r_000000"
TASK_ATTEMPT_ID="attempt_201006141152_0163_r_000000_0"
TASK_STATUS="SUCCESS" SHUFFLE_FINISHED="1276544883268"
SORT_FINISHED="1276544883562" FINISH_TIME="1276544889011"
HOSTNAME="/default-rack/hadoop7\.aj\.c2fse\.northgrum\.com"
STATE_STRING="Records R/W\=148036/1 > reduce"
COUNTERS="{(FileSystemCounters)(FileSystemCounters)[(FILE_BYTES_READ)(FI
LE_BYTES_READ)(2282245)][(FILE_BYTES_WRITTEN)(FILE_BYTES_WRITTEN)(228224
5)][(HDFS_BYTES_WRITTEN)(HDFS_BYTES_WRITTEN)(7259)]}{(org\.apache\.hadoo
p\.mapred\.Task$Counter)(Map-Reduce
Framework)[(REDUCE_INPUT_GROUPS)(Reduce input
groups)(148036)][(COMBINE_OUTPUT_RECORDS)(Combine output
records)(0)][(REDUCE_SHUFFLE_BYTES)(Reduce shuffle
bytes)(2282251)][(REDUCE_OUTPUT_RECORDS)(Reduce output
records)(46)][(SPILLED_RECORDS)(Spilled
Records)(148036)][(COMBINE_INPUT_RECORDS)(Combine input
records)(0)][(REDUCE_INPUT_RECORDS)(Reduce input records)(148036)]}" .

Task TASKID="task_201006141152_0163_r_000000" TASK_TYPE="REDUCE"
TASK_STATUS="SUCCESS" FINISH_TIME="1276545016389"
COUNTERS="{(FileSystemCounters)(FileSystemCounters)[(FILE_BYTES_READ)(FI
LE_BYTES_READ)(2282245)][(FILE_BYTES_WRITTEN)(FILE_BYTES_WRITTEN)(228224
5)][(HDFS_BYTES_WRITTEN)(HDFS_BYTES_WRITTEN)(7259)]}{(org\.apache\.hadoo
p\.mapred\.Task$Counter)(Map-Reduce
Framework)[(REDUCE_INPUT_GROUPS)(Reduce input
groups)(148036)][(COMBINE_OUTPUT_RECORDS)(Combine output
records)(0)][(REDUCE_SHUFFLE_BYTES)(Reduce shuffle
bytes)(2282251)][(REDUCE_OUTPUT_RECORDS)(Reduce output
records)(46)][(SPILLED_RECORDS)(Spilled
Records)(148036)][(COMBINE_INPUT_RECORDS)(Combine input
records)(0)][(REDUCE_INPUT_RECORDS)(Reduce input records)(148036)]}" .

Task TASKID="task_201006141152_0163_m_000002" TASK_TYPE="CLEANUP"
START_TIME="1276545016389" SPLITS="" .

MapAttempt TASK_TYPE="CLEANUP" TASKID="task_201006141152_0163_m_000002"
TASK_ATTEMPT_ID="attempt_201006141152_0163_m_000002_0"
START_TIME="1276544891567"
TRACKER_NAME="tracker_hadoop7\.aj\.c2fse\.northgrum\.com:localhost/127\.
0\.0\.1:42144" HTTP_PORT="50060" .

MapAttempt TASK_TYPE="CLEANUP" TASKID="task_201006141152_0163_m_000002"
TASK_ATTEMPT_ID="attempt_201006141152_0163_m_000002_0"
TASK_STATUS="SUCCESS" FINISH_TIME="1276544892421"
HOSTNAME="/default-rack/hadoop7\.aj\.c2fse\.northgrum\.com"
STATE_STRING="cleanup"
COUNTERS="{(org\.apache\.hadoop\.mapred\.Task$Counter)(Map-Reduce
Framework)[(SPILLED_RECORDS)(Spilled Records)(0)]}" .

Task TASKID="task_201006141152_0163_m_000002" TASK_TYPE="CLEANUP"
TASK_STATUS="SUCCESS" FINISH_TIME="1276545019393"
COUNTERS="{(org\.apache\.hadoop\.mapred\.Task$Counter)(Map-Reduce
Framework)[(SPILLED_RECORDS)(Spilled Records)(0)]}" .

Job JOBID="job_201006141152_0163" FINISH_TIME="1276545019394"
JOB_STATUS="SUCCESS" FINISHED_MAPS="2" FINISHED_REDUCES="1"
FAILED_MAPS="0" FAILED_REDUCES="0"
COUNTERS="{(org\.apache\.hadoop\.mapred\.JobInProgress$Counter)(Job
Counters )[(TOTAL_LAUNCHED_REDUCES)(Launched reduce
tasks)(1)][(RACK_LOCAL_MAPS)(Rack-local map
tasks)(2)][(TOTAL_LAUNCHED_MAPS)(Launched map
tasks)(2)]}{(FileSystemCounters)(FileSystemCounters)[(FILE_BYTES_READ)(F
ILE_BYTES_READ)(2282245)][(HDFS_BYTES_READ)(HDFS_BYTES_READ)(1967643)][(
FILE_BYTES_WRITTEN)(FILE_BYTES_WRITTEN)(4564560)][(HDFS_BYTES_WRITTEN)(H
DFS_BYTES_WRITTEN)(7259)]}{(org\.apache\.hadoop\.mapred\.Task$Counter)(M
ap-Reduce Framework)[(REDUCE_INPUT_GROUPS)(Reduce input
groups)(148036)][(COMBINE_OUTPUT_RECORDS)(Combine output
records)(0)][(MAP_INPUT_RECORDS)(Map input
records)(148036)][(REDUCE_SHUFFLE_BYTES)(Reduce shuffle
bytes)(2282251)][(REDUCE_OUTPUT_RECORDS)(Reduce output
records)(46)][(SPILLED_RECORDS)(Spilled
Records)(296072)][(MAP_OUTPUT_BYTES)(Map output
bytes)(1986167)][(MAP_INPUT_BYTES)(Map input
bytes)(1838131)][(MAP_OUTPUT_RECORDS)(Map output
records)(148036)][(COMBINE_INPUT_RECORDS)(Combine input
records)(0)][(REDUCE_INPUT_RECORDS)(Reduce input records)(148036)]}" .

 

Output log with failed Run 2:

 

Meta VERSION="1" .

Job JOBID="job_201006141152_0165"
JOBNAME="streamjob6334481689253156407\.jar" USER="ngc"
SUBMIT_TIME="1276545150464"
JOBCONF="hdfs://hadoop1\.aj\.c2fse\.northgrum\.com:9000/tmp/hadoop-ngc/m
apred/system/job_201006141152_0165/job\.xml" .

Job JOBID="job_201006141152_0165" JOB_PRIORITY="NORMAL" .

Job JOBID="job_201006141152_0165" LAUNCH_TIME="1276545150594"
TOTAL_MAPS="2" TOTAL_REDUCES="1" JOB_STATUS="PREP" .

Task TASKID="task_201006141152_0165_m_000003" TASK_TYPE="SETUP"
START_TIME="1276545150786" SPLITS="" .

MapAttempt TASK_TYPE="SETUP" TASKID="task_201006141152_0165_m_000003"
TASK_ATTEMPT_ID="attempt_201006141152_0165_m_000003_0"
START_TIME="1276516268757"
TRACKER_NAME="tracker_hadoop11\.aj\.c2fse\.northgrum\.com:localhost/127\
.0\.0\.1:47520" HTTP_PORT="50060" .

MapAttempt TASK_TYPE="SETUP" TASKID="task_201006141152_0165_m_000003"
TASK_ATTEMPT_ID="attempt_201006141152_0165_m_000003_0"
TASK_STATUS="SUCCESS" FINISH_TIME="1276516269394"
HOSTNAME="/default-rack/hadoop11\.aj\.c2fse\.northgrum\.com"
STATE_STRING="setup"
COUNTERS="{(org\.apache\.hadoop\.mapred\.Task$Counter)(Map-Reduce
Framework)[(SPILLED_RECORDS)(Spilled Records)(0)]}" .

Task TASKID="task_201006141152_0165_m_000003" TASK_TYPE="SETUP"
TASK_STATUS="SUCCESS" FINISH_TIME="1276545153792"
COUNTERS="{(org\.apache\.hadoop\.mapred\.Task$Counter)(Map-Reduce
Framework)[(SPILLED_RECORDS)(Spilled Records)(0)]}" .

Job JOBID="job_201006141152_0165" JOB_STATUS="RUNNING" .

Task TASKID="task_201006141152_0165_m_000000" TASK_TYPE="MAP"
START_TIME="1276545153792"
SPLITS="/default-rack/hadoop12\.aj\.c2fse\.northgrum\.com,/default-rack/
hadoop38\.aj\.c2fse\.northgrum\.com" .

Task TASKID="task_201006141152_0165_m_000001" TASK_TYPE="MAP"
START_TIME="1276545153886"
SPLITS="/default-rack/hadoop12\.aj\.c2fse\.northgrum\.com,/default-rack/
hadoop38\.aj\.c2fse\.northgrum\.com" .

MapAttempt TASK_TYPE="MAP" TASKID="task_201006141152_0165_m_000000"
TASK_ATTEMPT_ID="attempt_201006141152_0165_m_000000_0"
START_TIME="1276516271602"
TRACKER_NAME="tracker_hadoop11\.aj\.c2fse\.northgrum\.com:localhost/127\
.0\.0\.1:47520" HTTP_PORT="50060" .

MapAttempt TASK_TYPE="MAP" TASKID="task_201006141152_0165_m_000000"
TASK_ATTEMPT_ID="attempt_201006141152_0165_m_000000_0"
TASK_STATUS="FAILED" FINISH_TIME="1276516275655"
HOSTNAME="hadoop11\.aj\.c2fse\.northgrum\.com"
ERROR="java\.lang\.RuntimeException: Error in configuring object

                at
org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.
java:93)

                at
org\.apache\.hadoop\.util\.ReflectionUtils\.setConf(ReflectionUtils\.jav
a:64)

                at
org\.apache\.hadoop\.util\.ReflectionUtils\.newInstance(ReflectionUtils\
.java:117)

                at
org\.apache\.hadoop\.mapred\.MapTask\.runOldMapper(MapTask\.java:354)

                at
org\.apache\.hadoop\.mapred\.MapTask\.run(MapTask\.java:307)

                at
org\.apache\.hadoop\.mapred\.Child\.main(Child\.java:170)

Caused by: java\.lang\.reflect\.InvocationTargetException

                at
sun\.reflect\.NativeMethodAccessorImpl\.invoke0(Native Method)

                at
sun\.reflect\.NativeMethodAccessorImpl\.invoke(NativeMethodAccessorImpl\
.java:39)

                at
sun\.reflect\.DelegatingMethodAccessorImpl\.invoke(DelegatingMethodAcces
sorImpl\.java:25)

                at java\.lang\.reflect\.Method\.invoke(Method\.java:597)

                at
org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.
java:88)

                \.\.\. 5 more

Caused by: java\.lang\.RuntimeException: Error in configuring object

                at
org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.
java:93)

                at
org\.apache\.hadoop\.util\.ReflectionUtils\.setConf(ReflectionUtils\.jav
a:64)

                at
org\.apache\.hadoop\.util\.ReflectionUtils\.newInstance(ReflectionUtils\
.java:117)

                at
org\.apache\.hadoop\.mapred\.MapRunner\.configure(MapRunner\.java:34)

                \.\.\. 10 more

Caused by: java\.lang\.reflect\.InvocationTargetException

                at
sun\.reflect\.NativeMethodAccessorImpl\.invoke0(Native Method)

                at
sun\.reflect\.NativeMethodAccessorImpl\.invoke(NativeMethodAccessorImpl\
.java:39)

                at
sun\.reflect\.DelegatingMethodAccessorImpl\.invoke(DelegatingMethodAcces
sorImpl\.java:25)

                at java\.lang\.reflect\.Method\.invoke(Method\.java:597)

                at
org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.
java:88)

                \.\.\. 13 more

Caused by: java\.lang\.RuntimeException: configuration exception

                at
org\.apache\.hadoop\.streaming\.PipeMapRed\.configure(PipeMapRed\.java:1
82)

                at
org\.apache\.hadoop\.streaming\.PipeMapper\.configure(PipeMapper\.java:6
3)

                \.\.\. 18 more

Caused by: java\.io\.IOException: Cannot run program
\"/media/hd4/mapred/local/taskTracker/jobcache/job_201006141152_0165/att
empt_201006141152_0165_m_000000_0/work/\./CliquerMap\":
java\.io\.IOException: error\=2, No such file or directory

                at
java\.lang\.ProcessBuilder\.start(ProcessBuilder\.java:460)

                at
org\.apache\.hadoop\.streaming\.PipeMapRed\.configure(PipeMapRed\.java:1
66)

                \.\.\. 19 more

Caused by: java\.io\.IOException: java\.io\.IOException: error\=2, No
such file or directory

                at
java\.lang\.UNIXProcess\.<init>(UNIXProcess\.java:148)

                at java\.lang\.ProcessImpl\.start(ProcessImpl\.java:65)

                at
java\.lang\.ProcessBuilder\.start(ProcessBuilder\.java:453)

                \.\.\. 20 more

" .

MapAttempt TASK_TYPE="MAP" TASKID="task_201006141152_0165_m_000001"
TASK_ATTEMPT_ID="attempt_201006141152_0165_m_000001_0"
START_TIME="1276602962723"
TRACKER_NAME="tracker_hadoop31\.aj\.c2fse\.northgrum\.com:localhost/127\
.0\.0\.1:40869" HTTP_PORT="50060" .

MapAttempt TASK_TYPE="MAP" TASKID="task_201006141152_0165_m_000001"
TASK_ATTEMPT_ID="attempt_201006141152_0165_m_000001_0"
TASK_STATUS="FAILED" FINISH_TIME="1276602966774"
HOSTNAME="hadoop31\.aj\.c2fse\.northgrum\.com"
ERROR="java\.lang\.RuntimeException: Error in configuring object

                at
org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.
java:93)

                at
org\.apache\.hadoop\.util\.ReflectionUtils\.setConf(ReflectionUtils\.jav
a:64)

                at
org\.apache\.hadoop\.util\.ReflectionUtils\.newInstance(ReflectionUtils\
.java:117)

                at
org\.apache\.hadoop\.mapred\.MapTask\.runOldMapper(MapTask\.java:354)

                at
org\.apache\.hadoop\.mapred\.MapTask\.run(MapTask\.java:307)

                at
org\.apache\.hadoop\.mapred\.Child\.main(Child\.java:170)

Caused by: java\.lang\.reflect\.InvocationTargetException

                at
sun\.reflect\.NativeMethodAccessorImpl\.invoke0(Native Method)

                at
sun\.reflect\.NativeMethodAccessorImpl\.invoke(NativeMethodAccessorImpl\
.java:39)

                at
sun\.reflect\.DelegatingMethodAccessorImpl\.invoke(DelegatingMethodAcces
sorImpl\.java:25)

                at java\.lang\.reflect\.Method\.invoke(Method\.java:597)

                at
org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.
java:88)

                \.\.\. 5 more

Caused by: java\.lang\.RuntimeException: Error in configuring object

                at
org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.
java:93)

                at
org\.apache\.hadoop\.util\.ReflectionUtils\.setConf(ReflectionUtils\.jav
a:64)

                at
org\.apache\.hadoop\.util\.ReflectionUtils\.newInstance(ReflectionUtils\
.java:117)

                at
org\.apache\.hadoop\.mapred\.MapRunner\.configure(MapRunner\.java:34)

                \.\.\. 10 more

Caused by: java\.lang\.reflect\.InvocationTargetException

                at
sun\.reflect\.NativeMethodAccessorImpl\.invoke0(Native Method)

                at
sun\.reflect\.NativeMethodAccessorImpl\.invoke(NativeMethodAccessorImpl\
.java:39)

                at
sun\.reflect\.DelegatingMethodAccessorImpl\.invoke(DelegatingMethodAcces
sorImpl\.java:25)

                at java\.lang\.reflect\.Method\.invoke(Method\.java:597)

                at
org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.
java:88)

                \.\.\. 13 more

Caused by: java\.lang\.RuntimeException: configuration exception

                at
org\.apache\.hadoop\.streaming\.PipeMapRed\.configure(PipeMapRed\.java:1
82)

                at
org\.apache\.hadoop\.streaming\.PipeMapper\.configure(PipeMapper\.java:6
3)

                \.\.\. 18 more

Caused by: java\.io\.IOException: Cannot run program
\"/media/hd2/mapred/local/taskTracker/jobcache/job_201006141152_0165/att
empt_201006141152_0165_m_000001_0/work/\./CliquerMap\":
java\.io\.IOException: error\=2, No such file or directory

                at
java\.lang\.ProcessBuilder\.start(ProcessBuilder\.java:460)

                at
org\.apache\.hadoop\.streaming\.PipeMapRed\.configure(PipeMapRed\.java:1
66)

                \.\.\. 19 more

Caused by: java\.io\.IOException: java\.io\.IOException: error\=2, No
such file or directory

                at
java\.lang\.UNIXProcess\.<init>(UNIXProcess\.java:148)

                at java\.lang\.ProcessImpl\.start(ProcessImpl\.java:65)

                at
java\.lang\.ProcessBuilder\.start(ProcessBuilder\.java:453)

                \.\.\. 20 more

" .

MapAttempt TASK_TYPE="MAP" TASKID="task_201006141152_0165_m_000000"
TASK_ATTEMPT_ID="attempt_201006141152_0165_m_000000_1"
START_TIME="1276602968589"
TRACKER_NAME="tracker_hadoop31\.aj\.c2fse\.northgrum\.com:localhost/127\
.0\.0\.1:40869" HTTP_PORT="50060" .

MapAttempt TASK_TYPE="MAP" TASKID="task_201006141152_0165_m_000000"
TASK_ATTEMPT_ID="attempt_201006141152_0165_m_000000_1"
TASK_STATUS="FAILED" FINISH_TIME="1276602972635"
HOSTNAME="hadoop31\.aj\.c2fse\.northgrum\.com"
ERROR="java\.lang\.RuntimeException: Error in configuring object

                at
org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.
java:93)

                at
org\.apache\.hadoop\.util\.ReflectionUtils\.setConf(ReflectionUtils\.jav
a:64)

                at
org\.apache\.hadoop\.util\.ReflectionUtils\.newInstance(ReflectionUtils\
.java:117)

                at
org\.apache\.hadoop\.mapred\.MapTask\.runOldMapper(MapTask\.java:354)

                at
org\.apache\.hadoop\.mapred\.MapTask\.run(MapTask\.java:307)

                at
org\.apache\.hadoop\.mapred\.Child\.main(Child\.java:170)

Caused by: java\.lang\.reflect\.InvocationTargetException

                at
sun\.reflect\.NativeMethodAccessorImpl\.invoke0(Native Method)

                at
sun\.reflect\.NativeMethodAccessorImpl\.invoke(NativeMethodAccessorImpl\
.java:39)

                at
sun\.reflect\.DelegatingMethodAccessorImpl\.invoke(DelegatingMethodAcces
sorImpl\.java:25)

                at java\.lang\.reflect\.Method\.invoke(Method\.java:597)

                at
org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.
java:88)

                \.\.\. 5 more

Caused by: java\.lang\.RuntimeException: Error in configuring object

                at
org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.
java:93)

                at
org\.apache\.hadoop\.util\.ReflectionUtils\.setConf(ReflectionUtils\.jav
a:64)

                at
org\.apache\.hadoop\.util\.ReflectionUtils\.newInstance(ReflectionUtils\
.java:117)

                at
org\.apache\.hadoop\.mapred\.MapRunner\.configure(MapRunner\.java:34)

                \.\.\. 10 more

Caused by: java\.lang\.reflect\.InvocationTargetException

                at
sun\.reflect\.NativeMethodAccessorImpl\.invoke0(Native Method)

                at
sun\.reflect\.NativeMethodAccessorImpl\.invoke(NativeMethodAccessorImpl\
.java:39)

                at
sun\.reflect\.DelegatingMethodAccessorImpl\.invoke(DelegatingMethodAcces
sorImpl\.java:25)

                at java\.lang\.reflect\.Method\.invoke(Method\.java:597)

                at
org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.
java:88)

                \.\.\. 13 more

Caused by: java\.lang\.RuntimeException: configuration exception

                at
org\.apache\.hadoop\.streaming\.PipeMapRed\.configure(PipeMapRed\.java:1
82)

                at
org\.apache\.hadoop\.streaming\.PipeMapper\.configure(PipeMapper\.java:6
3)

                \.\.\. 18 more

Caused by: java\.io\.IOException: Cannot run program
\"/tmp/hadoop-ngc/mapred/local/taskTracker/jobcache/job_201006141152_016
5/attempt_201006141152_0165_m_000000_1/work/\./CliquerMap\":
java\.io\.IOException: error\=2, No such file or directory

                at
java\.lang\.ProcessBuilder\.start(ProcessBuilder\.java:460)

                at
org\.apache\.hadoop\.streaming\.PipeMapRed\.configure(PipeMapRed\.java:1
66)

                \.\.\. 19 more

Caused by: java\.io\.IOException: java\.io\.IOException: error\=2, No
such file or directory

                at
java\.lang\.UNIXProcess\.<init>(UNIXProcess\.java:148)

                at java\.lang\.ProcessImpl\.start(ProcessImpl\.java:65)

                at
java\.lang\.ProcessBuilder\.start(ProcessBuilder\.java:453)

                \.\.\. 20 more

" .

MapAttempt TASK_TYPE="MAP" TASKID="task_201006141152_0165_m_000001"
TASK_ATTEMPT_ID="attempt_201006141152_0165_m_000001_1"
START_TIME="1276516428044"
TRACKER_NAME="tracker_hadoop10\.aj\.c2fse\.northgrum\.com:localhost/127\
.0\.0\.1:54798" HTTP_PORT="50060" .

MapAttempt TASK_TYPE="MAP" TASKID="task_201006141152_0165_m_000001"
TASK_ATTEMPT_ID="attempt_201006141152_0165_m_000001_1"
TASK_STATUS="FAILED" FINISH_TIME="1276516432095"
HOSTNAME="hadoop10\.aj\.c2fse\.northgrum\.com"
ERROR="java\.lang\.RuntimeException: Error in configuring object

                at
org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.
java:93)

                at
org\.apache\.hadoop\.util\.ReflectionUtils\.setConf(ReflectionUtils\.jav
a:64)

                at
org\.apache\.hadoop\.util\.ReflectionUtils\.newInstance(ReflectionUtils\
.java:117)

                at
org\.apache\.hadoop\.mapred\.MapTask\.runOldMapper(MapTask\.java:354)

                at
org\.apache\.hadoop\.mapred\.MapTask\.run(MapTask\.java:307)

                at
org\.apache\.hadoop\.mapred\.Child\.main(Child\.java:170)

Caused by: java\.lang\.reflect\.InvocationTargetException

                at
sun\.reflect\.NativeMethodAccessorImpl\.invoke0(Native Method)

                at
sun\.reflect\.NativeMethodAccessorImpl\.invoke(NativeMethodAccessorImpl\
.java:39)

                at
sun\.reflect\.DelegatingMethodAccessorImpl\.invoke(DelegatingMethodAcces
sorImpl\.java:25)

                at java\.lang\.reflect\.Method\.invoke(Method\.java:597)

                at
org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.
java:88)

                \.\.\. 5 more

Caused by: java\.lang\.RuntimeException: Error in configuring object

                at
org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.
java:93)

                at
org\.apache\.hadoop\.util\.ReflectionUtils\.setConf(ReflectionUtils\.jav
a:64)

                at
org\.apache\.hadoop\.util\.ReflectionUtils\.newInstance(ReflectionUtils\
.java:117)

                at
org\.apache\.hadoop\.mapred\.MapRunner\.configure(MapRunner\.java:34)

                \.\.\. 10 more

Caused by: java\.lang\.reflect\.InvocationTargetException

                at
sun\.reflect\.NativeMethodAccessorImpl\.invoke0(Native Method)

                at
sun\.reflect\.NativeMethodAccessorImpl\.invoke(NativeMethodAccessorImpl\
.java:39)

                at
sun\.reflect\.DelegatingMethodAccessorImpl\.invoke(DelegatingMethodAcces
sorImpl\.java:25)

                at java\.lang\.reflect\.Method\.invoke(Method\.java:597)

                at
org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.
java:88)

                \.\.\. 13 more

Caused by: java\.lang\.RuntimeException: configuration exception

                at
org\.apache\.hadoop\.streaming\.PipeMapRed\.configure(PipeMapRed\.java:1
82)

                at
org\.apache\.hadoop\.streaming\.PipeMapper\.configure(PipeMapper\.java:6
3)

                \.\.\. 18 more

Caused by: java\.io\.IOException: Cannot run program
\"/media/hd4/mapred/local/taskTracker/jobcache/job_201006141152_0165/att
empt_201006141152_0165_m_000001_1/work/\./CliquerMap\":
java\.io\.IOException: error\=2, No such file or directory

                at
java\.lang\.ProcessBuilder\.start(ProcessBuilder\.java:460)

                at
org\.apache\.hadoop\.streaming\.PipeMapRed\.configure(PipeMapRed\.java:1
66)

                \.\.\. 19 more

Caused by: java\.io\.IOException: java\.io\.IOException: error\=2, No
such file or directory

                at
java\.lang\.UNIXProcess\.<init>(UNIXProcess\.java:148)

                at java\.lang\.ProcessImpl\.start(ProcessImpl\.java:65)

                at
java\.lang\.ProcessBuilder\.start(ProcessBuilder\.java:453)

                \.\.\. 20 more

" .

MapAttempt TASK_TYPE="MAP" TASKID="task_201006141152_0165_m_000000"
TASK_ATTEMPT_ID="attempt_201006141152_0165_m_000000_2"
START_TIME="1276516433881"
TRACKER_NAME="tracker_hadoop10\.aj\.c2fse\.northgrum\.com:localhost/127\
.0\.0\.1:54798" HTTP_PORT="50060" .

MapAttempt TASK_TYPE="MAP" TASKID="task_201006141152_0165_m_000000"
TASK_ATTEMPT_ID="attempt_201006141152_0165_m_000000_2"
TASK_STATUS="FAILED" FINISH_TIME="1276516437931"
HOSTNAME="hadoop10\.aj\.c2fse\.northgrum\.com"
ERROR="java\.lang\.RuntimeException: Error in configuring object

                at
org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.
java:93)

                at
org\.apache\.hadoop\.util\.ReflectionUtils\.setConf(ReflectionUtils\.jav
a:64)

                at
org\.apache\.hadoop\.util\.ReflectionUtils\.newInstance(ReflectionUtils\
.java:117)

                at
org\.apache\.hadoop\.mapred\.MapTask\.runOldMapper(MapTask\.java:354)

                at
org\.apache\.hadoop\.mapred\.MapTask\.run(MapTask\.java:307)

                at
org\.apache\.hadoop\.mapred\.Child\.main(Child\.java:170)

Caused by: java\.lang\.reflect\.InvocationTargetException

                at
sun\.reflect\.NativeMethodAccessorImpl\.invoke0(Native Method)

                at
sun\.reflect\.NativeMethodAccessorImpl\.invoke(NativeMethodAccessorImpl\
.java:39)

                at
sun\.reflect\.DelegatingMethodAccessorImpl\.invoke(DelegatingMethodAcces
sorImpl\.java:25)

                at java\.lang\.reflect\.Method\.invoke(Method\.java:597)

                at
org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.
java:88)

                \.\.\. 5 more

Caused by: java\.lang\.RuntimeException: Error in configuring object

                at
org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.
java:93)

                at
org\.apache\.hadoop\.util\.ReflectionUtils\.setConf(ReflectionUtils\.jav
a:64)

                at
org\.apache\.hadoop\.util\.ReflectionUtils\.newInstance(ReflectionUtils\
.java:117)

                at
org\.apache\.hadoop\.mapred\.MapRunner\.configure(MapRunner\.java:34)

                \.\.\. 10 more

Caused by: java\.lang\.reflect\.InvocationTargetException

                at
sun\.reflect\.NativeMethodAccessorImpl\.invoke0(Native Method)

                at
sun\.reflect\.NativeMethodAccessorImpl\.invoke(NativeMethodAccessorImpl\
.java:39)

                at
sun\.reflect\.DelegatingMethodAccessorImpl\.invoke(DelegatingMethodAcces
sorImpl\.java:25)

                at java\.lang\.reflect\.Method\.invoke(Method\.java:597)

                at
org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.
java:88)

                \.\.\. 13 more

Caused by: java\.lang\.RuntimeException: configuration exception

                at
org\.apache\.hadoop\.streaming\.PipeMapRed\.configure(PipeMapRed\.java:1
82)

                at
org\.apache\.hadoop\.streaming\.PipeMapper\.configure(PipeMapper\.java:6
3)

                \.\.\. 18 more

Caused by: java\.io\.IOException: Cannot run program
\"/media/hd4/mapred/local/taskTracker/jobcache/job_201006141152_0165/att
empt_201006141152_0165_m_000000_2/work/\./CliquerMap\":
java\.io\.IOException: error\=2, No such file or directory

                at
java\.lang\.ProcessBuilder\.start(ProcessBuilder\.java:460)

                at
org\.apache\.hadoop\.streaming\.PipeMapRed\.configure(PipeMapRed\.java:1
66)

                \.\.\. 19 more

Caused by: java\.io\.IOException: java\.io\.IOException: error\=2, No
such file or directory

                at
java\.lang\.UNIXProcess\.<init>(UNIXProcess\.java:148)

                at java\.lang\.ProcessImpl\.start(ProcessImpl\.java:65)

                at
java\.lang\.ProcessBuilder\.start(ProcessBuilder\.java:453)

                \.\.\. 20 more

" .

MapAttempt TASK_TYPE="MAP" TASKID="task_201006141152_0165_m_000001"
TASK_ATTEMPT_ID="attempt_201006141152_0165_m_000001_2"
START_TIME="1276574021030"
TRACKER_NAME="tracker_hadoop38\.aj\.c2fse\.northgrum\.com:localhost/127\
.0\.0\.1:45065" HTTP_PORT="50060" .

MapAttempt TASK_TYPE="MAP" TASKID="task_201006141152_0165_m_000001"
TASK_ATTEMPT_ID="attempt_201006141152_0165_m_000001_2"
TASK_STATUS="FAILED" FINISH_TIME="1276574024976"
HOSTNAME="hadoop38\.aj\.c2fse\.northgrum\.com"
ERROR="java\.lang\.RuntimeException: Error in configuring object

                at
org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.
java:93)

                at
org\.apache\.hadoop\.util\.ReflectionUtils\.setConf(ReflectionUtils\.jav
a:64)

                at
org\.apache\.hadoop\.util\.ReflectionUtils\.newInstance(ReflectionUtils\
.java:117)

                at
org\.apache\.hadoop\.mapred\.MapTask\.runOldMapper(MapTask\.java:354)

                at
org\.apache\.hadoop\.mapred\.MapTask\.run(MapTask\.java:307)

                at
org\.apache\.hadoop\.mapred\.Child\.main(Child\.java:170)

Caused by: java\.lang\.reflect\.InvocationTargetException

                at
sun\.reflect\.NativeMethodAccessorImpl\.invoke0(Native Method)

                at
sun\.reflect\.NativeMethodAccessorImpl\.invoke(NativeMethodAccessorImpl\
.java:39)

                at
sun\.reflect\.DelegatingMethodAccessorImpl\.invoke(DelegatingMethodAcces
sorImpl\.java:25)

                at java\.lang\.reflect\.Method\.invoke(Method\.java:597)

                at
org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.
java:88)

                \.\.\. 5 more

Caused by: java\.lang\.RuntimeException: Error in configuring object

                at
org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.
java:93)

                at
org\.apache\.hadoop\.util\.ReflectionUtils\.setConf(ReflectionUtils\.jav
a:64)

                at
org\.apache\.hadoop\.util\.ReflectionUtils\.newInstance(ReflectionUtils\
.java:117)

                at
org\.apache\.hadoop\.mapred\.MapRunner\.configure(MapRunner\.java:34)

                \.\.\. 10 more

Caused by: java\.lang\.reflect\.InvocationTargetException

                at
sun\.reflect\.NativeMethodAccessorImpl\.invoke0(Native Method)

                at
sun\.reflect\.NativeMethodAccessorImpl\.invoke(NativeMethodAccessorImpl\
.java:39)

                at
sun\.reflect\.DelegatingMethodAccessorImpl\.invoke(DelegatingMethodAcces
sorImpl\.java:25)

                at java\.lang\.reflect\.Method\.invoke(Method\.java:597)

                at
org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.
java:88)

                \.\.\. 13 more

Caused by: java\.lang\.RuntimeException: configuration exception

                at
org\.apache\.hadoop\.streaming\.PipeMapRed\.configure(PipeMapRed\.java:1
82)

                at
org\.apache\.hadoop\.streaming\.PipeMapper\.configure(PipeMapper\.java:6
3)

                \.\.\. 18 more

Caused by: java\.io\.IOException: Cannot run program
\"/tmp/hadoop-ngc/mapred/local/taskTracker/jobcache/job_201006141152_016
5/attempt_201006141152_0165_m_000001_2/work/\./CliquerMap\":
java\.io\.IOException: error\=2, No such file or directory

                at
java\.lang\.ProcessBuilder\.start(ProcessBuilder\.java:460)

                at
org\.apache\.hadoop\.streaming\.PipeMapRed\.configure(PipeMapRed\.java:1
66)

                \.\.\. 19 more

Caused by: java\.io\.IOException: java\.io\.IOException: error\=2, No
such file or directory

                at
java\.lang\.UNIXProcess\.<init>(UNIXProcess\.java:148)

                at java\.lang\.ProcessImpl\.start(ProcessImpl\.java:65)

                at
java\.lang\.ProcessBuilder\.start(ProcessBuilder\.java:453)

                \.\.\. 20 more

" .

MapAttempt TASK_TYPE="MAP" TASKID="task_201006141152_0165_m_000000"
TASK_ATTEMPT_ID="attempt_201006141152_0165_m_000000_3"
START_TIME="1276574026882"
TRACKER_NAME="tracker_hadoop38\.aj\.c2fse\.northgrum\.com:localhost/127\
.0\.0\.1:45065" HTTP_PORT="50060" .

MapAttempt TASK_TYPE="MAP" TASKID="task_201006141152_0165_m_000000"
TASK_ATTEMPT_ID="attempt_201006141152_0165_m_000000_3"
TASK_STATUS="FAILED" FINISH_TIME="1276574030934"
HOSTNAME="hadoop38\.aj\.c2fse\.northgrum\.com"
ERROR="java\.lang\.RuntimeException: Error in configuring object

                at
org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.
java:93)

                at
org\.apache\.hadoop\.util\.ReflectionUtils\.setConf(ReflectionUtils\.jav
a:64)

                at
org\.apache\.hadoop\.util\.ReflectionUtils\.newInstance(ReflectionUtils\
.java:117)

                at
org\.apache\.hadoop\.mapred\.MapTask\.runOldMapper(MapTask\.java:354)

                at
org\.apache\.hadoop\.mapred\.MapTask\.run(MapTask\.java:307)

                at
org\.apache\.hadoop\.mapred\.Child\.main(Child\.java:170)

Caused by: java\.lang\.reflect\.InvocationTargetException

                at
sun\.reflect\.NativeMethodAccessorImpl\.invoke0(Native Method)

                at
sun\.reflect\.NativeMethodAccessorImpl\.invoke(NativeMethodAccessorImpl\
.java:39)

                at
sun\.reflect\.DelegatingMethodAccessorImpl\.invoke(DelegatingMethodAcces
sorImpl\.java:25)

                at java\.lang\.reflect\.Method\.invoke(Method\.java:597)

                at
org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.
java:88)

                \.\.\. 5 more

Caused by: java\.lang\.RuntimeException: Error in configuring object

                at
org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.
java:93)

                at
org\.apache\.hadoop\.util\.ReflectionUtils\.setConf(ReflectionUtils\.jav
a:64)

                at
org\.apache\.hadoop\.util\.ReflectionUtils\.newInstance(ReflectionUtils\
.java:117)

                at
org\.apache\.hadoop\.mapred\.MapRunner\.configure(MapRunner\.java:34)

                \.\.\. 10 more

Caused by: java\.lang\.reflect\.InvocationTargetException

                at
sun\.reflect\.NativeMethodAccessorImpl\.invoke0(Native Method)

                at
sun\.reflect\.NativeMethodAccessorImpl\.invoke(NativeMethodAccessorImpl\
.java:39)

                at
sun\.reflect\.DelegatingMethodAccessorImpl\.invoke(DelegatingMethodAcces
sorImpl\.java:25)

                at java\.lang\.reflect\.Method\.invoke(Method\.java:597)

                at
org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.
java:88)

                \.\.\. 13 more

Caused by: java\.lang\.RuntimeException: configuration exception

                at
org\.apache\.hadoop\.streaming\.PipeMapRed\.configure(PipeMapRed\.java:1
82)

                at
org\.apache\.hadoop\.streaming\.PipeMapper\.configure(PipeMapper\.java:6
3)

                \.\.\. 18 more

Caused by: java\.io\.IOException: Cannot run program
\"/media/hd3/mapred/local/taskTracker/jobcache/job_201006141152_0165/att
empt_201006141152_0165_m_000000_3/work/\./CliquerMap\":
java\.io\.IOException: error\=2, No such file or directory

                at
java\.lang\.ProcessBuilder\.start(ProcessBuilder\.java:460)

                at
org\.apache\.hadoop\.streaming\.PipeMapRed\.configure(PipeMapRed\.java:1
66)

                \.\.\. 19 more

Caused by: java\.io\.IOException: java\.io\.IOException: error\=2, No
such file or directory

                at
java\.lang\.UNIXProcess\.<init>(UNIXProcess\.java:148)

                at java\.lang\.ProcessImpl\.start(ProcessImpl\.java:65)

                at
java\.lang\.ProcessBuilder\.start(ProcessBuilder\.java:453)

                \.\.\. 20 more

" .

Task TASKID="task_201006141152_0165_m_000000" TASK_TYPE="MAP"
TASK_STATUS="FAILED" FINISH_TIME="1276574030934"
ERROR="java\.lang\.RuntimeException: Error in configuring object

                at
org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.
java:93)

                at
org\.apache\.hadoop\.util\.ReflectionUtils\.setConf(ReflectionUtils\.jav
a:64)

                at
org\.apache\.hadoop\.util\.ReflectionUtils\.newInstance(ReflectionUtils\
.java:117)

                at
org\.apache\.hadoop\.mapred\.MapTask\.runOldMapper(MapTask\.java:354)

                at
org\.apache\.hadoop\.mapred\.MapTask\.run(MapTask\.java:307)

                at
org\.apache\.hadoop\.mapred\.Child\.main(Child\.java:170)

Caused by: java\.lang\.reflect\.InvocationTargetException

                at
sun\.reflect\.NativeMethodAccessorImpl\.invoke0(Native Method)

                at
sun\.reflect\.NativeMethodAccessorImpl\.invoke(NativeMethodAccessorImpl\
.java:39)

                at
sun\.reflect\.DelegatingMethodAccessorImpl\.invoke(DelegatingMethodAcces
sorImpl\.java:25)

                at java\.lang\.reflect\.Method\.invoke(Method\.java:597)

                at
org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.
java:88)

                \.\.\. 5 more

Caused by: java\.lang\.RuntimeException: Error in configuring object

                at
org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.
java:93)

                at
org\.apache\.hadoop\.util\.ReflectionUtils\.setConf(ReflectionUtils\.jav
a:64)

                at
org\.apache\.hadoop\.util\.ReflectionUtils\.newInstance(ReflectionUtils\
.java:117)

                at
org\.apache\.hadoop\.mapred\.MapRunner\.configure(MapRunner\.java:34)

                \.\.\. 10 more

Caused by: java\.lang\.reflect\.InvocationTargetException

                at
sun\.reflect\.NativeMethodAccessorImpl\.invoke0(Native Method)

                at
sun\.reflect\.NativeMethodAccessorImpl\.invoke(NativeMethodAccessorImpl\
.java:39)

                at
sun\.reflect\.DelegatingMethodAccessorImpl\.invoke(DelegatingMethodAcces
sorImpl\.java:25)

                at java\.lang\.reflect\.Method\.invoke(Method\.java:597)

                at
org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.
java:88)

                \.\.\. 13 more

Caused by: java\.lang\.RuntimeException: configuration exception

                at
org\.apache\.hadoop\.streaming\.PipeMapRed\.configure(PipeMapRed\.java:1
82)

                at
org\.apache\.hadoop\.streaming\.PipeMapper\.configure(PipeMapper\.java:6
3)

                \.\.\. 18 more

Caused by: java\.io\.IOException: Cannot run program
\"/media/hd3/mapred/local/taskTracker/jobcache/job_201006141152_0165/att
empt_201006141152_0165_m_000000_3/work/\./CliquerMap\":
java\.io\.IOException: error\=2, No such file or directory

                at
java\.lang\.ProcessBuilder\.start(ProcessBuilder\.java:460)

                at
org\.apache\.hadoop\.streaming\.PipeMapRed\.configure(PipeMapRed\.java:1
66)

                \.\.\. 19 more

Caused by: java\.io\.IOException: java\.io\.IOException: error\=2, No
such file or directory

                at
java\.lang\.UNIXProcess\.<init>(UNIXProcess\.java:148)

                at java\.lang\.ProcessImpl\.start(ProcessImpl\.java:65)

                at
java\.lang\.ProcessBuilder\.start(ProcessBuilder\.java:453)

                \.\.\. 20 more

" TASK_ATTEMPT_ID="" .

Task TASKID="task_201006141152_0165_m_000002" TASK_TYPE="CLEANUP"
START_TIME="1276545178009" SPLITS="" .

MapAttempt TASK_TYPE="MAP" TASKID="task_201006141152_0165_m_000001"
TASK_ATTEMPT_ID="attempt_201006141152_0165_m_000001_3"
START_TIME="1276516443646"
TRACKER_NAME="tracker_hadoop8\.aj\.c2fse\.northgrum\.com:localhost/127\.
0\.0\.1:46295" HTTP_PORT="50060" .

MapAttempt TASK_TYPE="MAP" TASKID="task_201006141152_0165_m_000001"
TASK_ATTEMPT_ID="attempt_201006141152_0165_m_000001_3"
TASK_STATUS="FAILED" FINISH_TIME="1276516447699"
HOSTNAME="hadoop8\.aj\.c2fse\.northgrum\.com"
ERROR="java\.lang\.RuntimeException: Error in configuring object

                at
org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.
java:93)

                at
org\.apache\.hadoop\.util\.ReflectionUtils\.setConf(ReflectionUtils\.jav
a:64)

                at
org\.apache\.hadoop\.util\.ReflectionUtils\.newInstance(ReflectionUtils\
.java:117)

                at
org\.apache\.hadoop\.mapred\.MapTask\.runOldMapper(MapTask\.java:354)

                at
org\.apache\.hadoop\.mapred\.MapTask\.run(MapTask\.java:307)

                at
org\.apache\.hadoop\.mapred\.Child\.main(Child\.java:170)

Caused by: java\.lang\.reflect\.InvocationTargetException

                at
sun\.reflect\.NativeMethodAccessorImpl\.invoke0(Native Method)

                at
sun\.reflect\.NativeMethodAccessorImpl\.invoke(NativeMethodAccessorImpl\
.java:39)

                at
sun\.reflect\.DelegatingMethodAccessorImpl\.invoke(DelegatingMethodAcces
sorImpl\.java:25)

                at java\.lang\.reflect\.Method\.invoke(Method\.java:597)

                at
org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.
java:88)

                \.\.\. 5 more

Caused by: java\.lang\.RuntimeException: Error in configuring object

                at
org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.
java:93)

                at
org\.apache\.hadoop\.util\.ReflectionUtils\.setConf(ReflectionUtils\.jav
a:64)

                at
org\.apache\.hadoop\.util\.ReflectionUtils\.newInstance(ReflectionUtils\
.java:117)

                at
org\.apache\.hadoop\.mapred\.MapRunner\.configure(MapRunner\.java:34)

                \.\.\. 10 more

Caused by: java\.lang\.reflect\.InvocationTargetException

                at
sun\.reflect\.NativeMethodAccessorImpl\.invoke0(Native Method)

                at
sun\.reflect\.NativeMethodAccessorImpl\.invoke(NativeMethodAccessorImpl\
.java:39)

                at
sun\.reflect\.DelegatingMethodAccessorImpl\.invoke(DelegatingMethodAcces
sorImpl\.java:25)

                at java\.lang\.reflect\.Method\.invoke(Method\.java:597)

                at
org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.
java:88)

                \.\.\. 13 more

Caused by: java\.lang\.RuntimeException: configuration exception

                at
org\.apache\.hadoop\.streaming\.PipeMapRed\.configure(PipeMapRed\.java:1
82)

                at
org\.apache\.hadoop\.streaming\.PipeMapper\.configure(PipeMapper\.java:6
3)

                \.\.\. 18 more

Caused by: java\.io\.IOException: Cannot run program
\"/media/hd2/mapred/local/taskTracker/jobcache/job_201006141152_0165/att
empt_201006141152_0165_m_000001_3/work/\./CliquerMap\":
java\.io\.IOException: error\=2, No such file or directory

                at
java\.lang\.ProcessBuilder\.start(ProcessBuilder\.java:460)

                at
org\.apache\.hadoop\.streaming\.PipeMapRed\.configure(PipeMapRed\.java:1
66)

                \.\.\. 19 more

Caused by: java\.io\.IOException: java\.io\.IOException: error\=2, No
such file or directory

                at
java\.lang\.UNIXProcess\.<init>(UNIXProcess\.java:148)

                at java\.lang\.ProcessImpl\.start(ProcessImpl\.java:65)

                at
java\.lang\.ProcessBuilder\.start(ProcessBuilder\.java:453)

                \.\.\. 20 more

" .

MapAttempt TASK_TYPE="CLEANUP" TASKID="task_201006141152_0165_m_000002"
TASK_ATTEMPT_ID="attempt_201006141152_0165_m_000002_0"
START_TIME="1276574032921"
TRACKER_NAME="tracker_hadoop38\.aj\.c2fse\.northgrum\.com:localhost/127\
.0\.0\.1:45065" HTTP_PORT="50060" .

MapAttempt TASK_TYPE="CLEANUP" TASKID="task_201006141152_0165_m_000002"
TASK_ATTEMPT_ID="attempt_201006141152_0165_m_000002_0"
TASK_STATUS="SUCCESS" FINISH_TIME="1276574033570"
HOSTNAME="/default-rack/hadoop38\.aj\.c2fse\.northgrum\.com"
STATE_STRING="cleanup"
COUNTERS="{(org\.apache\.hadoop\.mapred\.Task$Counter)(Map-Reduce
Framework)[(SPILLED_RECORDS)(Spilled Records)(0)]}" .

Task TASKID="task_201006141152_0165_m_000002" TASK_TYPE="CLEANUP"
TASK_STATUS="SUCCESS" FINISH_TIME="1276545181014"
COUNTERS="{(org\.apache\.hadoop\.mapred\.Task$Counter)(Map-Reduce
Framework)[(SPILLED_RECORDS)(Spilled Records)(0)]}" .

Job JOBID="job_201006141152_0165" FINISH_TIME="1276545181014"
JOB_STATUS="FAILED" FINISHED_MAPS="0" FINISHED_REDUCES="0"

 

Alan 

 

From: Amareshwari Sri Ramadasu [mailto:amarsri@yahoo-inc.com] 
Sent: Monday, June 14, 2010 12:44 AM
To: mapreduce-user@hadoop.apache.org
Subject: Re: Irreproducible Streaming Jobs

 

I don't know how your first run passed, but your streaming command
should be :
 bin/hadoop jar contrib/streaming/hadoop-0.20.2-streaming.jar -file
streamingapps/Steg/SDMapper -mapper SDMapper -file
streamingapps/Steg/Test2 -reducer Test2 -input ImageList -output
StegOut1

Your mapper/reducer should be the command to run. The paths
streamingapps/Steg/SDMapper and streamingapps/Steg/Test2 would be
present on your local filesystem (on client machine), not on compute
nodes.

Thanks
Amareshwari
On 6/11/10 7:05 PM, "Ratner, Alan S (IS)" <Alan.Ratner@ngc.com> wrote:

Our Hadoop streaming jobs are unpredictable.  The following illustrates
this problem.  I reset the system first to start with a clean slate
(deleting tmp files on master and all slaves, reformatting name node,
etc.).  I then ran a streaming job which gave the expected results.  I
then ran the exact same job again (using a different output file name)
and it bombed.  Curiously although the second run generated "no such
file or directory" errors in the log file but so did the first run.  I
suspect that our streaming job is doing something wrong (despite the
correct results) and corrupting the tmp files.  (These jobs were run on
40 servers configured as 1 master and 39 slaves.)  Any suggestions?

FIRST RUN 

ngc@hadoop1:~/hadoop-0.20.2$ bin/hadoop jar
contrib/streaming/hadoop-0.20.2-streaming.jar -file
streamingapps/Steg/SDMapper -mapper streamingapps/Steg/SDMapper -file
streamingapps/Steg/Test2 -reducer streamingapps/Steg/Test2 -input
ImageList -output StegOut1

packageJobJar: [streamingapps/Steg/SDMapper, streamingapps/Steg/Test2,
/tmp/hadoop-ngc/hadoop-unjar1378560104000865091/] []
/tmp/streamjob1574130777925793571.jar tmpDir=null

10/06/11 08:15:09 INFO mapred.FileInputFormat: Total input paths to
process : 1

10/06/11 08:15:09 INFO streaming.StreamJob: getLocalDirs():
[/tmp/hadoop-ngc/mapred/local, /media/hd2/mapred/local,
/media/hd3/mapred/local, /media/hd4/mapred/local]

10/06/11 08:15:09 INFO streaming.StreamJob: Running job:
job_201006110802_0013

10/06/11 08:15:09 INFO streaming.StreamJob: To kill this job, run:

10/06/11 08:15:09 INFO streaming.StreamJob:
/home/ngc/hadoop-0.20.2/bin/../bin/hadoop job
-Dmapred.job.tracker=10.64.147.2:9002 -kill job_201006110802_0013

10/06/11 08:15:09 INFO streaming.StreamJob: Tracking URL:
http://hadoop1.aj.c2fse.northgrum.com:50030/jobdetails.jsp?jobid=job_201
006110802_0013

10/06/11 08:15:10 INFO streaming.StreamJob:  map 0%  reduce 0%

10/06/11 08:15:22 INFO streaming.StreamJob:  map 50%  reduce 0%

10/06/11 08:15:28 INFO streaming.StreamJob:  map 100%  reduce 0%

10/06/11 08:15:31 INFO streaming.StreamJob:  map 100%  reduce 17%

10/06/11 08:15:40 INFO streaming.StreamJob:  map 100%  reduce 100%

10/06/11 08:15:43 INFO streaming.StreamJob: Job complete:
job_201006110802_0013

10/06/11 08:15:43 INFO streaming.StreamJob: Output: StegOut1

SECOND RUN

ngc@hadoop1:~/hadoop-0.20.2$ bin/hadoop jar
contrib/streaming/hadoop-0.20.2-streaming.jar -file
streamingapps/Steg/SDMapper -mapper streamingapps/Steg/SDMapper -file
streamingapps/Steg/Test2 -reducer streamingapps/Steg/Test2 -input
ImageList -output StegOut2

packageJobJar: [streamingapps/Steg/SDMapper, streamingapps/Steg/Test2,
/tmp/hadoop-ngc/hadoop-unjar7292727069710530665/] []
/tmp/streamjob8749080748645718359.jar tmpDir=null

10/06/11 08:16:00 INFO mapred.FileInputFormat: Total input paths to
process : 1

10/06/11 08:16:00 INFO streaming.StreamJob: getLocalDirs():
[/tmp/hadoop-ngc/mapred/local, /media/hd2/mapred/local,
/media/hd3/mapred/local, /media/hd4/mapred/local]

10/06/11 08:16:00 INFO streaming.StreamJob: Running job:
job_201006110802_0016

10/06/11 08:16:00 INFO streaming.StreamJob: To kill this job, run:

10/06/11 08:16:00 INFO streaming.StreamJob:
/home/ngc/hadoop-0.20.2/bin/../bin/hadoop job
-Dmapred.job.tracker=10.64.147.2:9002 -kill job_201006110802_0016

10/06/11 08:16:00 INFO streaming.StreamJob: Tracking URL:
http://hadoop1.aj.c2fse.northgrum.com:50030/jobdetails.jsp?jobid=job_201
006110802_0016

10/06/11 08:16:01 INFO streaming.StreamJob:  map 0%  reduce 0%

10/06/11 08:16:19 INFO streaming.StreamJob:  map 50%  reduce 0%

10/06/11 08:16:28 INFO streaming.StreamJob:  map 50%  reduce 17%

10/06/11 08:16:32 INFO streaming.StreamJob:  map 100%  reduce 100%

10/06/11 08:16:32 INFO streaming.StreamJob: To kill this job, run:

10/06/11 08:16:32 INFO streaming.StreamJob:
/home/ngc/hadoop-0.20.2/bin/../bin/hadoop job
-Dmapred.job.tracker=10.64.147.2:9002 -kill job_201006110802_0016

10/06/11 08:16:32 INFO streaming.StreamJob: Tracking URL:
http://hadoop1.aj.c2fse.northgrum.com:50030/jobdetails.jsp?jobid=job_201
006110802_0016

10/06/11 08:16:32 ERROR streaming.StreamJob: Job not Successful!

10/06/11 08:16:32 INFO streaming.StreamJob: killJob...

Streaming Job Failed!

MAP LOG FILE OF SECOND RUN

Meta VERSION="1" .

Job JOBID="job_201006110802_0016"
JOBNAME="streamjob8749080748645718359\.jar" USER="ngc"
SUBMIT_TIME="1276258560297"
JOBCONF="hdfs://hadoop1\.aj\.c2fse\.northgrum\.com:9000/tmp/hadoop-ngc/m
apred/system/job_201006110802_0016/job\.xml" .

Job JOBID="job_201006110802_0016" JOB_PRIORITY="NORMAL" .

Job JOBID="job_201006110802_0016" LAUNCH_TIME="1276258560564"
TOTAL_MAPS="2" TOTAL_REDUCES="1" JOB_STATUS="PREP" .

Task TASKID="task_201006110802_0016_m_000003" TASK_TYPE="SETUP"
START_TIME="1276258560932" SPLITS="" .

MapAttempt TASK_TYPE="SETUP" TASKID="task_201006110802_0016_m_000003"
TASK_ATTEMPT_ID="attempt_201006110802_0016_m_000003_0"
START_TIME="1276229924181"
TRACKER_NAME="tracker_hadoop6\.aj\.c2fse\.northgrum\.com:localhost/127\.
0\.0\.1:49372" HTTP_PORT="50060" .

MapAttempt TASK_TYPE="SETUP" TASKID="task_201006110802_0016_m_000003"
TASK_ATTEMPT_ID="attempt_201006110802_0016_m_000003_0"
TASK_STATUS="SUCCESS" FINISH_TIME="1276229924886"
HOSTNAME="/default-rack/hadoop6\.aj\.c2fse\.northgrum\.com"
STATE_STRING="setup"
COUNTERS="{(org\.apache\.hadoop\.mapred\.Task$Counter)(Map-Reduce
Framework)[(SPILLED_RECORDS)(Spilled Records)(0)]}" .

Task TASKID="task_201006110802_0016_m_000003" TASK_TYPE="SETUP"
TASK_STATUS="SUCCESS" FINISH_TIME="1276258563937"
COUNTERS="{(org\.apache\.hadoop\.mapred\.Task$Counter)(Map-Reduce
Framework)[(SPILLED_RECORDS)(Spilled Records)(0)]}" .

Job JOBID="job_201006110802_0016" JOB_STATUS="RUNNING" .

Task TASKID="task_201006110802_0016_m_000000" TASK_TYPE="MAP"
START_TIME="1276258563937"
SPLITS="/default-rack/hadoop20\.aj\.c2fse\.northgrum\.com,/default-rack/
hadoop17\.aj\.c2fse\.northgrum\.com" .

Task TASKID="task_201006110802_0016_m_000001" TASK_TYPE="MAP"
START_TIME="1276258564747"
SPLITS="/default-rack/hadoop20\.aj\.c2fse\.northgrum\.com,/default-rack/
hadoop17\.aj\.c2fse\.northgrum\.com" .

MapAttempt TASK_TYPE="MAP" TASKID="task_201006110802_0016_m_000000"
TASK_ATTEMPT_ID="attempt_201006110802_0016_m_000000_0"
START_TIME="1276229927063"
TRACKER_NAME="tracker_hadoop6\.aj\.c2fse\.northgrum\.com:localhost/127\.
0\.0\.1:49372" HTTP_PORT="50060" .

MapAttempt TASK_TYPE="MAP" TASKID="task_201006110802_0016_m_000000"
TASK_ATTEMPT_ID="attempt_201006110802_0016_m_000000_0"
TASK_STATUS="FAILED" FINISH_TIME="1276229931379"
HOSTNAME="hadoop6\.aj\.c2fse\.northgrum\.com"
ERROR="java\.lang\.RuntimeException: Error in configuring object

        at
org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.
java:93)

        at
org\.apache\.hadoop\.util\.ReflectionUtils\.setConf(ReflectionUtils\.jav
a:64)

        at
org\.apache\.hadoop\.util\.ReflectionUtils\.newInstance(ReflectionUtils\
.java:117)

        at
org\.apache\.hadoop\.mapred\.MapTask\.runOldMapper(MapTask\.java:354)

        at org\.apache\.hadoop\.mapred\.MapTask\.run(MapTask\.java:307)

        at org\.apache\.hadoop\.mapred\.Child\.main(Child\.java:170)

Caused by: java\.lang\.reflect\.InvocationTargetException

        at sun\.reflect\.NativeMethodAccessorImpl\.invoke0(Native
Method)

        at
sun\.reflect\.NativeMethodAccessorImpl\.invoke(NativeMethodAccessorImpl\
.java:39)

        at
sun\.reflect\.DelegatingMethodAccessorImpl\.invoke(DelegatingMethodAcces
sorImpl\.java:25)

        at java\.lang\.reflect\.Method\.invoke(Method\.java:597)

        at
org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.
java:88)

        \.\.\. 5 more

Caused by: java\.lang\.RuntimeException: Error in configuring object

        at
org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.
java:93)

        at
org\.apache\.hadoop\.util\.ReflectionUtils\.setConf(ReflectionUtils\.jav
a:64)

        at
org\.apache\.hadoop\.util\.ReflectionUtils\.newInstance(ReflectionUtils\
.java:117)

        at
org\.apache\.hadoop\.mapred\.MapRunner\.configure(MapRunner\.java:34)

        \.\.\. 10 more

Caused by: java\.lang\.reflect\.InvocationTargetException

        at sun\.reflect\.NativeMethodAccessorImpl\.invoke0(Native
Method)

        at
sun\.reflect\.NativeMethodAccessorImpl\.invoke(NativeMethodAccessorImpl\
.java:39)

        at
sun\.reflect\.DelegatingMethodAccessorImpl\.invoke(DelegatingMethodAcces
sorImpl\.java:25)

        at java\.lang\.reflect\.Method\.invoke(Method\.java:597)

        at
org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.
java:88)

        \.\.\. 13 more

Caused by: java\.lang\.RuntimeException: configuration exception

        at
org\.apache\.hadoop\.streaming\.PipeMapRed\.configure(PipeMapRed\.java:1
82)

        at
org\.apache\.hadoop\.streaming\.PipeMapper\.configure(PipeMapper\.java:6
3)

        \.\.\. 18 more

Caused by: java\.io\.IOException: Cannot run program
\"/tmp/hadoop-ngc/mapred/local/taskTracker/jobcache/job_201006110802_001
6/attempt_201006110802_0016_m_000000_0/work/\./SDMapper\":
java\.io\.IOException: error\=2, No such file or directory

        at java\.lang\.ProcessBuilder\.start(ProcessBuilder\.java:460)

        at
org\.apache\.hadoop\.streaming\.PipeMapRed\.configure(PipeMapRed\.java:1
66)

        \.\.\. 19 more

Caused by: java\.io\.IOException: java\.io\.IOException: error\=2, No
such file or directory

        at java\.lang\.UNIXProcess\.<init>(UNIXProcess\.java:148)

        at java\.lang\.ProcessImpl\.start(ProcessImpl\.java:65)

        at java\.lang\.ProcessBuilder\.start(ProcessBuilder\.java:453)

        \.\.\. 20 more

" .

MapAttempt TASK_TYPE="MAP" TASKID="task_201006110802_0016_m_000001"
TASK_ATTEMPT_ID="attempt_201006110802_0016_m_000001_0"
START_TIME="1276229819233"
TRACKER_NAME="tracker_hadoop8\.aj\.c2fse\.northgrum\.com:localhost/127\.
0\.0\.1:35631" HTTP_PORT="50060" .

MapAttempt TASK_TYPE="MAP" TASKID="task_201006110802_0016_m_000001"
TASK_ATTEMPT_ID="attempt_201006110802_0016_m_000001_0"
TASK_STATUS="FAILED" FINISH_TIME="1276229823283"
HOSTNAME="hadoop8\.aj\.c2fse\.northgrum\.com"
ERROR="java\.lang\.RuntimeException: Error in configuring object

        at
org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.
java:93)

        at
org\.apache\.hadoop\.util\.ReflectionUtils\.setConf(ReflectionUtils\.jav
a:64)

        at
org\.apache\.hadoop\.util\.ReflectionUtils\.newInstance(ReflectionUtils\
.java:117)

        at
org\.apache\.hadoop\.mapred\.MapTask\.runOldMapper(MapTask\.java:354)

        at org\.apache\.hadoop\.mapred\.MapTask\.run(MapTask\.java:307)

        at org\.apache\.hadoop\.mapred\.Child\.main(Child\.java:170)

Caused by: java\.lang\.reflect\.InvocationTargetException

        at sun\.reflect\.NativeMethodAccessorImpl\.invoke0(Native
Method)

        at
sun\.reflect\.NativeMethodAccessorImpl\.invoke(NativeMethodAccessorImpl\
.java:39)

        at
sun\.reflect\.DelegatingMethodAccessorImpl\.invoke(DelegatingMethodAcces
sorImpl\.java:25)

        at java\.lang\.reflect\.Method\.invoke(Method\.java:597)

        at
org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.
java:88)

        \.\.\. 5 more

Caused by: java\.lang\.RuntimeException: Error in configuring object

        at
org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.
java:93)

        at
org\.apache\.hadoop\.util\.ReflectionUtils\.setConf(ReflectionUtils\.jav
a:64)

        at
org\.apache\.hadoop\.util\.ReflectionUtils\.newInstance(ReflectionUtils\
.java:117)

        at
org\.apache\.hadoop\.mapred\.MapRunner\.configure(MapRunner\.java:34)

        \.\.\. 10 more

Caused by: java\.lang\.reflect\.InvocationTargetException

        at sun\.reflect\.NativeMethodAccessorImpl\.invoke0(Native
Method)

        at
sun\.reflect\.NativeMethodAccessorImpl\.invoke(NativeMethodAccessorImpl\
.java:39)

        at
sun\.reflect\.DelegatingMethodAccessorImpl\.invoke(DelegatingMethodAcces
sorImpl\.java:25)

        at java\.lang\.reflect\.Method\.invoke(Method\.java:597)

        at
org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.
java:88)

        \.\.\. 13 more

Caused by: java\.lang\.RuntimeException: configuration exception

        at
org\.apache\.hadoop\.streaming\.PipeMapRed\.configure(PipeMapRed\.java:1
82)

        at
org\.apache\.hadoop\.streaming\.PipeMapper\.configure(PipeMapper\.java:6
3)

        \.\.\. 18 more

Caused by: java\.io\.IOException: Cannot run program
\"/media/hd3/mapred/local/taskTracker/jobcache/job_201006110802_0016/att
empt_201006110802_0016_m_000001_0/work/\./SDMapper\":
java\.io\.IOException: error\=2, No such file or directory

        at java\.lang\.ProcessBuilder\.start(ProcessBuilder\.java:460)

        at
org\.apache\.hadoop\.streaming\.PipeMapRed\.configure(PipeMapRed\.java:1
66)

        \.\.\. 19 more

Caused by: java\.io\.IOException: java\.io\.IOException: error\=2, No
such file or directory

        at java\.lang\.UNIXProcess\.<init>(UNIXProcess\.java:148)

        at java\.lang\.ProcessImpl\.start(ProcessImpl\.java:65)

        at java\.lang\.ProcessBuilder\.start(ProcessBuilder\.java:453)

        \.\.\. 20 more

" .

MapAttempt TASK_TYPE="MAP" TASKID="task_201006110802_0016_m_000000"
TASK_ATTEMPT_ID="attempt_201006110802_0016_m_000000_1"
START_TIME="1276230008685"
TRACKER_NAME="tracker_hadoop3\.aj\.c2fse\.northgrum\.com:localhost/127\.
0\.0\.1:34294" HTTP_PORT="50060" .

MapAttempt TASK_TYPE="MAP" TASKID="task_201006110802_0016_m_000000"
TASK_ATTEMPT_ID="attempt_201006110802_0016_m_000000_1"
TASK_STATUS="FAILED" FINISH_TIME="1276230012735"
HOSTNAME="hadoop3\.aj\.c2fse\.northgrum\.com"
ERROR="java\.lang\.RuntimeException: Error in configuring object

        at
org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.
java:93)

        at
org\.apache\.hadoop\.util\.ReflectionUtils\.setConf(ReflectionUtils\.jav
a:64)

        at
org\.apache\.hadoop\.util\.ReflectionUtils\.newInstance(ReflectionUtils\
.java:117)

        at
org\.apache\.hadoop\.mapred\.MapTask\.runOldMapper(MapTask\.java:354)

        at org\.apache\.hadoop\.mapred\.MapTask\.run(MapTask\.java:307)

        at org\.apache\.hadoop\.mapred\.Child\.main(Child\.java:170)

Caused by: java\.lang\.reflect\.InvocationTargetException

        at sun\.reflect\.NativeMethodAccessorImpl\.invoke0(Native
Method)

        at
sun\.reflect\.NativeMethodAccessorImpl\.invoke(NativeMethodAccessorImpl\
.java:39)

        at
sun\.reflect\.DelegatingMethodAccessorImpl\.invoke(DelegatingMethodAcces
sorImpl\.java:25)

        at java\.lang\.reflect\.Method\.invoke(Method\.java:597)

        at
org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.
java:88)

        \.\.\. 5 more

Caused by: java\.lang\.RuntimeException: Error in configuring object

        at
org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.
java:93)

        at
org\.apache\.hadoop\.util\.ReflectionUtils\.setConf(ReflectionUtils\.jav
a:64)

        at
org\.apache\.hadoop\.util\.ReflectionUtils\.newInstance(ReflectionUtils\
.java:117)

        at
org\.apache\.hadoop\.mapred\.MapRunner\.configure(MapRunner\.java:34)

        \.\.\. 10 more

Caused by: java\.lang\.reflect\.InvocationTargetException

        at sun\.reflect\.NativeMethodAccessorImpl\.invoke0(Native
Method)

        at
sun\.reflect\.NativeMethodAccessorImpl\.invoke(NativeMethodAccessorImpl\
.java:39)

        at
sun\.reflect\.DelegatingMethodAccessorImpl\.invoke(DelegatingMethodAcces
sorImpl\.java:25)

        at java\.lang\.reflect\.Method\.invoke(Method\.java:597)

        at
org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.
java:88)

        \.\.\. 13 more

Caused by: java\.lang\.RuntimeException: configuration exception

        at
org\.apache\.hadoop\.streaming\.PipeMapRed\.configure(PipeMapRed\.java:1
82)

        at
org\.apache\.hadoop\.streaming\.PipeMapper\.configure(PipeMapper\.java:6
3)

        \.\.\. 18 more

Caused by: java\.io\.IOException: Cannot run program
\"/media/hd2/mapred/local/taskTracker/jobcache/job_201006110802_0016/att
empt_201006110802_0016_m_000000_1/work/\./SDMapper\":
java\.io\.IOException: error\=2, No such file or directory

        at java\.lang\.ProcessBuilder\.start(ProcessBuilder\.java:460)

        at
org\.apache\.hadoop\.streaming\.PipeMapRed\.configure(PipeMapRed\.java:1
66)

        \.\.\. 19 more

Caused by: java\.io\.IOException: java\.io\.IOException: error\=2, No
such file or directory

        at java\.lang\.UNIXProcess\.<init>(UNIXProcess\.java:148)

        at java\.lang\.ProcessImpl\.start(ProcessImpl\.java:65)

        at java\.lang\.ProcessBuilder\.start(ProcessBuilder\.java:453)

        \.\.\. 20 more

" .

MapAttempt TASK_TYPE="MAP" TASKID="task_201006110802_0016_m_000001"
TASK_ATTEMPT_ID="attempt_201006110802_0016_m_000001_1"
START_TIME="1276229520733"
TRACKER_NAME="tracker_hadoop23\.aj\.c2fse\.northgrum\.com:localhost/127\
.0\.0\.1:58025" HTTP_PORT="50060" .

MapAttempt TASK_TYPE="MAP" TASKID="task_201006110802_0016_m_000001"
TASK_ATTEMPT_ID="attempt_201006110802_0016_m_000001_1"
TASK_STATUS="FAILED" FINISH_TIME="1276229524784"
HOSTNAME="hadoop23\.aj\.c2fse\.northgrum\.com"
ERROR="java\.lang\.RuntimeException: Error in configuring object

        at
org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.
java:93)

        at
org\.apache\.hadoop\.util\.ReflectionUtils\.setConf(ReflectionUtils\.jav
a:64)

        at
org\.apache\.hadoop\.util\.ReflectionUtils\.newInstance(ReflectionUtils\
.java:117)

        at
org\.apache\.hadoop\.mapred\.MapTask\.runOldMapper(MapTask\.java:354)

        at org\.apache\.hadoop\.mapred\.MapTask\.run(MapTask\.java:307)

        at org\.apache\.hadoop\.mapred\.Child\.main(Child\.java:170)

Caused by: java\.lang\.reflect\.InvocationTargetException

        at sun\.reflect\.NativeMethodAccessorImpl\.invoke0(Native
Method)

        at
sun\.reflect\.NativeMethodAccessorImpl\.invoke(NativeMethodAccessorImpl\
.java:39)

        at
sun\.reflect\.DelegatingMethodAccessorImpl\.invoke(DelegatingMethodAcces
sorImpl\.java:25)

        at java\.lang\.reflect\.Method\.invoke(Method\.java:597)

        at
org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.
java:88)

        \.\.\. 5 more

Caused by: java\.lang\.RuntimeException: Error in configuring object

        at
org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.
java:93)

        at
org\.apache\.hadoop\.util\.ReflectionUtils\.setConf(ReflectionUtils\.jav
a:64)

        at
org\.apache\.hadoop\.util\.ReflectionUtils\.newInstance(ReflectionUtils\
.java:117)

        at
org\.apache\.hadoop\.mapred\.MapRunner\.configure(MapRunner\.java:34)

        \.\.\. 10 more

Caused by: java\.lang\.reflect\.InvocationTargetException

        at sun\.reflect\.NativeMethodAccessorImpl\.invoke0(Native
Method)

        at
sun\.reflect\.NativeMethodAccessorImpl\.invoke(NativeMethodAccessorImpl\
.java:39)

        at
sun\.reflect\.DelegatingMethodAccessorImpl\.invoke(DelegatingMethodAcces
sorImpl\.java:25)

        at java\.lang\.reflect\.Method\.invoke(Method\.java:597)

        at
org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.
java:88)

        \.\.\. 13 more

Caused by: java\.lang\.RuntimeException: configuration exception

        at
org\.apache\.hadoop\.streaming\.PipeMapRed\.configure(PipeMapRed\.java:1
82)

        at
org\.apache\.hadoop\.streaming\.PipeMapper\.configure(PipeMapper\.java:6
3)

        \.\.\. 18 more

Caused by: java\.io\.IOException: Cannot run program
\"/tmp/hadoop-ngc/mapred/local/taskTracker/jobcache/job_201006110802_001
6/attempt_201006110802_0016_m_000001_1/work/\./SDMapper\":
java\.io\.IOException: error\=2, No such file or directory

        at java\.lang\.ProcessBuilder\.start(ProcessBuilder\.java:460)

        at
org\.apache\.hadoop\.streaming\.PipeMapRed\.configure(PipeMapRed\.java:1
66)

        \.\.\. 19 more

Caused by: java\.io\.IOException: java\.io\.IOException: error\=2, No
such file or directory

        at java\.lang\.UNIXProcess\.<init>(UNIXProcess\.java:148)

        at java\.lang\.ProcessImpl\.start(ProcessImpl\.java:65)

        at java\.lang\.ProcessBuilder\.start(ProcessBuilder\.java:453)

        \.\.\. 20 more

" .

MapAttempt TASK_TYPE="MAP" TASKID="task_201006110802_0016_m_000000"
TASK_ATTEMPT_ID="attempt_201006110802_0016_m_000000_2"
START_TIME="1276229773743"
TRACKER_NAME="tracker_hadoop2\.aj\.c2fse\.northgrum\.com:localhost/127\.
0\.0\.1:51829" HTTP_PORT="50060" .

MapAttempt TASK_TYPE="MAP" TASKID="task_201006110802_0016_m_000000"
TASK_ATTEMPT_ID="attempt_201006110802_0016_m_000000_2"
TASK_STATUS="SUCCESS" FINISH_TIME="1276229774851"
HOSTNAME="/default-rack/hadoop2\.aj\.c2fse\.northgrum\.com"
STATE_STRING="Records R/W\=1/1"
COUNTERS="{(FileSystemCounters)(FileSystemCounters)[(HDFS_BYTES_READ)(HD
FS_BYTES_READ)(18)][(FILE_BYTES_WRITTEN)(FILE_BYTES_WRITTEN)(94)]}{(org\
.apache\.hadoop\.mapred\.Task$Counter)(Map-Reduce
Framework)[(COMBINE_OUTPUT_RECORDS)(Combine output
records)(0)][(MAP_INPUT_RECORDS)(Map input
records)(1)][(SPILLED_RECORDS)(Spilled
Records)(1)][(MAP_OUTPUT_BYTES)(Map output
bytes)(54)][(MAP_INPUT_BYTES)(Map input
bytes)(18)][(COMBINE_INPUT_RECORDS)(Combine input
records)(0)][(MAP_OUTPUT_RECORDS)(Map output records)(1)]}" .

Task TASKID="task_201006110802_0016_m_000000" TASK_TYPE="MAP"
TASK_STATUS="SUCCESS" FINISH_TIME="1276258579350"
COUNTERS="{(FileSystemCounters)(FileSystemCounters)[(HDFS_BYTES_READ)(HD
FS_BYTES_READ)(18)][(FILE_BYTES_WRITTEN)(FILE_BYTES_WRITTEN)(94)]}{(org\
.apache\.hadoop\.mapred\.Task$Counter)(Map-Reduce
Framework)[(COMBINE_OUTPUT_RECORDS)(Combine output
records)(0)][(MAP_INPUT_RECORDS)(Map input
records)(1)][(SPILLED_RECORDS)(Spilled
Records)(1)][(MAP_OUTPUT_BYTES)(Map output
bytes)(54)][(MAP_INPUT_BYTES)(Map input
bytes)(18)][(COMBINE_INPUT_RECORDS)(Combine input
records)(0)][(MAP_OUTPUT_RECORDS)(Map output records)(1)]}" .

Task TASKID="task_201006110802_0016_r_000000" TASK_TYPE="REDUCE"
START_TIME="1276258579351" SPLITS="" .

MapAttempt TASK_TYPE="MAP" TASKID="task_201006110802_0016_m_000001"
TASK_ATTEMPT_ID="attempt_201006110802_0016_m_000001_2"
START_TIME="1276316358506"
TRACKER_NAME="tracker_hadoop24\.aj\.c2fse\.northgrum\.com:localhost/127\
.0\.0\.1:38111" HTTP_PORT="50060" .

MapAttempt TASK_TYPE="MAP" TASKID="task_201006110802_0016_m_000001"
TASK_ATTEMPT_ID="attempt_201006110802_0016_m_000001_2"
TASK_STATUS="FAILED" FINISH_TIME="1276316362553"
HOSTNAME="hadoop24\.aj\.c2fse\.northgrum\.com"
ERROR="java\.lang\.RuntimeException: Error in configuring object

        at
org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.
java:93)

        at
org\.apache\.hadoop\.util\.ReflectionUtils\.setConf(ReflectionUtils\.jav
a:64)

        at
org\.apache\.hadoop\.util\.ReflectionUtils\.newInstance(ReflectionUtils\
.java:117)

        at
org\.apache\.hadoop\.mapred\.MapTask\.runOldMapper(MapTask\.java:354)

        at org\.apache\.hadoop\.mapred\.MapTask\.run(MapTask\.java:307)

        at org\.apache\.hadoop\.mapred\.Child\.main(Child\.java:170)

Caused by: java\.lang\.reflect\.InvocationTargetException

        at sun\.reflect\.NativeMethodAccessorImpl\.invoke0(Native
Method)

        at
sun\.reflect\.NativeMethodAccessorImpl\.invoke(NativeMethodAccessorImpl\
.java:39)

        at
sun\.reflect\.DelegatingMethodAccessorImpl\.invoke(DelegatingMethodAcces
sorImpl\.java:25)

        at java\.lang\.reflect\.Method\.invoke(Method\.java:597)

        at
org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.
java:88)

        \.\.\. 5 more

Caused by: java\.lang\.RuntimeException: Error in configuring object

        at
org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.
java:93)

        at
org\.apache\.hadoop\.util\.ReflectionUtils\.setConf(ReflectionUtils\.jav
a:64)

        at
org\.apache\.hadoop\.util\.ReflectionUtils\.newInstance(ReflectionUtils\
.java:117)

        at
org\.apache\.hadoop\.mapred\.MapRunner\.configure(MapRunner\.java:34)

        \.\.\. 10 more

Caused by: java\.lang\.reflect\.InvocationTargetException

        at sun\.reflect\.NativeMethodAccessorImpl\.invoke0(Native
Method)

        at
sun\.reflect\.NativeMethodAccessorImpl\.invoke(NativeMethodAccessorImpl\
.java:39)

        at
sun\.reflect\.DelegatingMethodAccessorImpl\.invoke(DelegatingMethodAcces
sorImpl\.java:25)

        at java\.lang\.reflect\.Method\.invoke(Method\.java:597)

        at
org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.
java:88)

        \.\.\. 13 more

Caused by: java\.lang\.RuntimeException: configuration exception

        at
org\.apache\.hadoop\.streaming\.PipeMapRed\.configure(PipeMapRed\.java:1
82)

        at
org\.apache\.hadoop\.streaming\.PipeMapper\.configure(PipeMapper\.java:6
3)

        \.\.\. 18 more

Caused by: java\.io\.IOException: Cannot run program
\"/tmp/hadoop-ngc/mapred/local/taskTracker/jobcache/job_201006110802_001
6/attempt_201006110802_0016_m_000001_2/work/\./SDMapper\":
java\.io\.IOException: error\=2, No such file or directory

        at java\.lang\.ProcessBuilder\.start(ProcessBuilder\.java:460)

        at
org\.apache\.hadoop\.streaming\.PipeMapRed\.configure(PipeMapRed\.java:1
66)

        \.\.\. 19 more

Caused by: java\.io\.IOException: java\.io\.IOException: error\=2, No
such file or directory

        at java\.lang\.UNIXProcess\.<init>(UNIXProcess\.java:148)

        at java\.lang\.ProcessImpl\.start(ProcessImpl\.java:65)

        at java\.lang\.ProcessBuilder\.start(ProcessBuilder\.java:453)

        \.\.\. 20 more

" .

MapAttempt TASK_TYPE="MAP" TASKID="task_201006110802_0016_m_000001"
TASK_ATTEMPT_ID="attempt_201006110802_0016_m_000001_3"
START_TIME="1276229596341"
TRACKER_NAME="tracker_hadoop19\.aj\.c2fse\.northgrum\.com:localhost/127\
.0\.0\.1:56345" HTTP_PORT="50060" .

MapAttempt TASK_TYPE="MAP" TASKID="task_201006110802_0016_m_000001"
TASK_ATTEMPT_ID="attempt_201006110802_0016_m_000001_3"
TASK_STATUS="FAILED" FINISH_TIME="1276229600392"
HOSTNAME="hadoop19\.aj\.c2fse\.northgrum\.com"
ERROR="java\.lang\.RuntimeException: Error in configuring object

        at
org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.
java:93)

        at
org\.apache\.hadoop\.util\.ReflectionUtils\.setConf(ReflectionUtils\.jav
a:64)

        at
org\.apache\.hadoop\.util\.ReflectionUtils\.newInstance(ReflectionUtils\
.java:117)

        at
org\.apache\.hadoop\.mapred\.MapTask\.runOldMapper(MapTask\.java:354)

        at org\.apache\.hadoop\.mapred\.MapTask\.run(MapTask\.java:307)

        at org\.apache\.hadoop\.mapred\.Child\.main(Child\.java:170)

Caused by: java\.lang\.reflect\.InvocationTargetException

        at sun\.reflect\.NativeMethodAccessorImpl\.invoke0(Native
Method)

        at
sun\.reflect\.NativeMethodAccessorImpl\.invoke(NativeMethodAccessorImpl\
.java:39)

        at
sun\.reflect\.DelegatingMethodAccessorImpl\.invoke(DelegatingMethodAcces
sorImpl\.java:25)

        at java\.lang\.reflect\.Method\.invoke(Method\.java:597)

        at
org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.
java:88)

        \.\.\. 5 more

Caused by: java\.lang\.RuntimeException: Error in configuring object

        at
org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.
java:93)

        at
org\.apache\.hadoop\.util\.ReflectionUtils\.setConf(ReflectionUtils\.jav
a:64)

        at
org\.apache\.hadoop\.util\.ReflectionUtils\.newInstance(ReflectionUtils\
.java:117)

        at
org\.apache\.hadoop\.mapred\.MapRunner\.configure(MapRunner\.java:34)

        \.\.\. 10 more

Caused by: java\.lang\.reflect\.InvocationTargetException

        at sun\.reflect\.NativeMethodAccessorImpl\.invoke0(Native
Method)

        at
sun\.reflect\.NativeMethodAccessorImpl\.invoke(NativeMethodAccessorImpl\
.java:39)

        at
sun\.reflect\.DelegatingMethodAccessorImpl\.invoke(DelegatingMethodAcces
sorImpl\.java:25)

        at java\.lang\.reflect\.Method\.invoke(Method\.java:597)

        at
org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.
java:88)

        \.\.\. 13 more

Caused by: java\.lang\.RuntimeException: configuration exception

        at
org\.apache\.hadoop\.streaming\.PipeMapRed\.configure(PipeMapRed\.java:1
82)

        at
org\.apache\.hadoop\.streaming\.PipeMapper\.configure(PipeMapper\.java:6
3)

        \.\.\. 18 more

Caused by: java\.io\.IOException: Cannot run program
\"/media/hd2/mapred/local/taskTracker/jobcache/job_201006110802_0016/att
empt_201006110802_0016_m_000001_3/work/\./SDMapper\":
java\.io\.IOException: error\=2, No such file or directory

        at java\.lang\.ProcessBuilder\.start(ProcessBuilder\.java:460)

        at
org\.apache\.hadoop\.streaming\.PipeMapRed\.configure(PipeMapRed\.java:1
66)

        \.\.\. 19 more

Caused by: java\.io\.IOException: java\.io\.IOException: error\=2, No
such file or directory

        at java\.lang\.UNIXProcess\.<init>(UNIXProcess\.java:148)

        at java\.lang\.ProcessImpl\.start(ProcessImpl\.java:65)

        at java\.lang\.ProcessBuilder\.start(ProcessBuilder\.java:453)

        \.\.\. 20 more

" .

Task TASKID="task_201006110802_0016_m_000001" TASK_TYPE="MAP"
TASK_STATUS="FAILED" FINISH_TIME="1276229600392"
ERROR="java\.lang\.RuntimeException: Error in configuring object

        at
org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.
java:93)

        at
org\.apache\.hadoop\.util\.ReflectionUtils\.setConf(ReflectionUtils\.jav
a:64)

        at
org\.apache\.hadoop\.util\.ReflectionUtils\.newInstance(ReflectionUtils\
.java:117)

        at
org\.apache\.hadoop\.mapred\.MapTask\.runOldMapper(MapTask\.java:354)

        at org\.apache\.hadoop\.mapred\.MapTask\.run(MapTask\.java:307)

        at org\.apache\.hadoop\.mapred\.Child\.main(Child\.java:170)

Caused by: java\.lang\.reflect\.InvocationTargetException

        at sun\.reflect\.NativeMethodAccessorImpl\.invoke0(Native
Method)

        at
sun\.reflect\.NativeMethodAccessorImpl\.invoke(NativeMethodAccessorImpl\
.java:39)

        at
sun\.reflect\.DelegatingMethodAccessorImpl\.invoke(DelegatingMethodAcces
sorImpl\.java:25)

        at java\.lang\.reflect\.Method\.invoke(Method\.java:597)

        at
org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.
java:88)

        \.\.\. 5 more

Caused by: java\.lang\.RuntimeException: Error in configuring object

        at
org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.
java:93)

        at
org\.apache\.hadoop\.util\.ReflectionUtils\.setConf(ReflectionUtils\.jav
a:64)

        at
org\.apache\.hadoop\.util\.ReflectionUtils\.newInstance(ReflectionUtils\
.java:117)

        at
org\.apache\.hadoop\.mapred\.MapRunner\.configure(MapRunner\.java:34)

        \.\.\. 10 more

Caused by: java\.lang\.reflect\.InvocationTargetException

        at sun\.reflect\.NativeMethodAccessorImpl\.invoke0(Native
Method)

        at
sun\.reflect\.NativeMethodAccessorImpl\.invoke(NativeMethodAccessorImpl\
.java:39)

        at
sun\.reflect\.DelegatingMethodAccessorImpl\.invoke(DelegatingMethodAcces
sorImpl\.java:25)

        at java\.lang\.reflect\.Method\.invoke(Method\.java:597)

        at
org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.
java:88)

        \.\.\. 13 more

Caused by: java\.lang\.RuntimeException: configuration exception

        at
org\.apache\.hadoop\.streaming\.PipeMapRed\.configure(PipeMapRed\.java:1
82)

        at
org\.apache\.hadoop\.streaming\.PipeMapper\.configure(PipeMapper\.java:6
3)

        \.\.\. 18 more

Caused by: java\.io\.IOException: Cannot run program
\"/media/hd2/mapred/local/taskTracker/jobcache/job_201006110802_0016/att
empt_201006110802_0016_m_000001_3/work/\./SDMapper\":
java\.io\.IOException: error\=2, No such file or directory

        at java\.lang\.ProcessBuilder\.start(ProcessBuilder\.java:460)

        at
org\.apache\.hadoop\.streaming\.PipeMapRed\.configure(PipeMapRed\.java:1
66)

        \.\.\. 19 more

Caused by: java\.io\.IOException: java\.io\.IOException: error\=2, No
such file or directory

        at java\.lang\.UNIXProcess\.<init>(UNIXProcess\.java:148)

        at java\.lang\.ProcessImpl\.start(ProcessImpl\.java:65)

        at java\.lang\.ProcessBuilder\.start(ProcessBuilder\.java:453)

        \.\.\. 20 more

" TASK_ATTEMPT_ID="" .

Task TASKID="task_201006110802_0016_m_000002" TASK_TYPE="CLEANUP"
START_TIME="1276258589119" SPLITS="" .

MapAttempt TASK_TYPE="CLEANUP" TASKID="task_201006110802_0016_m_000002"
TASK_ATTEMPT_ID="attempt_201006110802_0016_m_000002_0"
START_TIME="1276229602209"
TRACKER_NAME="tracker_hadoop19\.aj\.c2fse\.northgrum\.com:localhost/127\
.0\.0\.1:56345" HTTP_PORT="50060" .

MapAttempt TASK_TYPE="CLEANUP" TASKID="task_201006110802_0016_m_000002"
TASK_ATTEMPT_ID="attempt_201006110802_0016_m_000002_0"
TASK_STATUS="SUCCESS" FINISH_TIME="1276229602877"
HOSTNAME="/default-rack/hadoop19\.aj\.c2fse\.northgrum\.com"
STATE_STRING="cleanup"
COUNTERS="{(org\.apache\.hadoop\.mapred\.Task$Counter)(Map-Reduce
Framework)[(SPILLED_RECORDS)(Spilled Records)(0)]}" .

Task TASKID="task_201006110802_0016_m_000002" TASK_TYPE="CLEANUP"
TASK_STATUS="SUCCESS" FINISH_TIME="1276258592124"
COUNTERS="{(org\.apache\.hadoop\.mapred\.Task$Counter)(Map-Reduce
Framework)[(SPILLED_RECORDS)(Spilled Records)(0)]}" .

Job JOBID="job_201006110802_0016" FINISH_TIME="1276258592124"
JOB_STATUS="FAILED" FINISHED_MAPS="1" FINISHED_REDUCES="0" .

MAP LOG FILE OF FIRST RUN

eta VERSION="1" .

Job JOBID="job_201006110802_0013"
JOBNAME="streamjob1574130777925793571\.jar" USER="ngc"
SUBMIT_TIME="1276258509559"
JOBCONF="hdfs://hadoop1\.aj\.c2fse\.northgrum\.com:9000/tmp/hadoop-ngc/m
apred/system/job_201006110802_0013/job\.xml" .

Job JOBID="job_201006110802_0013" JOB_PRIORITY="NORMAL" .

Job JOBID="job_201006110802_0013" LAUNCH_TIME="1276258509729"
TOTAL_MAPS="2" TOTAL_REDUCES="1" JOB_STATUS="PREP" .

Task TASKID="task_201006110802_0013_m_000003" TASK_TYPE="SETUP"
START_TIME="1276258509836" SPLITS="" .

MapAttempt TASK_TYPE="SETUP" TASKID="task_201006110802_0013_m_000003"
TASK_ATTEMPT_ID="attempt_201006110802_0013_m_000003_0"
START_TIME="1276229873134"
TRACKER_NAME="tracker_hadoop6\.aj\.c2fse\.northgrum\.com:localhost/127\.
0\.0\.1:49372" HTTP_PORT="50060" .

MapAttempt TASK_TYPE="SETUP" TASKID="task_201006110802_0013_m_000003"
TASK_ATTEMPT_ID="attempt_201006110802_0013_m_000003_0"
TASK_STATUS="SUCCESS" FINISH_TIME="1276229873917"
HOSTNAME="/default-rack/hadoop6\.aj\.c2fse\.northgrum\.com"
STATE_STRING="setup"
COUNTERS="{(org\.apache\.hadoop\.mapred\.Task$Counter)(Map-Reduce
Framework)[(SPILLED_RECORDS)(Spilled Records)(0)]}" .

Task TASKID="task_201006110802_0013_m_000003" TASK_TYPE="SETUP"
TASK_STATUS="SUCCESS" FINISH_TIME="1276258512842"
COUNTERS="{(org\.apache\.hadoop\.mapred\.Task$Counter)(Map-Reduce
Framework)[(SPILLED_RECORDS)(Spilled Records)(0)]}" .

Job JOBID="job_201006110802_0013" JOB_STATUS="RUNNING" .

Task TASKID="task_201006110802_0013_m_000000" TASK_TYPE="MAP"
START_TIME="1276258512842"
SPLITS="/default-rack/hadoop20\.aj\.c2fse\.northgrum\.com,/default-rack/
hadoop17\.aj\.c2fse\.northgrum\.com" .

Task TASKID="task_201006110802_0013_m_000001" TASK_TYPE="MAP"
START_TIME="1276258512946"
SPLITS="/default-rack/hadoop20\.aj\.c2fse\.northgrum\.com,/default-rack/
hadoop17\.aj\.c2fse\.northgrum\.com" .

MapAttempt TASK_TYPE="MAP" TASKID="task_201006110802_0013_m_000000"
TASK_ATTEMPT_ID="attempt_201006110802_0013_m_000000_0"
START_TIME="1276229875959"
TRACKER_NAME="tracker_hadoop6\.aj\.c2fse\.northgrum\.com:localhost/127\.
0\.0\.1:49372" HTTP_PORT="50060" .

MapAttempt TASK_TYPE="MAP" TASKID="task_201006110802_0013_m_000000"
TASK_ATTEMPT_ID="attempt_201006110802_0013_m_000000_0"
TASK_STATUS="FAILED" FINISH_TIME="1276229880125"
HOSTNAME="hadoop6\.aj\.c2fse\.northgrum\.com"
ERROR="java\.lang\.RuntimeException: Error in configuring object

        at
org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.
java:93)

        at
org\.apache\.hadoop\.util\.ReflectionUtils\.setConf(ReflectionUtils\.jav
a:64)

        at
org\.apache\.hadoop\.util\.ReflectionUtils\.newInstance(ReflectionUtils\
.java:117)

        at
org\.apache\.hadoop\.mapred\.MapTask\.runOldMapper(MapTask\.java:354)

        at org\.apache\.hadoop\.mapred\.MapTask\.run(MapTask\.java:307)

        at org\.apache\.hadoop\.mapred\.Child\.main(Child\.java:170)

Caused by: java\.lang\.reflect\.InvocationTargetException

        at sun\.reflect\.NativeMethodAccessorImpl\.invoke0(Native
Method)

        at
sun\.reflect\.NativeMethodAccessorImpl\.invoke(NativeMethodAccessorImpl\
.java:39)

        at
sun\.reflect\.DelegatingMethodAccessorImpl\.invoke(DelegatingMethodAcces
sorImpl\.java:25)

        at java\.lang\.reflect\.Method\.invoke(Method\.java:597)

        at
org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.
java:88)

        \.\.\. 5 more

Caused by: java\.lang\.RuntimeException: Error in configuring object

        at
org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.
java:93)

        at
org\.apache\.hadoop\.util\.ReflectionUtils\.setConf(ReflectionUtils\.jav
a:64)

        at
org\.apache\.hadoop\.util\.ReflectionUtils\.newInstance(ReflectionUtils\
.java:117)

        at
org\.apache\.hadoop\.mapred\.MapRunner\.configure(MapRunner\.java:34)

        \.\.\. 10 more

Caused by: java\.lang\.reflect\.InvocationTargetException

        at sun\.reflect\.NativeMethodAccessorImpl\.invoke0(Native
Method)

        at
sun\.reflect\.NativeMethodAccessorImpl\.invoke(NativeMethodAccessorImpl\
.java:39)

        at
sun\.reflect\.DelegatingMethodAccessorImpl\.invoke(DelegatingMethodAcces
sorImpl\.java:25)

        at java\.lang\.reflect\.Method\.invoke(Method\.java:597)

        at
org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.
java:88)

        \.\.\. 13 more

Caused by: java\.lang\.RuntimeException: configuration exception

        at
org\.apache\.hadoop\.streaming\.PipeMapRed\.configure(PipeMapRed\.java:1
82)

        at
org\.apache\.hadoop\.streaming\.PipeMapper\.configure(PipeMapper\.java:6
3)

        \.\.\. 18 more

Caused by: java\.io\.IOException: Cannot run program
\"/tmp/hadoop-ngc/mapred/local/taskTracker/jobcache/job_201006110802_001
3/attempt_201006110802_0013_m_000000_0/work/\./SDMapper\":
java\.io\.IOException: error\=2, No such file or directory

        at java\.lang\.ProcessBuilder\.start(ProcessBuilder\.java:460)

        at
org\.apache\.hadoop\.streaming\.PipeMapRed\.configure(PipeMapRed\.java:1
66)

        \.\.\. 19 more

Caused by: java\.io\.IOException: java\.io\.IOException: error\=2, No
such file or directory

        at java\.lang\.UNIXProcess\.<init>(UNIXProcess\.java:148)

        at java\.lang\.ProcessImpl\.start(ProcessImpl\.java:65)

        at java\.lang\.ProcessBuilder\.start(ProcessBuilder\.java:453)

        \.\.\. 20 more

" .

MapAttempt TASK_TYPE="MAP" TASKID="task_201006110802_0013_m_000001"
TASK_ATTEMPT_ID="attempt_201006110802_0013_m_000001_0"
START_TIME="1276229951632"
TRACKER_NAME="tracker_hadoop3\.aj\.c2fse\.northgrum\.com:localhost/127\.
0\.0\.1:34294" HTTP_PORT="50060" .

MapAttempt TASK_TYPE="MAP" TASKID="task_201006110802_0013_m_000001"
TASK_ATTEMPT_ID="attempt_201006110802_0013_m_000001_0"
TASK_STATUS="FAILED" FINISH_TIME="1276229955681"
HOSTNAME="hadoop3\.aj\.c2fse\.northgrum\.com"
ERROR="java\.lang\.RuntimeException: Error in configuring object

        at
org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.
java:93)

        at
org\.apache\.hadoop\.util\.ReflectionUtils\.setConf(ReflectionUtils\.jav
a:64)

        at
org\.apache\.hadoop\.util\.ReflectionUtils\.newInstance(ReflectionUtils\
.java:117)

        at
org\.apache\.hadoop\.mapred\.MapTask\.runOldMapper(MapTask\.java:354)

        at org\.apache\.hadoop\.mapred\.MapTask\.run(MapTask\.java:307)

        at org\.apache\.hadoop\.mapred\.Child\.main(Child\.java:170)

Caused by: java\.lang\.reflect\.InvocationTargetException

        at sun\.reflect\.NativeMethodAccessorImpl\.invoke0(Native
Method)

        at
sun\.reflect\.NativeMethodAccessorImpl\.invoke(NativeMethodAccessorImpl\
.java:39)

        at
sun\.reflect\.DelegatingMethodAccessorImpl\.invoke(DelegatingMethodAcces
sorImpl\.java:25)

        at java\.lang\.reflect\.Method\.invoke(Method\.java:597)

        at
org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.
java:88)

        \.\.\. 5 more

Caused by: java\.lang\.RuntimeException: Error in configuring object

        at
org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.
java:93)

        at
org\.apache\.hadoop\.util\.ReflectionUtils\.setConf(ReflectionUtils\.jav
a:64)

        at
org\.apache\.hadoop\.util\.ReflectionUtils\.newInstance(ReflectionUtils\
.java:117)

        at
org\.apache\.hadoop\.mapred\.MapRunner\.configure(MapRunner\.java:34)

        \.\.\. 10 more

Caused by: java\.lang\.reflect\.InvocationTargetException

        at sun\.reflect\.NativeMethodAccessorImpl\.invoke0(Native
Method)

        at
sun\.reflect\.NativeMethodAccessorImpl\.invoke(NativeMethodAccessorImpl\
.java:39)

        at
sun\.reflect\.DelegatingMethodAccessorImpl\.invoke(DelegatingMethodAcces
sorImpl\.java:25)

        at java\.lang\.reflect\.Method\.invoke(Method\.java:597)

        at
org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.
java:88)

        \.\.\. 13 more

Caused by: java\.lang\.RuntimeException: configuration exception

        at
org\.apache\.hadoop\.streaming\.PipeMapRed\.configure(PipeMapRed\.java:1
82)

        at
org\.apache\.hadoop\.streaming\.PipeMapper\.configure(PipeMapper\.java:6
3)

        \.\.\. 18 more

Caused by: java\.io\.IOException: Cannot run program
\"/media/hd4/mapred/local/taskTracker/jobcache/job_201006110802_0013/att
empt_201006110802_0013_m_000001_0/work/\./SDMapper\":
java\.io\.IOException: error\=2, No such file or directory

        at java\.lang\.ProcessBuilder\.start(ProcessBuilder\.java:460)

        at
org\.apache\.hadoop\.streaming\.PipeMapRed\.configure(PipeMapRed\.java:1
66)

        \.\.\. 19 more

Caused by: java\.io\.IOException: java\.io\.IOException: error\=2, No
such file or directory

        at java\.lang\.UNIXProcess\.<init>(UNIXProcess\.java:148)

        at java\.lang\.ProcessImpl\.start(ProcessImpl\.java:65)

        at java\.lang\.ProcessBuilder\.start(ProcessBuilder\.java:453)

        \.\.\. 20 more

" .

MapAttempt TASK_TYPE="MAP" TASKID="task_201006110802_0013_m_000001"
TASK_ATTEMPT_ID="attempt_201006110802_0013_m_000001_1"
START_TIME="1276229716711"
TRACKER_NAME="tracker_hadoop2\.aj\.c2fse\.northgrum\.com:localhost/127\.
0\.0\.1:51829" HTTP_PORT="50060" .

MapAttempt TASK_TYPE="MAP" TASKID="task_201006110802_0013_m_000001"
TASK_ATTEMPT_ID="attempt_201006110802_0013_m_000001_1"
TASK_STATUS="SUCCESS" FINISH_TIME="1276229717868"
HOSTNAME="/default-rack/hadoop2\.aj\.c2fse\.northgrum\.com"
STATE_STRING="hdfs://hadoop1\.aj\.c2fse\.northgrum\.com:9000/user/ngc/Im
ageList/imagelist:9+9"
COUNTERS="{(FileSystemCounters)(FileSystemCounters)[(HDFS_BYTES_READ)(HD
FS_BYTES_READ)(10)][(FILE_BYTES_WRITTEN)(FILE_BYTES_WRITTEN)(38)]}{(org\
.apache\.hadoop\.mapred\.Task$Counter)(Map-Reduce
Framework)[(COMBINE_OUTPUT_RECORDS)(Combine output
records)(0)][(MAP_INPUT_RECORDS)(Map input
records)(0)][(SPILLED_RECORDS)(Spilled
Records)(0)][(MAP_OUTPUT_BYTES)(Map output
bytes)(0)][(MAP_INPUT_BYTES)(Map input
bytes)(0)][(COMBINE_INPUT_RECORDS)(Combine input
records)(0)][(MAP_OUTPUT_RECORDS)(Map output records)(0)]}" .

Task TASKID="task_201006110802_0013_m_000001" TASK_TYPE="MAP"
TASK_STATUS="SUCCESS" FINISH_TIME="1276258522269"
COUNTERS="{(FileSystemCounters)(FileSystemCounters)[(HDFS_BYTES_READ)(HD
FS_BYTES_READ)(10)][(FILE_BYTES_WRITTEN)(FILE_BYTES_WRITTEN)(38)]}{(org\
.apache\.hadoop\.mapred\.Task$Counter)(Map-Reduce
Framework)[(COMBINE_OUTPUT_RECORDS)(Combine output
records)(0)][(MAP_INPUT_RECORDS)(Map input
records)(0)][(SPILLED_RECORDS)(Spilled
Records)(0)][(MAP_OUTPUT_BYTES)(Map output
bytes)(0)][(MAP_INPUT_BYTES)(Map input
bytes)(0)][(COMBINE_INPUT_RECORDS)(Combine input
records)(0)][(MAP_OUTPUT_RECORDS)(Map output records)(0)]}" .

Task TASKID="task_201006110802_0013_r_000000" TASK_TYPE="REDUCE"
START_TIME="1276258522270" SPLITS="" .

MapAttempt TASK_TYPE="MAP" TASKID="task_201006110802_0013_m_000000"
TASK_ATTEMPT_ID="attempt_201006110802_0013_m_000000_1"
START_TIME="1276229957552"
TRACKER_NAME="tracker_hadoop3\.aj\.c2fse\.northgrum\.com:localhost/127\.
0\.0\.1:34294" HTTP_PORT="50060" .

MapAttempt TASK_TYPE="MAP" TASKID="task_201006110802_0013_m_000000"
TASK_ATTEMPT_ID="attempt_201006110802_0013_m_000000_1"
TASK_STATUS="FAILED" FINISH_TIME="1276229961598"
HOSTNAME="hadoop3\.aj\.c2fse\.northgrum\.com"
ERROR="java\.lang\.RuntimeException: Error in configuring object

        at
org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.
java:93)

        at
org\.apache\.hadoop\.util\.ReflectionUtils\.setConf(ReflectionUtils\.jav
a:64)

        at
org\.apache\.hadoop\.util\.ReflectionUtils\.newInstance(ReflectionUtils\
.java:117)

        at
org\.apache\.hadoop\.mapred\.MapTask\.runOldMapper(MapTask\.java:354)

        at org\.apache\.hadoop\.mapred\.MapTask\.run(MapTask\.java:307)

        at org\.apache\.hadoop\.mapred\.Child\.main(Child\.java:170)

Caused by: java\.lang\.reflect\.InvocationTargetException

        at sun\.reflect\.NativeMethodAccessorImpl\.invoke0(Native
Method)

        at
sun\.reflect\.NativeMethodAccessorImpl\.invoke(NativeMethodAccessorImpl\
.java:39)

        at
sun\.reflect\.DelegatingMethodAccessorImpl\.invoke(DelegatingMethodAcces
sorImpl\.java:25)

        at java\.lang\.reflect\.Method\.invoke(Method\.java:597)

        at
org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.
java:88)

        \.\.\. 5 more

Caused by: java\.lang\.RuntimeException: Error in configuring object

        at
org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.
java:93)

        at
org\.apache\.hadoop\.util\.ReflectionUtils\.setConf(ReflectionUtils\.jav
a:64)

        at
org\.apache\.hadoop\.util\.ReflectionUtils\.newInstance(ReflectionUtils\
.java:117)

        at
org\.apache\.hadoop\.mapred\.MapRunner\.configure(MapRunner\.java:34)

        \.\.\. 10 more

Caused by: java\.lang\.reflect\.InvocationTargetException

        at sun\.reflect\.NativeMethodAccessorImpl\.invoke0(Native
Method)

        at
sun\.reflect\.NativeMethodAccessorImpl\.invoke(NativeMethodAccessorImpl\
.java:39)

        at
sun\.reflect\.DelegatingMethodAccessorImpl\.invoke(DelegatingMethodAcces
sorImpl\.java:25)

        at java\.lang\.reflect\.Method\.invoke(Method\.java:597)

        at
org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.
java:88)

        \.\.\. 13 more

Caused by: java\.lang\.RuntimeException: configuration exception

        at
org\.apache\.hadoop\.streaming\.PipeMapRed\.configure(PipeMapRed\.java:1
82)

        at
org\.apache\.hadoop\.streaming\.PipeMapper\.configure(PipeMapper\.java:6
3)

        \.\.\. 18 more

Caused by: java\.io\.IOException: Cannot run program
\"/media/hd3/mapred/local/taskTracker/jobcache/job_201006110802_0013/att
empt_201006110802_0013_m_000000_1/work/\./SDMapper\":
java\.io\.IOException: error\=2, No such file or directory

        at java\.lang\.ProcessBuilder\.start(ProcessBuilder\.java:460)

        at
org\.apache\.hadoop\.streaming\.PipeMapRed\.configure(PipeMapRed\.java:1
66)

        \.\.\. 19 more

Caused by: java\.io\.IOException: java\.io\.IOException: error\=2, No
such file or directory

        at java\.lang\.UNIXProcess\.<init>(UNIXProcess\.java:148)

        at java\.lang\.ProcessImpl\.start(ProcessImpl\.java:65)

        at java\.lang\.ProcessBuilder\.start(ProcessBuilder\.java:453)

        \.\.\. 20 more

" .

MapAttempt TASK_TYPE="MAP" TASKID="task_201006110802_0013_m_000000"
TASK_ATTEMPT_ID="attempt_201006110802_0013_m_000000_2"
START_TIME="1276229722583"
TRACKER_NAME="tracker_hadoop2\.aj\.c2fse\.northgrum\.com:localhost/127\.
0\.0\.1:51829" HTTP_PORT="50060" .

MapAttempt TASK_TYPE="MAP" TASKID="task_201006110802_0013_m_000000"
TASK_ATTEMPT_ID="attempt_201006110802_0013_m_000000_2"
TASK_STATUS="SUCCESS" FINISH_TIME="1276229723735"
HOSTNAME="/default-rack/hadoop2\.aj\.c2fse\.northgrum\.com"
STATE_STRING="Records R/W\=1/1"
COUNTERS="{(FileSystemCounters)(FileSystemCounters)[(HDFS_BYTES_READ)(HD
FS_BYTES_READ)(18)][(FILE_BYTES_WRITTEN)(FILE_BYTES_WRITTEN)(94)]}{(org\
.apache\.hadoop\.mapred\.Task$Counter)(Map-Reduce
Framework)[(COMBINE_OUTPUT_RECORDS)(Combine output
records)(0)][(MAP_INPUT_RECORDS)(Map input
records)(1)][(SPILLED_RECORDS)(Spilled
Records)(1)][(MAP_OUTPUT_BYTES)(Map output
bytes)(54)][(MAP_INPUT_BYTES)(Map input
bytes)(18)][(COMBINE_INPUT_RECORDS)(Combine input
records)(0)][(MAP_OUTPUT_RECORDS)(Map output records)(1)]}" .

Task TASKID="task_201006110802_0013_m_000000" TASK_TYPE="MAP"
TASK_STATUS="SUCCESS" FINISH_TIME="1276258528279"
COUNTERS="{(FileSystemCounters)(FileSystemCounters)[(HDFS_BYTES_READ)(HD
FS_BYTES_READ)(18)][(FILE_BYTES_WRITTEN)(FILE_BYTES_WRITTEN)(94)]}{(org\
.apache\.hadoop\.mapred\.Task$Counter)(Map-Reduce
Framework)[(COMBINE_OUTPUT_RECORDS)(Combine output
records)(0)][(MAP_INPUT_RECORDS)(Map input
records)(1)][(SPILLED_RECORDS)(Spilled
Records)(1)][(MAP_OUTPUT_BYTES)(Map output
bytes)(54)][(MAP_INPUT_BYTES)(Map input
bytes)(18)][(COMBINE_INPUT_RECORDS)(Combine input
records)(0)][(MAP_OUTPUT_RECORDS)(Map output records)(1)]}" .

ReduceAttempt TASK_TYPE="REDUCE"
TASKID="task_201006110802_0013_r_000000"
TASK_ATTEMPT_ID="attempt_201006110802_0013_r_000000_0"
START_TIME="1276229719549"
TRACKER_NAME="tracker_hadoop2\.aj\.c2fse\.northgrum\.com:localhost/127\.
0\.0\.1:51829" HTTP_PORT="50060" .

ReduceAttempt TASK_TYPE="REDUCE"
TASKID="task_201006110802_0013_r_000000"
TASK_ATTEMPT_ID="attempt_201006110802_0013_r_000000_0"
TASK_STATUS="SUCCESS" SHUFFLE_FINISHED="1276229731481"
SORT_FINISHED="1276229731538" FINISH_TIME="1276229734818"
HOSTNAME="/default-rack/hadoop2\.aj\.c2fse\.northgrum\.com"
STATE_STRING="Records R/W\=1/1 > reduce"
COUNTERS="{(FileSystemCounters)(FileSystemCounters)[(FILE_BYTES_READ)(FI
LE_BYTES_READ)(62)][(FILE_BYTES_WRITTEN)(FILE_BYTES_WRITTEN)(62)][(HDFS_
BYTES_WRITTEN)(HDFS_BYTES_WRITTEN)(63)]}{(org\.apache\.hadoop\.mapred\.T
ask$Counter)(Map-Reduce Framework)[(REDUCE_INPUT_GROUPS)(Reduce input
groups)(1)][(COMBINE_OUTPUT_RECORDS)(Combine output
records)(0)][(REDUCE_SHUFFLE_BYTES)(Reduce shuffle
bytes)(6)][(REDUCE_OUTPUT_RECORDS)(Reduce output
records)(2)][(SPILLED_RECORDS)(Spilled
Records)(1)][(COMBINE_INPUT_RECORDS)(Combine input
records)(0)][(REDUCE_INPUT_RECORDS)(Reduce input records)(1)]}" .

Task TASKID="task_201006110802_0013_r_000000" TASK_TYPE="REDUCE"
TASK_STATUS="SUCCESS" FINISH_TIME="1276258540288"
COUNTERS="{(FileSystemCounters)(FileSystemCounters)[(FILE_BYTES_READ)(FI
LE_BYTES_READ)(62)][(FILE_BYTES_WRITTEN)(FILE_BYTES_WRITTEN)(62)][(HDFS_
BYTES_WRITTEN)(HDFS_BYTES_WRITTEN)(63)]}{(org\.apache\.hadoop\.mapred\.T
ask$Counter)(Map-Reduce Framework)[(REDUCE_INPUT_GROUPS)(Reduce input
groups)(1)][(COMBINE_OUTPUT_RECORDS)(Combine output
records)(0)][(REDUCE_SHUFFLE_BYTES)(Reduce shuffle
bytes)(6)][(REDUCE_OUTPUT_RECORDS)(Reduce output
records)(2)][(SPILLED_RECORDS)(Spilled
Records)(1)][(COMBINE_INPUT_RECORDS)(Combine input
records)(0)][(REDUCE_INPUT_RECORDS)(Reduce input records)(1)]}" .

Task TASKID="task_201006110802_0013_m_000002" TASK_TYPE="CLEANUP"
START_TIME="1276258540289" SPLITS="" .

MapAttempt TASK_TYPE="CLEANUP" TASKID="task_201006110802_0013_m_000002"
TASK_ATTEMPT_ID="attempt_201006110802_0013_m_000002_0"
START_TIME="1276229737575"
TRACKER_NAME="tracker_hadoop2\.aj\.c2fse\.northgrum\.com:localhost/127\.
0\.0\.1:51829" HTTP_PORT="50060" .

MapAttempt TASK_TYPE="CLEANUP" TASKID="task_201006110802_0013_m_000002"
TASK_ATTEMPT_ID="attempt_201006110802_0013_m_000002_0"
TASK_STATUS="SUCCESS" FINISH_TIME="1276229738283"
HOSTNAME="/default-rack/hadoop2\.aj\.c2fse\.northgrum\.com"
STATE_STRING="cleanup"
COUNTERS="{(org\.apache\.hadoop\.mapred\.Task$Counter)(Map-Reduce
Framework)[(SPILLED_RECORDS)(Spilled Records)(0)]}" .

Task TASKID="task_201006110802_0013_m_000002" TASK_TYPE="CLEANUP"
TASK_STATUS="SUCCESS" FINISH_TIME="1276258543294"
COUNTERS="{(org\.apache\.hadoop\.mapred\.Task$Counter)(Map-Reduce
Framework)[(SPILLED_RECORDS)(Spilled Records)(0)]}" .

Job JOBID="job_201006110802_0013" FINISH_TIME="1276258543294"
JOB_STATUS="SUCCESS" FINISHED_MAPS="2" FINISHED_REDUCES="1"
FAILED_MAPS="3" FAILED_REDUCES="0"
COUNTERS="{(org\.apache\.hadoop\.mapred\.JobInProgress$Counter)(Job
Counters )[(TOTAL_LAUNCHED_REDUCES)(Launched reduce
tasks)(1)][(RACK_LOCAL_MAPS)(Rack-local map
tasks)(5)][(TOTAL_LAUNCHED_MAPS)(Launched map
tasks)(5)]}{(FileSystemCounters)(FileSystemCounters)[(FILE_BYTES_READ)(F
ILE_BYTES_READ)(62)][(HDFS_BYTES_READ)(HDFS_BYTES_READ)(28)][(FILE_BYTES
_WRITTEN)(FILE_BYTES_WRITTEN)(194)][(HDFS_BYTES_WRITTEN)(HDFS_BYTES_WRIT
TEN)(63)]}{(org\.apache\.hadoop\.mapred\.Task$Counter)(Map-Reduce
Framework)[(REDUCE_INPUT_GROUPS)(Reduce input
groups)(1)][(COMBINE_OUTPUT_RECORDS)(Combine output
records)(0)][(MAP_INPUT_RECORDS)(Map input
records)(1)][(REDUCE_SHUFFLE_BYTES)(Reduce shuffle
bytes)(6)][(REDUCE_OUTPUT_RECORDS)(Reduce output
records)(2)][(SPILLED_RECORDS)(Spilled
Records)(2)][(MAP_OUTPUT_BYTES)(Map output
bytes)(54)][(MAP_INPUT_BYTES)(Map input
bytes)(18)][(MAP_OUTPUT_RECORDS)(Map output
records)(1)][(COMBINE_INPUT_RECORDS)(Combine input
records)(0)][(REDUCE_INPUT_RECORDS)(Reduce input records)(1)]}" .


Mime
View raw message