hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ashish Venugopal" <...@andrew.cmu.edu>
Subject tracking down mapper error
Date Thu, 24 Apr 2008 03:14:09 GMT
Hi, I am trying to track down a mapper error run as a streaming hod
job. I downloaded the log files of my job from:

/user/hod/logs/ashishv/6035/*.gz

When I look at the region near the error, I dont see any STDERR output
indicating that an error occurred.

I do however see:

008-04-23 19:35:09,851 INFO org.apache.hadoop.streaming.PipeMapRed: R/W/S=1/0/0
in:NA [rec/s] out:NA [rec/s]
2008-04-23 19:35:09,857 INFO org.apache.hadoop.streaming.PipeMapRed:
mapRedFinished
2008-04-23 19:42:56,097 INFO org.apache.hadoop.streaming.PipeMapRed: Records
R/W=9/1
2008-04-23 19:43:23,848 INFO org.apache.hadoop.streaming.PipeMapRed:
MRErrorThread done
2008-04-23 19:43:23,848 INFO org.apache.hadoop.streaming.PipeMapRed:
MROutputThread done
2008-04-23 19:43:23,848 INFO org.apache.hadoop.streaming.PipeMapRed:
PipeMapRed.waitOutputThreads(): subprocess failed with code 14
1 in org.apache.hadoop.streaming.PipeMapRed
2008-04-23 19:43:24,015 INFO org.apache.hadoop.mapred.TaskRunner: Task
'task_200804231934_0001_m_000009_0' done.

What is code 14? Is this useful to debugging the problem?

Below is this error is context:



...^@^@^@userlogs/task_200804231934_0001_m_000009_0/syslog

008-04-23 19:35:09,354 WARN org.apache.hadoop.conf.Configuration:
hadoop-site.xml:a attempt to override
final parameter: mapred.reduce.parallel.copies;  Ignoring.
2008-04-23 19:35:09,463 WARN org.apache.hadoop.conf.Configuration:
hadoop-site.xml:a attempt to override final parameter: mapred.re
duce.parallel.copies;  Ignoring.
2008-04-23 19:35:09,475 WARN org.apache.hadoop.conf.Configuration:
/grid/0/kryptonite/hod/tmps/2/grit1247.yahooresearchcluster.com-
29207-3262465680115619/mapred-tt/mapred-local/taskTracker/jobcache/job_200804231934_0001/task_200804231934_0001_m_000009_0/job.xml:
a attempt to override final parameter: mapred.job.tracker.info.port;  Ignoring.
2008-04-23 19:35:09,476 WARN org.apache.hadoop.conf.Configuration:
/grid/0/kryptonite/hod/tmps/2/grit1247.yahooresearchcluster.com-
29207-3262465680115619/mapred-tt/mapred-local/taskTracker/jobcache/job_200804231934_0001/task_200804231934_0001_m_000009_0/job.xml:
a attempt to override final parameter: mapred.reduce.parallel.copies;
Ignoring.
2008-04-23 19:35:09,477 WARN org.apache.hadoop.conf.Configuration:
/grid/0/kryptonite/hod/tmps/2/grit1247.yahooresearchcluster.com-
29207-3262465680115619/mapred-tt/mapred-local/taskTracker/jobcache/job_200804231934_0001/task_200804231934_0001_m_000009_0/job.xml:
a attempt to override final parameter: fs.default.name;  Ignoring.
2008-04-23 19:35:09,477 WARN org.apache.hadoop.conf.Configuration:
/grid/0/kryptonite/hod/tmps/2/grit1247.yahooresearchcluster.com-
29207-3262465680115619/mapred-tt/mapred-local/taskTracker/jobcache/job_200804231934_0001/task_200804231934_0001_m_000009_0/job.xml:
a attempt to override final parameter: dfs.client.buffer.dir;  Ignoring.
2008-04-23 19:35:09,478 WARN org.apache.hadoop.conf.Configuration:
/grid/0/kryptonite/hod/tmps/2/grit1247.yahooresearchcluster.com-
29207-3262465680115619/mapred-tt/mapred-local/taskTracker/jobcache/job_200804231934_0001/task_200804231934_0001_m_000009_0/job.xml:
a attempt to override final parameter: mapred.job.tracker;  Ignoring.
2008-04-23 19:35:09,478 WARN org.apache.hadoop.conf.Configuration:
/grid/0/kryptonite/hod/tmps/2/grit1247.yahooresearchcluster.com-
29207-3262465680115619/mapred-tt/mapred-local/taskTracker/jobcache/job_200804231934_0001/task_200804231934_0001_m_000009_0/job.xml:
a attempt to override final parameter: mapred.local.dir;  Ignoring.
2008-04-23 19:35:09,479 WARN org.apache.hadoop.conf.Configuration:
/grid/0/kryptonite/hod/tmps/2/grit1247.yahooresearchcluster.com-
29207-3262465680115619/mapred-tt/mapred-local/taskTracker/jobcache/job_200804231934_0001/task_200804231934_0001_m_000009_0/job.xml:
a attempt to override final parameter: mapred.temp.dir;  Ignoring.
2008-04-23 19:35:09,479 WARN org.apache.hadoop.conf.Configuration:
/grid/0/kryptonite/hod/tmps/2/grit1247.yahooresearchcluster.com-
29207-3262465680115619/mapred-tt/mapred-local/taskTracker/jobcache/job_200804231934_0001/task_200804231934_0001_m_000009_0/job.xml:
a attempt to override final parameter: mapred.system.dir;  Ignoring.
2008-04-23 19:35:09,483 INFO org.apache.hadoop.metrics.jvm.JvmMetrics:
Initializing JVM Metrics with processName=MAP, sessionId=
2008-04-23 19:35:09,723 INFO org.apache.hadoop.mapred.MapTask: numReduceTasks:
1
2008-04-23 19:35:09,791 INFO org.apache.hadoop.streaming.PipeMapRed: PipeMapRed
exec [/grid/1/tmp/grit1247.yahooresearchcluster.com
-29207-3262465680115619/mapred-tt/mapred-local/taskTracker/jobcache/job_200804231934_0001/work/FastTranslateChart,
--mapreduce_inpu
t, true, --NumReferences, 7, --RuleSetDir,
hdfs:/user/ashishv/iwslt/test1/filter_rules_dev, --RuleSetPrefix, rule,
--LMFiles, lm.en
.5gram.srilm, --NormalizingScript, ./punctuation-postprocess-eval4_bin,
--RecomputeLMCostsDuringNBest, 1, --RescoreLM, 0, --SRIHist
oryLength, 4, --HistoryLength, 2, --MEROptimize, 0, --PruningMap,
0-100-7-@_S-200-7, --ComboPruningBeamSize, 10000, --ComboPruningF
uzzCostDifference, 2, --MaxCostDifferencePerCell, inf, --MaxCombinationCount,
10, --NBest, 2000, --HypsPerNode, 1000, --RemoveUnt,
0, --MaxRuleAppCountDifference, 5, --RA_Mult, 0, --RA_UpdateHyp, 1,
--RA_LowestCount, 0, --NBestSubSpans, 0, --v, 0, --TagSetList,
@_dummy, --ScoringMetric, IBMBLEU, --DisplayNBestData, 2000,
--CompareTargetWords, 1, --NBestStyle, 2, --ExtractUnique, 1, --Prunin
gMapUseBoundary, 1, --FeatureWeightsParsing,
0.0209398_0.0233861_2.1456e-05_-0.0100184_0.00216776_-0.000383287_0_0.00178281_0_0.007
31606_-0.00307071_1.65476_0_0.00149819_0.0125884_0.00380715_0.0018003_0.0107588_0_-0.036329_0.00201955_0.00719299_0_0.000755101]
2008-04-23 19:35:09,851 INFO org.apache.hadoop.streaming.PipeMapRed:
R/W/S=1/0/0 in:NA [rec/s] out:NA [rec/s]
008-04-23 19:35:09,851 INFO org.apache.hadoop.streaming.PipeMapRed: R/W/S=1/0/0
in:NA [rec/s] out:NA [rec/s]
2008-04-23 19:35:09,857 INFO org.apache.hadoop.streaming.PipeMapRed:
mapRedFinished
2008-04-23 19:42:56,097 INFO org.apache.hadoop.streaming.PipeMapRed: Records
R/W=9/1
2008-04-23 19:43:23,848 INFO org.apache.hadoop.streaming.PipeMapRed:
MRErrorThread done
2008-04-23 19:43:23,848 INFO org.apache.hadoop.streaming.PipeMapRed:
MROutputThread done
2008-04-23 19:43:23,848 INFO org.apache.hadoop.streaming.PipeMapRed:
PipeMapRed.waitOutputThreads(): subprocess failed with code 14
1 in org.apache.hadoop.streaming.PipeMapRed
2008-04-23 19:43:24,015 INFO org.apache.hadoop.mapred.TaskRunner: Task
'task_200804231934_0001_m_000009_0' done.

Mime
View raw message