hadoop-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From jamal sasha <jamalsha...@gmail.com>
Subject viewing log messages from mapper and reducer.
Date Wed, 16 Jan 2013 21:10:25 GMT
   I am trying to run the following example:
Except in the mapper and reduce class I am logging via
import org.apache.log4j.Logger;

In the WordCount class I add the follwoing line
private static final Logger LOG = Logger.getLogger(WordCount.class);

and then in the map and reduce methods
I add LOG.info("mapper");

But those are not outputed in the console (I am running on pseudo
distributed mode)
In the userlogs directory there are four folders
log.index  stderr  stdout  syslog

In syslog, I have
2013-01-16 10:09:14,230 INFO org.apache.hadoop.util.NativeCodeLoader:
Loaded the native-hadoop library
2013-01-16 10:09:14,353 WARN
org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Source name ugi already
2013-01-16 10:09:14,414 INFO org.apache.hadoop.util.ProcessTree: setsid
exited with exit code 0
2013-01-16 10:09:14,418 INFO org.apache.hadoop.mapred.Task:  Using
ResourceCalculatorPlugin :
2013-01-16 10:09:14,489 INFO org.apache.hadoop.mapred.Task:
Task:attempt_201301021121_0131_m_000003_0 is done. And is in the process of
2013-01-16 10:09:17,411 INFO org.apache.hadoop.mapred.Task: Task
'attempt_201301021121_0131_m_000003_0' done.
2013-01-16 10:09:17,433 INFO org.apache.hadoop.mapred.TaskLogsTruncater:
Initializing logs' truncater with mapRetainSize=-1 and reduceRetainSize=-1
2013-01-16 10:09:17,455 INFO org.apache.hadoop.io.nativeio.NativeIO:
Initialized cache for UID to User mapping with a cache timeout of 14400
2013-01-16 10:09:17,456 INFO org.apache.hadoop.io.nativeio.NativeIO: Got
UserName mhduser for UID 1003 from the native implementation

Rest of the files are empty.. (except log.index)
Where is the logs being saved?

View raw message