hadoop-mapreduce-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "JasonZhu (JIRA)" <j...@apache.org>
Subject [jira] [Created] (MAPREDUCE-6159) No log of JobHistory found in every logs.
Date Wed, 12 Nov 2014 08:15:34 GMT
JasonZhu created MAPREDUCE-6159:

             Summary: No log of JobHistory found in every logs.
                 Key: MAPREDUCE-6159
                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6159
             Project: Hadoop Map/Reduce
          Issue Type: Bug
          Components: jobhistoryserver, mrv2
    Affects Versions: 2.2.0
         Environment: Hadoop-2.2.0

            Reporter: JasonZhu

I intend to dig into 'mapreduce.jobhistory.intermediate-done-dir' argument, the position of
which is at `JHAdminConfig:73`, to get some comprehension on history server. This argument
is referenced at `JobHistoryEventHandler.moveToDoneNow()`, where history server moves job
summary file from "${yarn.app.mapreduce.am.staging-dir}/${user}/.staging" to "${mapreduce.jobhistory.intermediate-done-dir}/${user}".

Since the following code snippet in `moveToDoneNow()` will definitely write some logs out
to log file, but I can found no any sign of it in all logs in $HADOOP_LOG_DIR via command
`grep "Copied to done location" *`.
    if (copied)
        LOG.info("Copied to done location: " + toPath);
        LOG.info("copy failed");

Is there anything that I missed?

This message was sent by Atlassian JIRA

View raw message