hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "JasonZhu (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (MAPREDUCE-6159) No log of JobHistory found in every logs.
Date Wed, 12 Nov 2014 08:19:34 GMT

     [ https://issues.apache.org/jira/browse/MAPREDUCE-6159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

JasonZhu updated MAPREDUCE-6159:
--------------------------------
    Description: 
I intend to dig into 'mapreduce.jobhistory.intermediate-done-dir' argument, the position of
which is at `JHAdminConfig:73`, to get some comprehension on history server. This argument
is referenced at `JobHistoryEventHandler.moveToDoneNow()`, where history server moves job
summary file 
from "$[yarn.app.mapreduce.am.staging-dir]/$[user]/.staging" to "$[mapreduce.jobhistory.intermediate-done-dir]/$[user]".


Since the following code snippet in `moveToDoneNow()` will definitely write some logs out
to log file, but I can found no any sign of it in all logs in $HADOOP_LOG_DIR via command
`grep "Copied to done location" *`.
    if (copied)
        LOG.info("Copied to done location: " + toPath);
    else 
        LOG.info("copy failed");

Is there anything that I missed?

  was:
I intend to dig into 'mapreduce.jobhistory.intermediate-done-dir' argument, the position of
which is at `JHAdminConfig:73`, to get some comprehension on history server. This argument
is referenced at `JobHistoryEventHandler.moveToDoneNow()`, where history server moves job
summary file 
from 
"$[yarn.app.mapreduce.am.staging-dir]/$[user]/.staging" 
to 
"$[mapreduce.jobhistory.intermediate-done-dir]/$[user]". 

Since the following code snippet in `moveToDoneNow()` will definitely write some logs out
to log file, but I can found no any sign of it in all logs in $HADOOP_LOG_DIR via command
`grep "Copied to done location" *`.
    if (copied)
        LOG.info("Copied to done location: " + toPath);
    else 
        LOG.info("copy failed");

Is there anything that I missed?


> No log of JobHistory found in every logs.
> -----------------------------------------
>
>                 Key: MAPREDUCE-6159
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6159
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: jobhistoryserver, mrv2
>    Affects Versions: 2.2.0
>         Environment: Hadoop-2.2.0
>            Reporter: JasonZhu
>
> I intend to dig into 'mapreduce.jobhistory.intermediate-done-dir' argument, the position
of which is at `JHAdminConfig:73`, to get some comprehension on history server. This argument
is referenced at `JobHistoryEventHandler.moveToDoneNow()`, where history server moves job
summary file 
> from "$[yarn.app.mapreduce.am.staging-dir]/$[user]/.staging" to "$[mapreduce.jobhistory.intermediate-done-dir]/$[user]".

> Since the following code snippet in `moveToDoneNow()` will definitely write some logs
out to log file, but I can found no any sign of it in all logs in $HADOOP_LOG_DIR via command
`grep "Copied to done location" *`.
>     if (copied)
>         LOG.info("Copied to done location: " + toPath);
>     else 
>         LOG.info("copy failed");
> Is there anything that I missed?



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message