hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Satish Subhashrao Saley (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HADOOP-14522) Unable to see logs for Job end notification
Date Mon, 12 Jun 2017 22:09:00 GMT

     [ https://issues.apache.org/jira/browse/HADOOP-14522?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Satish Subhashrao Saley updated HADOOP-14522:
---------------------------------------------
    Labels: applicationmaster mapreduce  (was: )

> Unable to see logs for Job end notification
> -------------------------------------------
>
>                 Key: HADOOP-14522
>                 URL: https://issues.apache.org/jira/browse/HADOOP-14522
>             Project: Hadoop Common
>          Issue Type: Bug
>    Affects Versions: 2.8.0
>            Reporter: Satish Subhashrao Saley
>              Labels: applicationmaster, mapreduce
>
> Hi, I have set {{mapreduce.job.end-notification.url}} and I am able to get the notification
correctly.  But I am unable to see log lines from class org.apache.hadoop.mapreduce.v2.app.MRAppMaster
regarding job end notification. When I was trying out different notification urls (before
stabilizing my app), I didn't have any way to look at the logs and wasted a lot of time figuring
out actual issue. It would be good if these logs are also included in syslog for container.

> [relevant code|https://github.com/apache/hadoop/blob/branch-2.8/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/MRAppMaster.java#L641-L650]
> {code}
> notifyIsLastAMRetry(isLastAMRetry);
>       // Stop all services
>       // This will also send the final report to the ResourceManager
>       LOG.info("Calling stop for all the services"); <---- Able to see this.
>       MRAppMaster.this.stop();
>       if (isLastAMRetry) {
>         // Send job-end notification when it is safe to report termination to
>         // users and it is the last AM retry
>         if (getConfig().get(MRJobConfig.MR_JOB_END_NOTIFICATION_URL) != null) {
>           try {
>             LOG.info("Job end notification started for jobID : "
>                 + job.getReport().getJobId()); <--- unable to see this
>             JobEndNotifier notifier = new JobEndNotifier();
>             notifier.setConf(getConfig());
>             JobReport report = job.getReport();
> {code}
> Is it because we are shutting down all services including JobHistoryEventHandler in {{MRAppMaster.this.stop();}}
? 



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org


Mime
View raw message