hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Alok Singh (JIRA)" <j...@apache.org>
Subject [jira] Created: (HADOOP-6651) Hadoop should provide a simplified way of fetching user-logs
Date Sat, 20 Mar 2010 04:08:27 GMT
Hadoop should provide a simplified way of fetching user-logs

                 Key: HADOOP-6651
                 URL: https://issues.apache.org/jira/browse/HADOOP-6651
             Project: Hadoop Common
          Issue Type: New Feature
    Affects Versions: 0.20.2, 0.20.1, 0.20.0
            Reporter: Alok Singh


   Currently , in both streaming and normal mode hadoop mapred program, user can't download
logs programatically.

jobclient.output.filter=ALL, allows user to print output in the stdout/stderr

We need to have the ability to fetch the user logs from the framework.

in 0.18, under the hod , we used to store the logs in the hdfs.
For 0.20, as long as the jobhistory resides user can view the logs but then it's gone.

So in short , I am proposing that hadoop 
1) provide the options to the JobClient (i.e jobconf var jobclient.output.logs.location),
so that it will download the output in the hdfs location instead of printing to stdout.



This message is automatically generated by JIRA.
You can reply to this email to add a comment to the issue online.

View raw message