Mailing-List: contact common-issues-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
Reply-To: common-issues@hadoop.apache.org
Message-ID: <1468308357.382531269058107272.JavaMail.jira@brutus.apache.org>
Date: Sat, 20 Mar 2010 04:08:27 +0000 (UTC)
From: "Alok Singh (JIRA)" <jira@apache.org>
To: common-issues@hadoop.apache.org
Subject: [jira] Created: (HADOOP-6651) Hadoop should provide a simplified
 way of fetching user-logs
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit

Hadoop should provide a simplified way of fetching user-logs
------------------------------------------------------------

                 Key: HADOOP-6651
                 URL: https://issues.apache.org/jira/browse/HADOOP-6651
             Project: Hadoop Common
          Issue Type: New Feature
    Affects Versions: 0.20.2, 0.20.1, 0.20.0
            Reporter: Alok Singh


Hi,

   Currently , in both streaming and normal mode hadoop mapred program, user can't download the 
logs programatically.

jobclient.output.filter=ALL, allows user to print output in the stdout/stderr


We need to have the ability to fetch the user logs from the framework.

in 0.18, under the hod , we used to store the logs in the hdfs.
For 0.20, as long as the jobhistory resides user can view the logs but then it's gone.

So in short , I am proposing that hadoop 
1) provide the options to the JobClient (i.e jobconf var jobclient.output.logs.location), so that it will download the output in the hdfs location instead of printing to stdout.

Thanks
Alok


Alok


-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.