hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Amareshwari Sriramadasu (JIRA)" <j...@apache.org>
Subject [jira] Updated: (MAPREDUCE-1776) Hadoop should provide a simplified way of fetching user-logs
Date Fri, 07 May 2010 05:39:49 GMT

     [ https://issues.apache.org/jira/browse/MAPREDUCE-1776?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Amareshwari Sriramadasu updated MAPREDUCE-1776:
-----------------------------------------------

    Component/s: tasktracker

> Hadoop should provide a simplified way of fetching user-logs
> ------------------------------------------------------------
>
>                 Key: MAPREDUCE-1776
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1776
>             Project: Hadoop Map/Reduce
>          Issue Type: New Feature
>          Components: tasktracker
>    Affects Versions: 0.20.1, 0.20.2
>            Reporter: Alok Singh
>
> Hi,
>    Currently , in both streaming and normal mode hadoop mapred program, user can't download
the 
> logs programatically.
> jobclient.output.filter=ALL, allows user to print output in the stdout/stderr
> We need to have the ability to fetch the user logs from the framework.
> in 0.18, under the hod , we used to store the logs in the hdfs.
> For 0.20, as long as the jobhistory resides user can view the logs but then it's gone.
> So in short , I am proposing that hadoop 
> 1) provide the options to the JobClient (i.e jobconf var jobclient.output.logs.location),
so that it will download the output in the hdfs location instead of printing to stdout.
> Thanks
> Alok
> Alok

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message