hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Bharath Mundlapudi (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (MAPREDUCE-2415) Distribute TaskTracker userlogs onto multiple disks
Date Thu, 21 Apr 2011 05:51:05 GMT

    [ https://issues.apache.org/jira/browse/MAPREDUCE-2415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13022619#comment-13022619
] 

Bharath Mundlapudi commented on MAPREDUCE-2415:
-----------------------------------------------

Owen, 

I have run ant test-patch. Most of the things seems fine - no javac warnings or findbugs errors.
But found two minor javadoc warnings. I am attaching a patch which fixes these warnings. 


You will see the following in the diff b/w these two (v2 and v3) patches:

< +   * @param TaskAttemptID ID of the task
---
> +   * @param taskID ID of the task

< +   * @return
---
> +   * @return target task attempt log directory



> Distribute TaskTracker userlogs onto multiple disks
> ---------------------------------------------------
>
>                 Key: MAPREDUCE-2415
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2415
>             Project: Hadoop Map/Reduce
>          Issue Type: Improvement
>          Components: task-controller, tasktracker
>    Affects Versions: 0.20.204.0
>            Reporter: Bharath Mundlapudi
>            Assignee: Bharath Mundlapudi
>             Fix For: 0.20.204.0
>
>         Attachments: MAPREDUCE-2415-1.patch, MAPREDUCE-2415-2.patch, MAPREDUCE-2415-3.patch,
TaskTracker Userlogs Design.pdf
>
>
> Currently, userlogs directory in TaskTracker is placed under hadoop.log.dir like <hadoop.log.dir>/userlogs.
I am proposing to spread these userlogs onto multiple configured mapred.local.dirs to strengthen
TaskTracker reliability w.r.t disk failures.  

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message