hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Matei Zaharia (JIRA)" <j...@apache.org>
Subject [jira] Updated: (HADOOP-3708) Provide accounting functionality for Hadoop resource manager
Date Mon, 27 Oct 2008 21:49:44 GMT

     [ https://issues.apache.org/jira/browse/HADOOP-3708?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Matei Zaharia updated HADOOP-3708:
----------------------------------

    Attachment: history-scripts-0.18.tgz

Here are some modified scripts for 0.18 too. It looks like some naming in the history log
changed slightly, unfortunately (e.g. task attempts being called task_someting instead of
tip_something, or counters being written as key:value instead of key=value). Are you guys
planning to finalize the history log format sometime? It would make it easier to do accounting
after the fact using tools like this.

> Provide accounting functionality for Hadoop resource manager
> ------------------------------------------------------------
>
>                 Key: HADOOP-3708
>                 URL: https://issues.apache.org/jira/browse/HADOOP-3708
>             Project: Hadoop Core
>          Issue Type: New Feature
>          Components: contrib/capacity-sched
>            Reporter: Hemanth Yamijala
>            Assignee: Hemanth Yamijala
>             Fix For: 0.20.0
>
>         Attachments: history-scripts-0.16.tgz, history-scripts-0.18.tgz, history-scripts.patch
>
>
> HADOOP-3421 describes requirements for a new resource manager in Hadoop to schedule Map/Reduce
jobs. In production systems, it would be useful to produce accounting information related
to the scheduling - such as job start and run times, resources used, etc. This information
can be consumed by other systems to build accounting for shared resources. This JIRA is for
tracking the requirements, approach and implementation for producing accounting information.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message