hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Milind Bhandarkar (JIRA)" <j...@apache.org>
Subject [jira] Commented: (HDFS-459) Job History Log Analyzer
Date Wed, 01 Jul 2009 06:26:47 GMT

    [ https://issues.apache.org/jira/browse/HDFS-459?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12725943#action_12725943

Milind Bhandarkar commented on HDFS-459:

There is already a job history analyzer contributed to hadoop, called hadoop vaidya. Please
consider contributing this patch there. Thanks.

> Job History Log Analyzer
> ------------------------
>                 Key: HDFS-459
>                 URL: https://issues.apache.org/jira/browse/HDFS-459
>             Project: Hadoop HDFS
>          Issue Type: New Feature
>    Affects Versions: 0.21.0
>            Reporter: Konstantin Shvachko
>            Assignee: Konstantin Shvachko
>             Fix For: 0.21.0
>         Attachments: JHLA-description.html, JHLA.patch
> Job History Log Analyzer parses and analyzes history logs of map-reduce jobs. History
logs contain information about execution of jobs, tasks, and attempts. The tool focuses on
submission, launch, start, and finish times, as well as the success or failure of jobs, tasks
and attempt.
> The analyzer calculates _per hour slot utilization_ and _pending times_ on clusters running
map-reduce jobs.

This message is automatically generated by JIRA.
You can reply to this email to add a comment to the issue online.

View raw message