hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Sangjin Lee (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (YARN-3438) add a mode to replay MR job history files to the timeline service
Date Fri, 24 Apr 2015 00:28:39 GMT

     [ https://issues.apache.org/jira/browse/YARN-3438?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Sangjin Lee updated YARN-3438:
------------------------------
    Attachment: YARN-3438.000.patch

A preliminary patch based on MAPREDUCE-6355.005.patch to solicit reviews.

The idea is to scan an hdfs directory of jobhistory files, and each mapper will get a roughly
equal share of job history files to process.

Also found a small issue in FileSystemTimelineWriterImpl.java and fixed it (cc [~vrushalic]).

Your feedback is greatly appreciated.

> add a mode to replay MR job history files to the timeline service
> -----------------------------------------------------------------
>
>                 Key: YARN-3438
>                 URL: https://issues.apache.org/jira/browse/YARN-3438
>             Project: Hadoop YARN
>          Issue Type: Sub-task
>          Components: timelineserver
>            Reporter: Sangjin Lee
>            Assignee: Sangjin Lee
>         Attachments: YARN-3438.000.patch
>
>
> The subtask covers the work on top of YARN-3437 to add a mode to replay MR job history
files to the timeline service storage.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message