hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "chang li (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (YARN-2556) Tool to measure the performance of the timeline server
Date Wed, 29 Oct 2014 22:08:34 GMT

     [ https://issues.apache.org/jira/browse/YARN-2556?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel

chang li updated YARN-2556:
    Attachment: yarn2556.patch

Cleaned up my patch, welcome to review. I have used this application to test the timeline
server throughput on local mode by launching 4 mappers and each will put an entity larger
than 100 kbs and iterate for 1000 times. Here is my measure result, on my local machine, the
timeline server can provide about 10Mbs io rate for write. There is some deviation from the
write throughput for leveldb. People are welcome to try this tool and comment about it.  

> Tool to measure the performance of the timeline server
> ------------------------------------------------------
>                 Key: YARN-2556
>                 URL: https://issues.apache.org/jira/browse/YARN-2556
>             Project: Hadoop YARN
>          Issue Type: Sub-task
>          Components: timelineserver
>            Reporter: Jonathan Eagles
>            Assignee: chang li
>         Attachments: YARN-2556-WIP.patch, YARN-2556-WIP.patch, yarn2556.patch, yarn2556_wip.patch
> We need to be able to understand the capacity model for the timeline server to give users
the tools they need to deploy a timeline server with the correct capacity.
> I propose we create a mapreduce job that can measure timeline server write and read performance.
Transactions per second, I/O for both read and write would be a good start.
> This could be done as an example or test job that could be tied into gridmix.

This message was sent by Atlassian JIRA

View raw message