hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Arpit Agarwal (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-6900) Eliminate DU thread per block pool slice
Date Mon, 25 Aug 2014 23:06:58 GMT

    [ https://issues.apache.org/jira/browse/HDFS-6900?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14109936#comment-14109936

Arpit Agarwal commented on HDFS-6900:

I think we can manage with 'disk free' information which is much cheaper to query. Need to
look into this further though.

> Eliminate DU thread per block pool slice
> ----------------------------------------
>                 Key: HDFS-6900
>                 URL: https://issues.apache.org/jira/browse/HDFS-6900
>             Project: Hadoop HDFS
>          Issue Type: Improvement
>          Components: datanode
>    Affects Versions: 2.5.0
>            Reporter: Arpit Agarwal
> We use one DU thread per block pool slice to compute disk usage information. In addition
to the thread overhead this results in the disk usage information being out of date for up
to 10 minutes at a time. We can refresh it more frequently but then we'd be launching a shell
command per block pool slice even more often.

This message was sent by Atlassian JIRA

View raw message