hadoop-hdfs-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Allen Wittenauer (JIRA)" <j...@apache.org>
Subject [jira] [Resolved] (HDFS-4) DF should use used + available as the capacity of this volume
Date Tue, 22 Jul 2014 19:06:39 GMT

     [ https://issues.apache.org/jira/browse/HDFS-4?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel

Allen Wittenauer resolved HDFS-4.

    Resolution: Won't Fix

This breaks with pooled storage. e.g.:

NAME                           USED  AVAIL  REFER  MOUNTPOINT
rpool                         1.42T   548G   316K  /rpool
rpool/zones                   47.5G   548G   184K  /rpool/zones
rpool/zones/ryoko             2.20G   548G   160K  /rpool/zones/ryoko

Closing as won't fix.

> DF should use used + available as the capacity of this volume
> -------------------------------------------------------------
>                 Key: HDFS-4
>                 URL: https://issues.apache.org/jira/browse/HDFS-4
>             Project: Hadoop HDFS
>          Issue Type: Bug
>         Environment: UNIX
>            Reporter: Rong-En Fan
>              Labels: newbie
> Generally speaking, UNIX tends to keep certain percentage of disk space reserved for
root used only (can be changed via tune2fs or when mkfs). Therefore, Hadoop's DF class should
not use the 1st number in df output as the capacity of this volume. Instead, it should use
used+available as its capacity.
> Otherwise, datanode may think this volume is not full but in fact it is.
> The code in question is src/core/org/apache/hadoop/fs/DF.java, method parseExecResult()

This message was sent by Atlassian JIRA

View raw message