hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Jagadesh Kiran N (JIRA)" <j...@apache.org>
Subject [jira] [Created] (HDFS-8467) [HDFS-Quota]Quota is getting updated after storage policy is modified even before mover command is executed.
Date Fri, 22 May 2015 09:53:17 GMT
Jagadesh Kiran N created HDFS-8467:
--------------------------------------

             Summary: [HDFS-Quota]Quota is getting updated after storage policy is modified
even before mover command is executed.
                 Key: HDFS-8467
                 URL: https://issues.apache.org/jira/browse/HDFS-8467
             Project: Hadoop HDFS
          Issue Type: Bug
            Reporter: Jagadesh Kiran N
            Assignee: surendra singh lilhore


a. create a directory 
{code}
./hdfs dfs -mkdir /d1
{code}
b. Set storage policy HOT on /d1
{code}
./hdfs storagepolicies -setStoragePolicy -path /d1 -policy HOT
{code}

c. Set space quota to disk on /d1
{code}
  ./hdfs dfsadmin -setSpaceQuota 10000 -storageType DISK /d1
{code}

{code} 
./hdfs dfs -count -v -q -h -t  /d1
   DISK_QUOTA    REM_DISK_QUOTA     SSD_QUOTA     REM_SSD_QUOTA ARCHIVE_QUOTA REM_ARCHIVE_QUOTA
PATHNAME
        9.8 K             9.8 K          none               inf          none            
  inf /d1
{code}

d. Insert 2 file each of 1000B
{code}
./hdfs dfs -count -v -q -h -t  /d1
   DISK_QUOTA    REM_DISK_QUOTA     SSD_QUOTA     REM_SSD_QUOTA ARCHIVE_QUOTA REM_ARCHIVE_QUOTA
PATHNAME
        9.8 K             3.9 K          none               inf          none            
  inf /d1
{code}

e. Set ARCHIVE quota on /d1
{code}
./hdfs dfsadmin -setSpaceQuota 10000 -storageType ARCHIVE /d1
./hdfs dfs -count -v -q -h -t  /d1
   DISK_QUOTA    REM_DISK_QUOTA     SSD_QUOTA     REM_SSD_QUOTA ARCHIVE_QUOTA REM_ARCHIVE_QUOTA
PATHNAME
        9.8 K             3.9 K          none               inf         9.8 K            
9.8 K /d1
{code}

f. Change storagepilicy to COLD
{code}
./hdfs storagepolicies -setStoragePolicy -path /d1 -policy COLD
{code}

g. Check REM_ARCHIVE_QUOTA Value
{code}
./hdfs dfs -count -v -q -h -t  /d1
   DISK_QUOTA    REM_DISK_QUOTA     SSD_QUOTA     REM_SSD_QUOTA ARCHIVE_QUOTA REM_ARCHIVE_QUOTA
PATHNAME
        9.8 K             9.8 K          none               inf         9.8 K            
3.9 K /d1
{code}

Here even when 'Mover' command is not run, quota of REM_ARCHIVE_QUOTA is reduced and REM_DISK_QUOTA
is increased.

Expected : After Mover is success quota values has to be changed.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message