hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "J.Andreina (JIRA)" <j...@apache.org>
Subject [jira] [Created] (HDFS-3325) When configuring "dfs.namenode.safemode.threshold-pct" to a value greater or equal to 1 there is mismatch in the UI report
Date Thu, 26 Apr 2012 04:09:28 GMT
J.Andreina created HDFS-3325:
--------------------------------

             Summary: When configuring "dfs.namenode.safemode.threshold-pct" to a value greater
or equal to 1 there is mismatch in the UI report
                 Key: HDFS-3325
                 URL: https://issues.apache.org/jira/browse/HDFS-3325
             Project: Hadoop HDFS
          Issue Type: Bug
    Affects Versions: 2.0.0
            Reporter: J.Andreina
             Fix For: 2.0.0, 3.0.0


When dfs.namenode.safemode.threshold-pct is configured to n
Namenode will be in safemode until n percentage of blocks that should satisfy 
    the minimal replication requirement defined by dfs.namenode.replication.min is reported
to namenode

But in UI it displays that n percentage of total blocks + 1 blocks  are additionally needed
to come out of the safemode

Scenario 1:
============
Configurations:
dfs.namenode.safemode.threshold-pct = 2
dfs.replication = 2
dfs.namenode.replication.min =2
Step 1: Start NN,DN1,DN2
Step 2: Write a file "a.txt" which has got 167 blocks
step 3: Stop NN,DN1,DN2
Step 4: start NN
In UI report the Number of blocks needed to come out of safemode and number of blocks actually
present is different.

{noformat}
Cluster Summary
Security is OFF 
Safe mode is ON. The reported blocks 0 needs additional 335 blocks to reach the threshold
2.0000 of total blocks 167. Safe mode will be turned off automatically.
2 files and directories, 167 blocks = 169 total.
Heap Memory used 57.05 MB is 2% of Commited Heap Memory 2 GB. Max Heap Memory is 2 GB. 
Non Heap Memory used 23.37 MB is 17% of Commited Non Heap Memory 130.44 MB. Max Non Heap Memory
is 176 MB.{noformat}

Scenario 2:
===========
Configurations:
dfs.namenode.safemode.threshold-pct = 1
dfs.replication = 2
dfs.namenode.replication.min =2
Step 1: Start NN,DN1,DN2
Step 2: Write a file "a.txt" which has got 167 blocks
step 3: Stop NN,DN1,DN2
Step 4: start NN
In UI report the Number of blocks needed to come out of safemode and number of blocks actually
present is different

{noformat}
Cluster Summary
Security is OFF 
Safe mode is ON. The reported blocks 0 needs additional 168 blocks to reach the threshold
1.0000 of total blocks 167. Safe mode will be turned off automatically.
2 files and directories, 167 blocks = 169 total.
Heap Memory used 56.2 MB is 2% of Commited Heap Memory 2 GB. Max Heap Memory is 2 GB. 
Non Heap Memory used 23.37 MB is 17% of Commited Non Heap Memory 130.44 MB. Max Non Heap Memory
is 176 MB.{noformat}


--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Mime
View raw message