hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "J.Andreina (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-3457) Number of UnderReplicated blocks displayed in UI and Fsck report is different
Date Wed, 30 May 2012 04:30:26 GMT

    [ https://issues.apache.org/jira/browse/HDFS-3457?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13285374#comment-13285374
] 

J.Andreina commented on HDFS-3457:
----------------------------------

Hi Aaron,
  Thanks for looking into this defect.
Actually i raised this defect pointing to following two issues 
(1) Number of Underreplicated blocks
(2) Number of files
displayed in UI and fsck report is different

But as Ashish has commented : Number of files displayed in UI and fsck report is proper and
i too agree with that.

But still the number of underreplicated blocks are different in UI and fsck .Please let me
know why this is happening.

                
> Number of UnderReplicated blocks displayed in UI and Fsck report is different
> -----------------------------------------------------------------------------
>
>                 Key: HDFS-3457
>                 URL: https://issues.apache.org/jira/browse/HDFS-3457
>             Project: Hadoop HDFS
>          Issue Type: Bug
>    Affects Versions: 2.0.0-alpha
>            Reporter: J.Andreina
>            Priority: Minor
>         Attachments: Mismatch in Number of Underreplicated blocks UI.jpg, Mismatch in
number of files UI.jpg
>
>
> Scenario:
> =========
> Write an HDFS application with the following sequence of operations
> 1. Create file.
> 2. Append and sync file.
> 3. Delete file.
> 4. Create file.
> 5. Rename file.
> Run the application using 50 threads for 4 hours.
> Next Run the same application using 200 threads for the next 4 hours.
> Next Run the application using 50 threads for the next 4 hours.
> The Number of under-Replicated blocks mentioned in the UI and fsck report differs
> Fsck report for the mismatch in Number of under-Replicated blocks :
> ===================================================================
> Status: HEALTHY
>  Total size:	5670200922 B
>  Total dirs:	2
>  Total files:	2015
>  Total blocks (validated):	977 (avg. block size 5803685 B)
>  Minimally replicated blocks:	977 (100.0 %)
>  Over-replicated blocks:	0 (0.0 %)
>  Under-replicated blocks:	94 (9.621289 %)
>  Mis-replicated blocks:		0 (0.0 %)
>  Default replication factor:	2
>  Average block replication:	1.9037871
>  Corrupt blocks:		0
>  Missing replicas:		94 (5.0537634 %)
>  Number of data-nodes:		3
>  Number of racks:		1
> FSCK ended at Mon Mar 19 11:14:41 IST 2012 in 94 milliseconds
> The filesystem under path '/' is HEALTHY
> Have attached UI screenshot for this issue

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Mime
View raw message