hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Raghu Angadi (JIRA)" <j...@apache.org>
Subject [jira] Commented: (HADOOP-2114) Checksums for Namenode image files
Date Wed, 31 Oct 2007 22:41:50 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-2114?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12539204
] 

Raghu Angadi commented on HADOOP-2114:
--------------------------------------


Regd performance, we should be  able to write about 10k records (of 100-300 bytes each) per
sec and about 10-20 records could be batched.

> Checksums for Namenode image files
> ----------------------------------
>
>                 Key: HADOOP-2114
>                 URL: https://issues.apache.org/jira/browse/HADOOP-2114
>             Project: Hadoop
>          Issue Type: Improvement
>          Components: dfs
>    Affects Versions: 0.14.3
>            Reporter: Raghu Angadi
>
> Currently DFS can write multiple copies of image files but we do not automatically recover
from corrupted or truncated image files well. This jira intends to keep CRC for image file
records and Namenode should recover accurate image as long as data exists in one of the copies
(e.g. it should be ok to have non overlapping corruptions in the copies). Will add more details
in next comment.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message