hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Todd Lipcon (JIRA)" <j...@apache.org>
Subject [jira] Commented: (HDFS-1350) make datanodes do graceful shutdown
Date Mon, 23 Aug 2010 05:21:17 GMT

    [ https://issues.apache.org/jira/browse/HDFS-1350?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12901266#action_12901266
] 

Todd Lipcon commented on HDFS-1350:
-----------------------------------

I believe the way 20-append works is that it won't use that replica if there are other replicas
where the checksum and data length do match up. If *all* of them are incorrect, it falls back
to the old behavior of truncating. If we're too aggressive with the truncation, we risk truncating
back before the last sync() offset, I think. HDFS-1218 changes the behavior here a bit, though
- I think that's one of the patches that hasn't made it into the branch yet?

> make datanodes do graceful shutdown
> -----------------------------------
>
>                 Key: HDFS-1350
>                 URL: https://issues.apache.org/jira/browse/HDFS-1350
>             Project: Hadoop HDFS
>          Issue Type: Improvement
>          Components: data-node
>            Reporter: sam rash
>            Assignee: sam rash
>
> we found that the Datanode doesn't do a graceful shutdown and a block can be corrupted
(data + checksum amounts off)
> we can make the DN do a graceful shutdown in case there are open files. if this presents
a problem to a timely shutdown, we can make a it a parameter of how long to wait for the full
graceful shutdown before just exiting

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message