hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Chen Liang (JIRA)" <j...@apache.org>
Subject [jira] [Comment Edited] (HDFS-11667) Block Storage:Handling flushing of incomplete block id buffers during shutdown
Date Thu, 20 Apr 2017 20:26:04 GMT

    [ https://issues.apache.org/jira/browse/HDFS-11667?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15977445#comment-15977445
] 

Chen Liang edited comment on HDFS-11667 at 4/20/17 8:25 PM:
------------------------------------------------------------

Thanks Mukul for the clarification.

#2 makes sense to me. Regarding #1, I looked at the code a bit more, turns out my earlier
concern is valid because whatever dirtylog file existing in the directory would have been
picked up and requeued already, so there should simply be nothing impactful when it comes
to {{writeBlockBufferToFile}}. Will commit v002 patch soon.


was (Author: vagarychen):
Thanks Mukul for the clarification.

#2 makes sense to me, and I looked at the code a bit more, turns out my earlier concern is
valid because whatever dirtylog file existing in the directory would have been picked up and
requeued already, so there should simply be nothing impactful when it comes to {{writeBlockBufferToFile}}.
Will commit this soon.

> Block Storage:Handling flushing of incomplete block id buffers during shutdown
> ------------------------------------------------------------------------------
>
>                 Key: HDFS-11667
>                 URL: https://issues.apache.org/jira/browse/HDFS-11667
>             Project: Hadoop HDFS
>          Issue Type: Sub-task
>          Components: ozone
>            Reporter: Mukul Kumar Singh
>            Assignee: Mukul Kumar Singh
>         Attachments: HDFS-11667-HDFS-7240.001.patch, HDFS-11667-HDFS-7240.002.patch
>
>
> Currently, whenever the cache shutdown not, zero blocks are written to DirtyLog. This
change will ensure that only required number of blocks are written to the DirtyLog.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org


Mime
View raw message