hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Mukul Kumar Singh (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-12853) Ozone: Optimize chunk writes for Ratis by avoiding double writes
Date Mon, 08 Jan 2018 10:16:00 GMT

    [ https://issues.apache.org/jira/browse/HDFS-12853?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16316022#comment-16316022

Mukul Kumar Singh commented on HDFS-12853:

If we don't have the synchronization mentioned the above, it seems that the patch won't work?
bq. Yes, thats correct, without the synchronization, the fix will not work.

However the following lines in the latest patch adds the syncronization
      if (requestProto.getCmdType() == ContainerProtos.Type.WriteChunk) {
        WriteChunkRequestProto write = requestProto.getWriteChunk();
        CompletableFuture<Message> stateMachineFuture =
        return stateMachineFuture
            .thenComposeAsync(v ->

> Ozone: Optimize chunk writes for Ratis by avoiding double writes
> ----------------------------------------------------------------
>                 Key: HDFS-12853
>                 URL: https://issues.apache.org/jira/browse/HDFS-12853
>             Project: Hadoop HDFS
>          Issue Type: Sub-task
>          Components: ozone
>    Affects Versions: HDFS-7240
>            Reporter: Mukul Kumar Singh
>            Assignee: Mukul Kumar Singh
>             Fix For: HDFS-7240
>         Attachments: HDFS-12853-HDFS-7240.001.patch, HDFS-12853-HDFS-7240.002.patch
> Ozone, in replicated mode writes the data twice, once to the raft log and then to the
> This results in the data being written twice during a particular chunk write, this is
subobtimal. With RATIS-122 the statemachine in Ozone can be optimized by writing the data
to the statemachine only once.

This message was sent by Atlassian JIRA

To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org

View raw message