hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Tsz Wo Nicholas Sze (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-12853) Ozone: Optimize chunk writes for Ratis by avoiding double writes
Date Mon, 08 Jan 2018 10:06:00 GMT

    [ https://issues.apache.org/jira/browse/HDFS-12853?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16316006#comment-16316006
] 

Tsz Wo Nicholas Sze commented on HDFS-12853:
--------------------------------------------

> COMMIT_DATA should be sync'ed with WRITE_DATA so that COMMIT_DATA is always after WRITE_DATA.

If we don't have the synchronization mentioned the above, it seems that the patch won't work?

> Ozone: Optimize chunk writes for Ratis by avoiding double writes
> ----------------------------------------------------------------
>
>                 Key: HDFS-12853
>                 URL: https://issues.apache.org/jira/browse/HDFS-12853
>             Project: Hadoop HDFS
>          Issue Type: Sub-task
>          Components: ozone
>    Affects Versions: HDFS-7240
>            Reporter: Mukul Kumar Singh
>            Assignee: Mukul Kumar Singh
>             Fix For: HDFS-7240
>
>         Attachments: HDFS-12853-HDFS-7240.001.patch, HDFS-12853-HDFS-7240.002.patch
>
>
> Ozone, in replicated mode writes the data twice, once to the raft log and then to the
statemachine.
> This results in the data being written twice during a particular chunk write, this is
subobtimal. With RATIS-122 the statemachine in Ozone can be optimized by writing the data
to the statemachine only once.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org


Mime
View raw message