hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Konstantin Shvachko (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HDFS-12978) Fine-grained locking while consuming journal stream.
Date Thu, 24 May 2018 22:44:00 GMT

     [ https://issues.apache.org/jira/browse/HDFS-12978?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Konstantin Shvachko updated HDFS-12978:
---------------------------------------
    Attachment: HDFS-12978.003.patch

> Fine-grained locking while consuming journal stream.
> ----------------------------------------------------
>
>                 Key: HDFS-12978
>                 URL: https://issues.apache.org/jira/browse/HDFS-12978
>             Project: Hadoop HDFS
>          Issue Type: Sub-task
>          Components: namenode
>            Reporter: Konstantin Shvachko
>            Assignee: Konstantin Shvachko
>            Priority: Major
>         Attachments: HDFS-12978.001.patch, HDFS-12978.002.patch, HDFS-12978.003.patch
>
>
> In current implementation SBN consumes the entire segment of transactions under a single
namesystem lock, which does not allow reads over a long period of time until the segment is
processed. We should break the lock into fine grained chunks. In extreme case each transaction
should release the lock once it is applied.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org


Mime
View raw message