hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Konstantin Shvachko (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HDFS-12978) Fine-grained locking while consuming journal stream.
Date Thu, 24 May 2018 22:44:00 GMT

     [ https://issues.apache.org/jira/browse/HDFS-12978?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel

Konstantin Shvachko updated HDFS-12978:
    Attachment: HDFS-12978.003.patch

> Fine-grained locking while consuming journal stream.
> ----------------------------------------------------
>                 Key: HDFS-12978
>                 URL: https://issues.apache.org/jira/browse/HDFS-12978
>             Project: Hadoop HDFS
>          Issue Type: Sub-task
>          Components: namenode
>            Reporter: Konstantin Shvachko
>            Assignee: Konstantin Shvachko
>            Priority: Major
>         Attachments: HDFS-12978.001.patch, HDFS-12978.002.patch, HDFS-12978.003.patch
> In current implementation SBN consumes the entire segment of transactions under a single
namesystem lock, which does not allow reads over a long period of time until the segment is
processed. We should break the lock into fine grained chunks. In extreme case each transaction
should release the lock once it is applied.

This message was sent by Atlassian JIRA

To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org

View raw message