hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Brandon Li (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-4971) Move IO operations out of locking in OpenFileCtx
Date Thu, 19 Sep 2013 20:37:56 GMT

    [ https://issues.apache.org/jira/browse/HDFS-4971?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13772284#comment-13772284

Brandon Li commented on HDFS-4971:

Thanks for the patch. Some quick comments:
1. in the cleanup(), it should check if dumpOut==null before trying to delete the dump file.
2. in the dumper thread, it should check if dump is still enable before each loop:
    while (activeState && enabledDump) {
> Move IO operations out of locking in OpenFileCtx
> ------------------------------------------------
>                 Key: HDFS-4971
>                 URL: https://issues.apache.org/jira/browse/HDFS-4971
>             Project: Hadoop HDFS
>          Issue Type: Sub-task
>          Components: nfs
>            Reporter: Jing Zhao
>            Assignee: Jing Zhao
>         Attachments: HDFS-4971.000.patch, HDFS-4971.001.patch, HDFS-4971.002.patch, HDFS-4971.003.patch,
HDFS-4971.004.patch, HDFS-4971.005.patch, HDFS-4971.006.patch
> Currently some IO operations (such as writing data to HDFS and dumping to local disk)
in OpenFileCtx may hold a lock which can block processing incoming writing requests. This
jira aims to optimize OpenFileCtx and move the IO operations out of the locking.

This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

View raw message