hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Brandon Li (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-4971) Move IO operations out of locking in OpenFileCtx
Date Thu, 19 Sep 2013 20:37:56 GMT

    [ https://issues.apache.org/jira/browse/HDFS-4971?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13772284#comment-13772284
] 

Brandon Li commented on HDFS-4971:
----------------------------------

Thanks for the patch. Some quick comments:
1. in the cleanup(), it should check if dumpOut==null before trying to delete the dump file.
2. in the dumper thread, it should check if dump is still enable before each loop:
    while (activeState && enabledDump) {
                
> Move IO operations out of locking in OpenFileCtx
> ------------------------------------------------
>
>                 Key: HDFS-4971
>                 URL: https://issues.apache.org/jira/browse/HDFS-4971
>             Project: Hadoop HDFS
>          Issue Type: Sub-task
>          Components: nfs
>            Reporter: Jing Zhao
>            Assignee: Jing Zhao
>         Attachments: HDFS-4971.000.patch, HDFS-4971.001.patch, HDFS-4971.002.patch, HDFS-4971.003.patch,
HDFS-4971.004.patch, HDFS-4971.005.patch, HDFS-4971.006.patch
>
>
> Currently some IO operations (such as writing data to HDFS and dumping to local disk)
in OpenFileCtx may hold a lock which can block processing incoming writing requests. This
jira aims to optimize OpenFileCtx and move the IO operations out of the locking.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message