hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Tsz Wo (Nicholas), SZE (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-1840) Terminate LeaseChecker when all writing files are closed.
Date Wed, 27 Apr 2011 18:20:03 GMT

    [ https://issues.apache.org/jira/browse/HDFS-1840?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13025932#comment-13025932
] 

Tsz Wo (Nicholas), SZE commented on HDFS-1840:
----------------------------------------------

Before the patch in this issue, you are right that the number of threads increases as more
and more users submitting jobs to JobTracker since the threads live forever even if some users
stop submitting jobs.  This issue is to fix the problem -- changed the threads to that they
will terminate.  In the JobTracker case, the number of threads will decrease when users stop
submitting new jobs.  So this actually improves the performance. :)

> Terminate LeaseChecker when all writing files are closed.
> ---------------------------------------------------------
>
>                 Key: HDFS-1840
>                 URL: https://issues.apache.org/jira/browse/HDFS-1840
>             Project: Hadoop HDFS
>          Issue Type: Improvement
>          Components: hdfs client
>            Reporter: Tsz Wo (Nicholas), SZE
>            Assignee: Tsz Wo (Nicholas), SZE
>             Fix For: 0.23.0
>
>         Attachments: h1840_20110418.patch, h1840_20110419.patch, h1840_20110419b.patch
>
>
> In {{DFSClient}}, when there are files opened for write, a {{LeaseChecker}} thread is
started for updating the leases periodically.  However, it never terminates when when all
writing files are closed.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message