hadoop-hdfs-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hairong Kuang (JIRA)" <j...@apache.org>
Subject [jira] Created: (HDFS-1429) Make lease expiration limit configurable
Date Wed, 29 Sep 2010 18:38:33 GMT
Make lease expiration limit configurable

                 Key: HDFS-1429
                 URL: https://issues.apache.org/jira/browse/HDFS-1429
             Project: Hadoop HDFS
          Issue Type: Improvement
          Components: name-node
    Affects Versions: 0.22.0
            Reporter: Hairong Kuang
            Assignee: Hairong Kuang
             Fix For: 0.22.0

Currently the soft lease expiration limit is hardcoded as 1 min and the hard limit is hardcoded
to be 1 hour. I'd like to make these two values to be configurable. This would allow applications
with real-time requirements to set the limits that satisfy their needs.

For most HDFS clusters that do not need to serve real-time applications, this change allows
it to set the soft limit to be a much larger number (like equivalent to the hard limit). This
will make the lease renewable thread at the client side to renew lease much less frequently
since the renewable interval is set to be half of the soft limit. This will greatly reduce
the amount of traffic caused by lease renewable when there are large number of clients writing
to HDFS simultaneously.

This message is automatically generated by JIRA.
You can reply to this email to add a comment to the issue online.

View raw message