hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Doug Judd (JIRA)" <j...@apache.org>
Subject [jira] Created: (HADOOP-5359) HDFS soft lease limit should be configurable per-file
Date Fri, 27 Feb 2009 20:45:13 GMT
HDFS soft lease limit should be configurable per-file

                 Key: HADOOP-5359
                 URL: https://issues.apache.org/jira/browse/HADOOP-5359
             Project: Hadoop Core
          Issue Type: Bug
          Components: dfs
    Affects Versions: 0.19.1
         Environment: All operating systems
            Reporter: Doug Judd

In Hypertable, there is a process called the RangeServer which is responsible for handling
updates and queries on portions (ranges) of a database table.  When an update arrives at the
RangeServer, it first gets written to a commit log and then it goes into an in-memory table
structure.  If at any time, the RangeServer dies, when it comes back up, it replays the commit
log to reconstruct the state of the in-memory table structure.  As it stands now, when the
RangeServer comes up, it cannot read the commit log file until the soft lease limit has expired.
 This causes the RangeServer to hang with all of the ranges that it was managing unaccessible.

We would like to be able to configure the soft lease limit per-file so that we can set the
limit to 0 for our commit log files.  That would allow Hypertable to recover immediately after
a crash.

This message is automatically generated by JIRA.
You can reply to this email to add a comment to the issue online.

View raw message