accumulo-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Eric Newton (JIRA)" <>
Subject [jira] [Created] (ACCUMULO-578) consider using hdfs for the walog
Date Mon, 07 May 2012 14:48:50 GMT
Eric Newton created ACCUMULO-578:

             Summary: consider using hdfs for the walog
                 Key: ACCUMULO-578
             Project: Accumulo
          Issue Type: Improvement
          Components: logger, tserver
    Affects Versions: 1.5.0-SNAPSHOT
            Reporter: Eric Newton
            Assignee: Eric Newton

Using HDFS for walogs would fix:
 * ACCUMULO-84: any node can read the replicated files
 * ACCUMULO-558: wouldn't need to monitor loggers
 * ACCUMULO-544: log references wouldn't include hostnames
 * ACCUMULO-423: wouldn't need to monitor loggers
 * ACCUMULO-258: hdfs has load balancing already

To implement it, we would need the ability to distribute log sorts.

Continuing to use loggers helps us avoid:
 * hdfs pipeline strategy
 * we don't have fine-grained insight when a single node makes dfs slow
 * additional namenode pressure
 * flexibility: for example, we can add fadvise() calls to the logger before HDFS supports

This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:!default.jspa
For more information on JIRA, see:


View raw message