Return-Path: X-Original-To: apmail-accumulo-notifications-archive@minotaur.apache.org Delivered-To: apmail-accumulo-notifications-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 58536111E6 for ; Fri, 6 Jun 2014 17:26:03 +0000 (UTC) Received: (qmail 6236 invoked by uid 500); 6 Jun 2014 17:26:03 -0000 Delivered-To: apmail-accumulo-notifications-archive@accumulo.apache.org Received: (qmail 6199 invoked by uid 500); 6 Jun 2014 17:26:03 -0000 Mailing-List: contact notifications-help@accumulo.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: jira@apache.org Delivered-To: mailing list notifications@accumulo.apache.org Received: (qmail 6053 invoked by uid 99); 6 Jun 2014 17:26:03 -0000 Received: from arcas.apache.org (HELO arcas.apache.org) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 06 Jun 2014 17:26:03 +0000 Date: Fri, 6 Jun 2014 17:26:03 +0000 (UTC) From: "Mike Drob (JIRA)" To: notifications@accumulo.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Commented] (ACCUMULO-2866) Default WAL size should be based on HDFS Block Size MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/ACCUMULO-2866?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14020086#comment-14020086 ] Mike Drob commented on ACCUMULO-2866: ------------------------------------- [~ecn] - The WAL is not splitable and will only be processed by at most one server at a time. Keeping it in a single block 1) alleviates extra NN pressure that we could be causing and 2) avoids some potential network overhead. Maybe I'm overstating the benefits here, but as far as defaults go, it makes more sense to me than just picking a number out of the air. > Default WAL size should be based on HDFS Block Size > --------------------------------------------------- > > Key: ACCUMULO-2866 > URL: https://issues.apache.org/jira/browse/ACCUMULO-2866 > Project: Accumulo > Issue Type: Improvement > Components: tserver > Reporter: Mike Drob > Priority: Minor > Labels: wal > Fix For: 1.7.0 > > > HBase automatically defaults their WAL size to 0.95 * HDFS block size. This makes a lot of sense from a resource management perspective, and we should do the same. -- This message was sent by Atlassian JIRA (v6.2#6252)