Return-Path: X-Original-To: apmail-hbase-dev-archive@www.apache.org Delivered-To: apmail-hbase-dev-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 55EEFD59F for ; Thu, 13 Sep 2012 17:29:22 +0000 (UTC) Received: (qmail 27277 invoked by uid 500); 13 Sep 2012 17:29:21 -0000 Delivered-To: apmail-hbase-dev-archive@hbase.apache.org Received: (qmail 27224 invoked by uid 500); 13 Sep 2012 17:29:21 -0000 Mailing-List: contact dev-help@hbase.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@hbase.apache.org Delivered-To: mailing list dev@hbase.apache.org Received: (qmail 27213 invoked by uid 99); 13 Sep 2012 17:29:21 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 13 Sep 2012 17:29:21 +0000 X-ASF-Spam-Status: No, hits=-0.7 required=5.0 tests=RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of saint.ack@gmail.com designates 209.85.214.169 as permitted sender) Received: from [209.85.214.169] (HELO mail-ob0-f169.google.com) (209.85.214.169) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 13 Sep 2012 17:29:15 +0000 Received: by obhx4 with SMTP id x4so6078968obh.14 for ; Thu, 13 Sep 2012 10:28:54 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:sender:in-reply-to:references:date :x-google-sender-auth:message-id:subject:from:to:content-type; bh=DkZOiseMe4icsEO7GNqZ2TVCsxdvmTQ1dR0QIORI8YM=; b=Xu4Nv8PiJzKZLUSW34D5Iuj5IEV7UKS+5mtpk3G/BFAIr8wKlt8m0qge0HTZ57Ia4+ h21hbNRnx1yzHJ6WTMdTvnPbt6ogSYt+ShSZBdLnjajDwYugC41kLjQAGtsPFWESt/rP t7PxSHF1PL3aXtsF3MQ5iyQAhRRVDgsQ8Y33cLte8he/nVXD/AvzHeTnpL8oaDPbBYcz cmHhostOaqt6tRWGSQB/QjwbC4xmzGFB12EJUxjPdR75i2QyRFF1qeTOYd+waOVTPJ9B dygmOGWMfI3IhPpwwu1iDqYInP0CMQF+nCScYzz0+xtkp0w+K4vVK+8bR0awtgtlA3dz CXaw== MIME-Version: 1.0 Received: by 10.182.154.70 with SMTP id vm6mr3627812obb.50.1347557334622; Thu, 13 Sep 2012 10:28:54 -0700 (PDT) Sender: saint.ack@gmail.com Received: by 10.76.25.201 with HTTP; Thu, 13 Sep 2012 10:28:54 -0700 (PDT) In-Reply-To: References: Date: Thu, 13 Sep 2012 10:28:54 -0700 X-Google-Sender-Auth: pm5BvD3ytQG0f1abYoVKHys9R7w Message-ID: Subject: Re: read short circuit From: Stack To: dev@hbase.apache.org Content-Type: text/plain; charset=ISO-8859-1 X-Virus-Checked: Checked by ClamAV on apache.org On Thu, Sep 13, 2012 at 9:51 AM, Jean-Daniel Cryans wrote: > On Thu, Sep 13, 2012 at 9:42 AM, n keywal wrote: >> It's all in the "pretty much" :-) >> Should we make it the default (i.e. recommending it in the doc, emitting a >> warning if it's not set) for all installation ? > > I'd recommend it in the doc as an important config to consider. > > One issue with the current implementation is that you can only have 1 > user that short circuit reads, all the others who have the config > enabled will get a fat Exception. At SU we don't have special config > files for every MR job so unless you disable it job by job then you'll > get those exceptions everywhere. We live with it but it did take > people by surprise when we rolled it out :) > >> Or would it make sense to separate the store and wal cases, meaning that we >> need a change in hdfs to make this possible? > > Don't we only have one FS instance per region server? If so, that's a > moot point. > Write a short paragraph and I'll make an HDFS configuration sections like this HBase configurations section on manual and stick it in there: http://hbase.apache.org/book.html#perf.configurations St.Ack