Return-Path: X-Original-To: apmail-hbase-user-archive@www.apache.org Delivered-To: apmail-hbase-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id AB8AB18F7D for ; Tue, 25 Aug 2015 17:37:55 +0000 (UTC) Received: (qmail 76182 invoked by uid 500); 25 Aug 2015 17:37:53 -0000 Delivered-To: apmail-hbase-user-archive@hbase.apache.org Received: (qmail 76109 invoked by uid 500); 25 Aug 2015 17:37:53 -0000 Mailing-List: contact user-help@hbase.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hbase.apache.org Delivered-To: mailing list user@hbase.apache.org Received: (qmail 76097 invoked by uid 99); 25 Aug 2015 17:37:52 -0000 Received: from Unknown (HELO spamd2-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 25 Aug 2015 17:37:52 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd2-us-west.apache.org (ASF Mail Server at spamd2-us-west.apache.org) with ESMTP id 7D9F21AACFF for ; Tue, 25 Aug 2015 17:37:52 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd2-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 2.879 X-Spam-Level: ** X-Spam-Status: No, score=2.879 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, HTML_MESSAGE=3, RCVD_IN_MSPIKE_H3=-0.01, RCVD_IN_MSPIKE_WL=-0.01, SPF_PASS=-0.001] autolearn=disabled Authentication-Results: spamd2-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com Received: from mx1-eu-west.apache.org ([10.40.0.8]) by localhost (spamd2-us-west.apache.org [10.40.0.9]) (amavisd-new, port 10024) with ESMTP id RW0mvHHfMHkq for ; Tue, 25 Aug 2015 17:37:51 +0000 (UTC) Received: from mail-ig0-f170.google.com (mail-ig0-f170.google.com [209.85.213.170]) by mx1-eu-west.apache.org (ASF Mail Server at mx1-eu-west.apache.org) with ESMTPS id ACEF425CD9 for ; Tue, 25 Aug 2015 17:37:50 +0000 (UTC) Received: by igui7 with SMTP id i7so16909095igu.0 for ; Tue, 25 Aug 2015 10:37:49 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type; bh=j5C+zRlbey+w4XrpDBzR9RqPRZbHYLNDEVUiIMwOF5o=; b=a1K36L5Ep50M9jw5yp3kHjX8i7vSURmBZ/BGHQztwWRJO/s8Ra/kIkZzXDLePNRNCz 9VuPwPWc21R+jKkK15rviCPNnyje/FiP+u6hXIkeJl7JVG6uIqKgE8boQAosz4bIWCC0 7kybh4kc9Bre/ScHLNlfBQ45rLFXpJLgafYQ6wCL5VDwnbKmJgGonJLUhbbkG29nlu92 N5ZROFY33iOXHyvEV2UAAeZ9AxXpzdUsaVDxxdJXj9UIsfgWXWaW6iZYHUad/pP0s5UL tqe80giCYM8QU+t54MZiXdY5uhh+Td89d9VDbm9lM8/Fkz9//Mi1PYWM/IWE6KFjC4US twJg== MIME-Version: 1.0 X-Received: by 10.50.117.8 with SMTP id ka8mr4420599igb.68.1440524269682; Tue, 25 Aug 2015 10:37:49 -0700 (PDT) Received: by 10.64.227.110 with HTTP; Tue, 25 Aug 2015 10:37:49 -0700 (PDT) In-Reply-To: References: Date: Tue, 25 Aug 2015 13:37:49 -0400 Message-ID: Subject: Re: Using HBase with a shared filesystem (gluster, nfs, s3, etc) From: donmai To: user Content-Type: multipart/alternative; boundary=089e013a10f4628992051e2631df --089e013a10f4628992051e2631df Content-Type: text/plain; charset=UTF-8 NFS 0.98.10 Will get to you as soon as I am able, on travel Is my general understanding correct, though, that there shouldn't be any data movement from a region reassignment? On Tue, Aug 25, 2015 at 12:40 PM, Ted Yu wrote: > Can you give a bit more information: > > which filesystem you use > which hbase release you use > master log snippet for the long region assignment > > Thanks > > On Tue, Aug 25, 2015 at 9:30 AM, donmai wrote: > > > Hi, > > > > I'm curious about how exactly region movement works with regard to data > > transfer. To my understanding from the docs given an HDFS-backed > cluster, a > > region movement / transition involves changing things in meta only, all > > data movement for locality is handled by HDFS. In the case where rootdir > is > > a shared file system, there shouldn't be any data movement with a region > > reassignment, correct? I'm running into performance issues where region > > assignment takes a very long time and I'm trying to figure out why. > > > > Thanks! > > > --089e013a10f4628992051e2631df--