Return-Path: X-Original-To: apmail-hbase-dev-archive@www.apache.org Delivered-To: apmail-hbase-dev-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 93CF710B50 for ; Mon, 24 Mar 2014 22:46:53 +0000 (UTC) Received: (qmail 32197 invoked by uid 500); 24 Mar 2014 22:46:49 -0000 Delivered-To: apmail-hbase-dev-archive@hbase.apache.org Received: (qmail 32083 invoked by uid 500); 24 Mar 2014 22:46:49 -0000 Mailing-List: contact dev-help@hbase.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@hbase.apache.org Delivered-To: mailing list dev@hbase.apache.org Received: (qmail 32075 invoked by uid 99); 24 Mar 2014 22:46:49 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 24 Mar 2014 22:46:49 +0000 X-ASF-Spam-Status: No, hits=1.5 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of yuzhihong@gmail.com designates 209.85.128.173 as permitted sender) Received: from [209.85.128.173] (HELO mail-ve0-f173.google.com) (209.85.128.173) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 24 Mar 2014 22:46:44 +0000 Received: by mail-ve0-f173.google.com with SMTP id oy12so6435298veb.4 for ; Mon, 24 Mar 2014 15:46:22 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type; bh=edQRcsTD0C7LTVA+f3quslvWywnOvZvkTBwDLQ4S+vk=; b=ZQM/iGvRpd9GNlWyCGfL77nQzAhmOD3RnqJ5cPWmfYbGeYijVO+mOtTQrqXDWDh0FS Y12OjjSIVZ8taw8lh1SalGn2e1DIeuTMvley34b7pl2S14pAhfur9NNR79P0Qex1BTE1 VZoD9lm6DPcWyWk2OQuD9fZTVMPv/xS2rLXadjw6R0SmlQW4o8nD9Kq6qwemWfwXGLHJ 9HYh1QASmNG7NO26pxBHZ2oHRsp/vedxhl9wGbn4Llo+V/uOh558nAGau06SbHDVo/Sf J6UGSE6VRcx+4nMZNiphhb0gndnIECyGj5FQhQ5y10iYHzrWUwBKt8Rk6Kaa3lryt269 gNhA== MIME-Version: 1.0 X-Received: by 10.52.240.207 with SMTP id wc15mr45599721vdc.14.1395701182651; Mon, 24 Mar 2014 15:46:22 -0700 (PDT) Received: by 10.58.228.103 with HTTP; Mon, 24 Mar 2014 15:46:22 -0700 (PDT) In-Reply-To: References: Date: Mon, 24 Mar 2014 15:46:22 -0700 Message-ID: Subject: Re: Co-locate meta and master, and beyond From: Ted Yu To: "dev@hbase.apache.org" Content-Type: multipart/alternative; boundary=20cf307ac1413463fa04f562013f X-Virus-Checked: Checked by ClamAV on apache.org --20cf307ac1413463fa04f562013f Content-Type: text/plain; charset=ISO-8859-1 Nice work Jimmy. On Thu, Mar 20, 2014 at 9:08 AM, Jimmy Xiang wrote: > Here is a heads up on some work I've been doing of late. > > > My goal is to make region assignment simpler, faster, more reliable > > and maintainable making it so we are able to handle many more regions > > more efficiently (improve mttr, and lessen impact of compactions), and > > to eventually look into quorum-based master service. > > In HBASE-10569, I posted a patch that makes a HMaster also a > HRegionServer. I've also done work so that we can co-locate the meta > region with the master server. These changes are based on one of the > agreements per the discussion in HBASE-5487, the master re-design. > > We should be able to do a rolling restart on to this new basis (I'm > > working on it). > > Putting the master and regionserver processes together and making it > > so meta and master are also together is a step toward making it easier > doing > region assignment without using ZK, another agreement from HBASE-5487. > > > Thanks. > > Jimmy > --20cf307ac1413463fa04f562013f--