Return-Path: X-Original-To: apmail-hbase-dev-archive@www.apache.org Delivered-To: apmail-hbase-dev-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id CEEA410E3A for ; Thu, 20 Mar 2014 16:08:59 +0000 (UTC) Received: (qmail 87276 invoked by uid 500); 20 Mar 2014 16:08:57 -0000 Delivered-To: apmail-hbase-dev-archive@hbase.apache.org Received: (qmail 87045 invoked by uid 500); 20 Mar 2014 16:08:56 -0000 Mailing-List: contact dev-help@hbase.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@hbase.apache.org Delivered-To: mailing list dev@hbase.apache.org Received: (qmail 87029 invoked by uid 99); 20 Mar 2014 16:08:55 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 20 Mar 2014 16:08:55 +0000 X-ASF-Spam-Status: No, hits=1.5 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of jxiang@cloudera.com designates 209.85.216.51 as permitted sender) Received: from [209.85.216.51] (HELO mail-qa0-f51.google.com) (209.85.216.51) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 20 Mar 2014 16:08:50 +0000 Received: by mail-qa0-f51.google.com with SMTP id j7so1085779qaq.24 for ; Thu, 20 Mar 2014 09:08:29 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:mime-version:date:message-id:subject:from:to :content-type; bh=xRVw1c6rFeBaAzFa7PpkGtkm9nTzuCrMM0ROxVAB65A=; b=WNZaNomt8Uagl2UUC9BVHcvCRXRfpr9olhsNd53ipfAFhPPplUilIWqhOVDM0jQ9uK knq6J8Olh3V8SMFJwsVvS3yP6777uoQzwbw/Y3iWDnTiETutJ/EnUdLKJsBHuv96ir0w TtHYofXFWT9opyb6K38yPxQElvkRuE5rgfylO1vWz5EMvcQ/ed5vXByNP0wWy0NwXbrd pvfjmR1TOIaj/v6HT3UF493q42Vh2pKyAZWH+plHnslqnSYSXhuKPJXYY5h8Ljcs9CSB VOxqiku8MzZBi/Qe7dfJ1I7rPR7uAKZCMIjG4CW6pymmVkoEtYID7Wpaf+ObJVUu9CKJ F4HA== X-Gm-Message-State: ALoCoQkgrCz5Tt7Qz2q9L1E5JicnsCGW7FV/y1LwuqxLIBUsRsMtnPw4ftTRg40J95cX2qx+pish MIME-Version: 1.0 X-Received: by 10.224.112.6 with SMTP id u6mr26441939qap.78.1395331709318; Thu, 20 Mar 2014 09:08:29 -0700 (PDT) Received: by 10.229.18.74 with HTTP; Thu, 20 Mar 2014 09:08:29 -0700 (PDT) Date: Thu, 20 Mar 2014 09:08:29 -0700 Message-ID: Subject: Co-locate meta and master, and beyond From: Jimmy Xiang To: dev@hbase.apache.org Content-Type: multipart/alternative; boundary=001a11c2e848e0e12104f50bfaaf X-Virus-Checked: Checked by ClamAV on apache.org --001a11c2e848e0e12104f50bfaaf Content-Type: text/plain; charset=ISO-8859-1 Here is a heads up on some work I've been doing of late. My goal is to make region assignment simpler, faster, more reliable and maintainable making it so we are able to handle many more regions more efficiently (improve mttr, and lessen impact of compactions), and to eventually look into quorum-based master service. In HBASE-10569, I posted a patch that makes a HMaster also a HRegionServer. I've also done work so that we can co-locate the meta region with the master server. These changes are based on one of the agreements per the discussion in HBASE-5487, the master re-design. We should be able to do a rolling restart on to this new basis (I'm working on it). Putting the master and regionserver processes together and making it so meta and master are also together is a step toward making it easier doing region assignment without using ZK, another agreement from HBASE-5487. Thanks. Jimmy --001a11c2e848e0e12104f50bfaaf--