Return-Path: X-Original-To: apmail-hbase-issues-archive@www.apache.org Delivered-To: apmail-hbase-issues-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 666F64454 for ; Mon, 9 May 2011 20:46:45 +0000 (UTC) Received: (qmail 60123 invoked by uid 500); 9 May 2011 20:46:45 -0000 Delivered-To: apmail-hbase-issues-archive@hbase.apache.org Received: (qmail 60090 invoked by uid 500); 9 May 2011 20:46:45 -0000 Mailing-List: contact issues-help@hbase.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Delivered-To: mailing list issues@hbase.apache.org Received: (qmail 60082 invoked by uid 99); 9 May 2011 20:46:45 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 09 May 2011 20:46:45 +0000 X-ASF-Spam-Status: No, hits=-1996.4 required=5.0 tests=ALL_TRUSTED,FS_REPLICA,T_RP_MATCHES_RCVD X-Spam-Check-By: apache.org Received: from [140.211.11.116] (HELO hel.zones.apache.org) (140.211.11.116) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 09 May 2011 20:46:43 +0000 Received: from hel.zones.apache.org (hel.zones.apache.org [140.211.11.116]) by hel.zones.apache.org (Postfix) with ESMTP id 7A768C81D3 for ; Mon, 9 May 2011 20:46:03 +0000 (UTC) Date: Mon, 9 May 2011 20:46:03 +0000 (UTC) From: "Jason Rutherglen (JIRA)" To: issues@hbase.apache.org Message-ID: <743411247.33278.1304973963498.JavaMail.tomcat@hel.zones.apache.org> Subject: [jira] [Commented] (HBASE-2357) Coprocessors: Add read-only region replicas (slaves) for availability and fast region recovery MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 X-Virus-Checked: Checked by ClamAV on apache.org [ https://issues.apache.org/jira/browse/HBASE-2357?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13030892#comment-13030892 ] Jason Rutherglen commented on HBASE-2357: ----------------------------------------- @Andrew The ZAB would be very cool, as then there wouldn't be a need for too much logic when a master fails? However I wonder about the write performance, as it means additional network overhead (to each node) per write? bq. Initial thoughts on this is a region slave can get notice from the region owner via zk that a log has rolled and process the new edits from there What is the expected latency between a write and then reading the new value(s) from the slave? I'm not sure if this means writing a series of WAL edits to a file, then waiting for the file to reach a given limit (?), and then the slave reads from the newly flushed log in HDFS? If this is the case, perhaps we'll want to implement replication that is more immediate (like MySQL)? > Coprocessors: Add read-only region replicas (slaves) for availability and fast region recovery > ---------------------------------------------------------------------------------------------- > > Key: HBASE-2357 > URL: https://issues.apache.org/jira/browse/HBASE-2357 > Project: HBase > Issue Type: Sub-task > Components: master, regionserver > Reporter: Todd Lipcon > Assignee: Andrew Purtell > > I dont plan on working on this in the short term, but the idea is to extend region ownership to have two modes. Each region has one primary region server and N slave region servers. The slaves would follow the master (probably by streaming the relevant HLog entries directly from it) and be able to serve stale reads. The benefit is twofold: (a) provides the ability to spread read load, (b) enables very fast region failover/rebalance since the memstore is already nearly up to date on the slave RS. -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira