Return-Path: X-Original-To: apmail-hbase-user-archive@www.apache.org Delivered-To: apmail-hbase-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id F3B30F4FA for ; Sat, 1 Jun 2013 20:21:12 +0000 (UTC) Received: (qmail 17477 invoked by uid 500); 1 Jun 2013 20:21:11 -0000 Delivered-To: apmail-hbase-user-archive@hbase.apache.org Received: (qmail 17335 invoked by uid 500); 1 Jun 2013 20:21:10 -0000 Mailing-List: contact user-help@hbase.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hbase.apache.org Delivered-To: mailing list user@hbase.apache.org Received: (qmail 17313 invoked by uid 99); 1 Jun 2013 20:21:09 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Sat, 01 Jun 2013 20:21:09 +0000 X-ASF-Spam-Status: No, hits=-2.3 required=5.0 tests=RCVD_IN_DNSWL_MED,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of jtaylor@salesforce.com designates 64.18.3.86 as permitted sender) Received: from [64.18.3.86] (HELO exprod8og103.obsmtp.com) (64.18.3.86) by apache.org (qpsmtpd/0.29) with SMTP; Sat, 01 Jun 2013 20:21:05 +0000 Received: from exsfm-hub5.internal.salesforce.com ([204.14.239.233]) by exprod8ob103.postini.com ([64.18.7.12]) with SMTP ID DSNKUapXnIx7j4wEHF3BEObpIFeMGVkGyaWj@postini.com; Sat, 01 Jun 2013 13:20:45 PDT Received: from [10.0.54.31] (10.0.54.31) by exsfm-hub5.internal.salesforce.com (10.1.127.5) with Microsoft SMTP Server (TLS) id 8.3.279.5; Sat, 1 Jun 2013 13:20:44 -0700 Message-ID: <51AA579C.3030304@salesforce.com> Date: Sat, 1 Jun 2013 13:20:44 -0700 From: James Taylor User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:17.0) Gecko/20130330 Thunderbird/17.0.5 MIME-Version: 1.0 To: Subject: Re: querying hbase References: <1369193727.62383.YahooMailNeo@web140602.mail.bf1.yahoo.com> <519CEDD6.5030503@salesforce.com> <519EAFE0.1040203@salesforce.com> In-Reply-To: Content-Type: text/plain; charset="ISO-8859-1"; format=flowed Content-Transfer-Encoding: 7bit X-Virus-Checked: Checked by ClamAV on apache.org These approaches all sound somewhat brittle and unlikely to be relied on for a production system (more here: https://issues.apache.org/jira/browse/HBASE-8607). Sounds like a rolling restart is the best option in the near/medium term. Our pain points are more around how to get to the point where Phoenix can more easily be installed. Maybe https://issues.apache.org/jira/browse/HBASE-8400 would help? I propose we move the discussion to those JIRAs. On 06/01/2013 11:15 AM, Michael Segel wrote: > Well, > > What happens when you restart the RS? > > Suppose I'm running a scan on a completely different table and you restart the RS? > What happens to me? > > I havent thought through the whole problem, but you need to put each table's CP in to its own sandbox. > (There's more to it and would require some pizza, beer and a very large whiteboard....) > > > On Jun 1, 2013, at 5:44 AM, Andrew Purtell wrote: > >> Isn't the time to restart and the steps necessary more or less the same? Or >> will the objects that hold the in memory state survive across the reload? >> Will they still share a classloader (maintain equality tests)? What if the >> implementation / bundle version changes? We are taking about an upgrade >> scenario. Will we need to dump and restore in memory state to local disk, >> pickle the state of an earlier version and have the latest version >> unpickle, fixing up as needed? What happens if that fails midway? >> The JITted code for the old bundle is unused and GCed now that the bundle >> is upgraded, so we have to wait for runtime profiling and C2 to crunch the >> bytecode again for the new bundle. Will all that need more time than just >> restating a JVM ? Am I missing a simpler way? >> >> On Saturday, June 1, 2013, Michel Segel wrote: >> >>>> Is there a benefit to restarting a regionserver in an OSGi container >>> versus >>>> restarting a Java process? >>> Was that rhetorical? >>> >>> Absolutely. >>> Think of a production environment where you are using HBase to serve data >>> in real time. >>> >>> >>> Sent from a remote device. Please excuse any typos... >>> >>> Mike Segel >>> >>> On May 24, 2013, at 4:50 PM, Andrew Purtell > >>> wrote: >>> >>>> On Thu, May 23, 2013 at 5:10 PM, James Taylor >>>> wrote: >>>> >>>>> Has there been any discussions on running the HBase server in an OSGi >>>>> container? >>>> >>>> I believe the only discussions have been on avoiding talk about >>> coprocessor >>>> reloading, as it implies either a reimplementation of or taking on an >>> OSGi >>>> runtime. >>>> >>>> Is there a benefit to restarting a regionserver in an OSGi container >>> versus >>>> restarting a Java process? >>>> >>>> Or would that work otherwise like an update the coprocessor and filters >>> in >>>> the container then trigger the embedded regionserver to do a quick close >>>> and reopen of the regions? >>>> >>>> -- >>>> Best regards, >>>> >>>> - Andy >>>> >>>> Problems worthy of attack prove their worth by hitting back. - Piet Hein >>>> (via Tom White) >> >> -- >> Best regards, >> >> - Andy >> >> Problems worthy of attack prove their worth by hitting back. - Piet Hein >> (via Tom White)