Return-Path: X-Original-To: apmail-hbase-dev-archive@www.apache.org Delivered-To: apmail-hbase-dev-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 14A1C10174 for ; Sun, 10 Nov 2013 05:44:41 +0000 (UTC) Received: (qmail 82780 invoked by uid 500); 10 Nov 2013 05:44:39 -0000 Delivered-To: apmail-hbase-dev-archive@hbase.apache.org Received: (qmail 82332 invoked by uid 500); 10 Nov 2013 05:44:34 -0000 Mailing-List: contact dev-help@hbase.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@hbase.apache.org Delivered-To: mailing list dev@hbase.apache.org Received: (qmail 82324 invoked by uid 99); 10 Nov 2013 05:44:32 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Sun, 10 Nov 2013 05:44:32 +0000 X-ASF-Spam-Status: No, hits=1.5 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of vladrodionov@gmail.com designates 74.125.82.43 as permitted sender) Received: from [74.125.82.43] (HELO mail-wg0-f43.google.com) (74.125.82.43) by apache.org (qpsmtpd/0.29) with ESMTP; Sun, 10 Nov 2013 05:44:27 +0000 Received: by mail-wg0-f43.google.com with SMTP id n12so532095wgh.34 for ; Sat, 09 Nov 2013 21:44:06 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type; bh=Ha7u0Ioglb/9waGdBitw2yfO/bARSRJcQoHRes/llAc=; b=BYJJWVh9SnLjiQ7bgIw3AM5JIZYorwtNSoU01+spyRMaTuWNm2z2WuTyrlgyLoBohY cy+Dz11+eemihRwYmhSGjJHZx8kw6FaeTc/fY1QRqEUbkNicyy7mu9qTJQJi/koq6VhL cEZwGmY6zMEARqNLgWs6rBmMwSBpewRvHr4VGKEkF4Uove6FpXsItdxoqe2eHepJtKd9 /ULGFDbniPasd+1IMQA30rR/nY6FaRptbWGhk8BxZj+BIp3PG069/uPD/xjsL3JXfPG2 DR5RNfb7agIX9hD6TLRLe9zKHFhaDbJuTXf98Le259OTfm3y8MnJkxiLJhIQ85JbcwxI nbhQ== MIME-Version: 1.0 X-Received: by 10.180.73.9 with SMTP id h9mr2009399wiv.26.1384062246885; Sat, 09 Nov 2013 21:44:06 -0800 (PST) Received: by 10.217.128.145 with HTTP; Sat, 9 Nov 2013 21:44:06 -0800 (PST) In-Reply-To: <1384050881.13692359@apps.rackspace.com> References: <1384043054.338531290@apps.rackspace.com> <1384050881.13692359@apps.rackspace.com> Date: Sat, 9 Nov 2013 21:44:06 -0800 Message-ID: Subject: Re: problems with theUnsafe From: Vladimir Rodionov To: "dev@hbase.apache.org" Content-Type: multipart/alternative; boundary=f46d043c7f2692a1c304eacc1ac0 X-Virus-Checked: Checked by ClamAV on apache.org --f46d043c7f2692a1c304eacc1ac0 Content-Type: text/plain; charset=ISO-8859-1 Interesting, it seems that you are the first user who is trying HBase (0.94.7) on IBM JRE. Which version of IBM JRE are you using? Unsafe MUST be supported by IBM JRE in Java 6. On Sat, Nov 9, 2013 at 6:34 PM, wrote: > > I don't have access to the system at the moment (SE 6 RHEL 64-bit). > Basically, invoking a client Get operation causes the app server / JRE to > core dump. I wasn't able to find any specific IBM bug associated with this > behavior, but their issue tracking is not exactly transparent. I don't > think that this will work: > > try { } catch(CoreDump) { :D } > > Avro and others allow explicit avoidance: > > if("false".equals(System.getProperty("hbase.disable.unsafe", "false")) > //attempt unsafe impl > else > //use pure impl > > An alternative might be to whitelist java.vendor. > > However, I think the explicit solution is better than trying to be too > clever. > > -----Original Message----- > From: "Ted Yu" > Sent: Saturday, November 9, 2013 8:28pm > To: "dev@hbase.apache.org" > Subject: Re: problems with theUnsafe > > > > bq. The IBM JRE supplies Unsafe, but apparently it doesn't work > > Can you give us a bit more detail (in this case, UnsafeComparer) ? Is there > a BUG associated with it ? > > If there is a known procedure / test by which we can tell whether > UnsafeComparer > works or not, that would help make the decision of switching to pure Java > comparer. > > Cheers > > > On Sat, Nov 9, 2013 at 4:24 PM, wrote: > > > > > Our WebSphere Application Server started core dumping immediately after > we > > merged our hbase feature branch to our mainline. I've tracked this down > to > > Bytes use of theUnsafe. The IBM JRE supplies Unsafe, but apparently it > > doesn't work worth a damn. I managed to temporarily work "around" the > > issue using some AOP wizardry. Would it be possible to add some property > > check to the static initializer to allow one to explicitly opt for the > pure > > Java comparer? > > > > > > > http://grepcode.com/file/repo1.maven.org/maven2/org.apache.hbase/hbase/0.94.7/org/apache/hadoop/hbase/util/Bytes.java#Bytes.LexicographicalComparerHolder.getBestComparer%28%29 > > > > thanks, > > > > -Jess > --f46d043c7f2692a1c304eacc1ac0--