Return-Path: X-Original-To: apmail-hbase-user-archive@www.apache.org Delivered-To: apmail-hbase-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 83604D242 for ; Wed, 29 Aug 2012 02:16:56 +0000 (UTC) Received: (qmail 33908 invoked by uid 500); 29 Aug 2012 02:16:54 -0000 Delivered-To: apmail-hbase-user-archive@hbase.apache.org Received: (qmail 33867 invoked by uid 500); 29 Aug 2012 02:16:54 -0000 Mailing-List: contact user-help@hbase.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hbase.apache.org Delivered-To: mailing list user@hbase.apache.org Received: (qmail 33858 invoked by uid 99); 29 Aug 2012 02:16:54 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 29 Aug 2012 02:16:54 +0000 X-ASF-Spam-Status: No, hits=-0.7 required=5.0 tests=FSL_RCVD_USER,RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of yuzhihong@gmail.com designates 209.85.160.41 as permitted sender) Received: from [209.85.160.41] (HELO mail-pb0-f41.google.com) (209.85.160.41) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 29 Aug 2012 02:16:46 +0000 Received: by pbbro12 with SMTP id ro12so264013pbb.14 for ; Tue, 28 Aug 2012 19:16:26 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=references:in-reply-to:mime-version:content-transfer-encoding :content-type:message-id:cc:x-mailer:from:subject:date:to; bh=08PCC0FEGOWp8C3Bj1CVMKhQgRjCOIb9R40er5DT0h4=; b=aInPfEkKWEyCH8U37S3dEebOjPDezKppBzevhzZZrvoYDF2jmBfjrVcqK3UoxbcgQX acscVkHjs8GYMTPmxJt/itGBaqScknDxevi8Q82V2V0aQhWCmqUBAZh5FM4PiOQdGYpF twk0QHfpAxJo9Q5g2lcmLh2rqdm5YSsdCS2CxNUlnZCCZohCRCbnHc/sN8cRlc/uFYRb cWw8ddd6tveuJzDF4smwBKAYe0nH0uwsCIO09yiVCw+iqS1di4XORZ81CIhepVwRZOXr 8aUEGVzgGzpVdiF5SCTjVSl2xJ5XYfVvnCgQj0+wMMBladp0MFvz2BXD0ReCDmfl/Eod lhuQ== Received: by 10.66.76.231 with SMTP id n7mr41585603paw.68.1346206586532; Tue, 28 Aug 2012 19:16:26 -0700 (PDT) Received: from [10.234.178.116] (135.sub-174-253-243.myvzw.com. [174.253.243.135]) by mx.google.com with ESMTPS id ud8sm12406693pbc.35.2012.08.28.19.16.22 (version=TLSv1/SSLv3 cipher=OTHER); Tue, 28 Aug 2012 19:16:25 -0700 (PDT) References: In-Reply-To: Mime-Version: 1.0 (1.0) Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset=GB2312 Message-Id: <2CB44630-B45A-4897-A7BE-8A4AD9C1126A@gmail.com> Cc: "user@hbase.apache.org" X-Mailer: iPhone Mail (9A405) From: yuzhihong@gmail.com Subject: Re: PIG with HBase Coprocessors Date: Tue, 28 Aug 2012 19:16:14 -0700 To: "user@hbase.apache.org" X-Virus-Checked: Checked by ClamAV on apache.org Did you find some clue from region server logs ? You can pastebin snippet and show the link here.=20 On Aug 28, 2012, at 6:54 PM, =C4=B3=D2=F2=E1=A6 wrote: > Ping? >=20 > 2012/8/28 =C4=B3=D2=F2=E1=A6 : >> Thanks for your quick reply. >> The co-processor looks like: >> public void postGet(final ObserverContext e= , >> final Get get, final List results) >> { >> if table is X >> get some columns from table Y >> add these columns to results >> } >> And similar for postScannerNext(). >> This works in HBase JRuby shell using get/scan plus heavy performance los= s. >>=20 >> And the versions are: >> Hadoop 1.0.3 >> HBase 0.92.1 >> Pig 0.9.2 >>=20 >>=20 >> 2012/8/27 Ted Yu : >>> Allow me to refer to previous discussion: >>> http://mail-archives.apache.org/mod_mbox/hbase-user/201203.mbox/%3CCABsY= 1jQ8+OiLh7SYkXZ8iO=3DNosY8khz7iYs+6W4u6SxCpJ5s9g@mail.gmail.com%3E >>>=20 >>> If the above doesn't answer your question, please give us more details >>> about the versions of HBase and PIG you're using. >>>=20 >>> On Mon, Aug 27, 2012 at 3:42 AM, =C4=B3=D2=F2=E1=A6 = wrote: >>>=20 >>>> Hi, >>>> I've created a co-processor which will insert more columns in the >>>> result by overriding preGet and postScannerNext. >>>> And it is registered as a system co-processor, works with hbase shell, >>>> both get and scan. >>>> When I tried to access those columns in PIG, it simply returns null >>>> for the column. >>>> Is there something more to be done? >>>>=20 >>>>=20 >>>> -- >>>> language: Chinese, Japanese, English >>>>=20 >>=20 >>=20 >>=20 >> -- >> language: Chinese, Japanese, English >=20 >=20 >=20 > --=20 > language: Chinese, Japanese, English