Return-Path: X-Original-To: apmail-hbase-user-archive@www.apache.org Delivered-To: apmail-hbase-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 929D4985D for ; Thu, 8 Mar 2012 20:39:19 +0000 (UTC) Received: (qmail 78364 invoked by uid 500); 8 Mar 2012 20:39:11 -0000 Delivered-To: apmail-hbase-user-archive@hbase.apache.org Received: (qmail 78204 invoked by uid 500); 8 Mar 2012 20:39:10 -0000 Mailing-List: contact user-help@hbase.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hbase.apache.org Delivered-To: mailing list user@hbase.apache.org Received: (qmail 78154 invoked by uid 99); 8 Mar 2012 20:39:08 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 08 Mar 2012 20:39:08 +0000 X-ASF-Spam-Status: No, hits=2.2 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_NONE,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: local policy) Received: from [98.138.90.83] (HELO nm20.bullet.mail.ne1.yahoo.com) (98.138.90.83) by apache.org (qpsmtpd/0.29) with SMTP; Thu, 08 Mar 2012 20:39:00 +0000 Received: from [98.138.90.51] by nm20.bullet.mail.ne1.yahoo.com with NNFMP; 08 Mar 2012 20:38:39 -0000 Received: from [98.138.89.168] by tm4.bullet.mail.ne1.yahoo.com with NNFMP; 08 Mar 2012 20:38:39 -0000 Received: from [127.0.0.1] by omp1024.mail.ne1.yahoo.com with NNFMP; 08 Mar 2012 20:38:39 -0000 X-Yahoo-Newman-Property: ymail-3 X-Yahoo-Newman-Id: 319876.34723.bm@omp1024.mail.ne1.yahoo.com Received: (qmail 74446 invoked by uid 60001); 8 Mar 2012 20:38:39 -0000 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s1024; t=1331239119; bh=xayh2eZPguaJbebizpowfXm0u12AMcyuurdKb2NY8kg=; h=X-YMail-OSG:Received:X-Mailer:References:Message-ID:Date:From:Reply-To:Subject:To:In-Reply-To:MIME-Version:Content-Type; b=Ww5obdBy6kz3FiR9GPILvWxByRyIT4gvDQYL3RlgmNLsQ2OIbd9ZHo/T8k2MrSEL8fXxUsa5AqNH9wcX3FaqkcqXsQ4HdH5Qg5KsrsirIe3lzGncgsHT6NXOst4S6Ri/CUPODqGh87MQejsK4JxAM6XVsKWRA1h7bCx8SoXL1BE= DomainKey-Signature: a=rsa-sha1; q=dns; c=nofws; s=s1024; d=yahoo.com; h=X-YMail-OSG:Received:X-Mailer:References:Message-ID:Date:From:Reply-To:Subject:To:In-Reply-To:MIME-Version:Content-Type; b=GjTxQr8CbU2W/S7M09fuUpzDtBbjdKpu9/Lk/dZlWw6gYD9wTIyeqsCtKp/16ih6gI5jQsUBTo+0IFwvM0FIbKEQL/jegU9kz0G1wDbe9ZR/b1SHq7rbHPXjCCrcq0SluPkTN1K49WRBkVKHAkQ98p6wZhkwSVKAM7j3wuaBtiY=; X-YMail-OSG: Tgu28XIVM1kU63shh7__OGZs056jslr2jzBCYrWwUKQXYFq f5dhjm47uz8OUfkvreH48HQ54amCmocPZlzHkAXJcnKNVVysqi4Et1LoJ5FS ITzKXTpKomGCadj4sfyNpi1bMSaYOBiJQ6QzurGUAlof7ZWNRb4oe4DclPfK myCaU3ZpINbfHAEnQDMov1BQYHsg3zoVWP1PfhpzdockbVzSoqgzK_nESOOC uPgcx1g.RIf_rNIFv2eX7A_be9PJxFXFoUItYdL1NbX841NBAxG1X1cN7W8A zQW.ptssyxrb9rCzY_qmVNuyWKoDPVMgFuhRPkKQfKsUMCJ01j_lFjtL0O0E LtRxcf.R_woAY7RkEQ.xy4KPLy4l5Hd0KaUDDecRe9dMnKMHOUosoOmWG25q 4eCyy1u8ibtHDxTLys7OIFQuMKEUSa8AXzTKwguinAfWkq0epCRW2StIdczX fG6_LSU7F7fjD__CMAaFHFNnlQ4FOUCnZLufk8CXXwFz5TcgBhGqjUjbeEHA 2xlp0detM0Nl9vqe1HlY3si3edZWVqkLb Received: from [69.181.180.38] by web121703.mail.ne1.yahoo.com via HTTP; Thu, 08 Mar 2012 12:38:38 PST X-Mailer: YahooMailWebService/0.8.116.338427 References: <1331232961.67605.YahooMailNeo@web164501.mail.gq1.yahoo.com> Message-ID: <1331239118.73963.YahooMailNeo@web121703.mail.ne1.yahoo.com> Date: Thu, 8 Mar 2012 12:38:38 -0800 (PST) From: lars hofhansl Reply-To: lars hofhansl Subject: Re: Coprocessor execution with bulk data To: "user@hbase.apache.org" , Andrew Purtell In-Reply-To: <1331232961.67605.YahooMailNeo@web164501.mail.gq1.yahoo.com> MIME-Version: 1.0 Content-Type: multipart/alternative; boundary="1001534069-1803669202-1331239118=:73963" X-Virus-Checked: Checked by ClamAV on apache.org --1001534069-1803669202-1331239118=:73963 Content-Type: text/plain; charset=iso-8859-1 Content-Transfer-Encoding: quoted-printable +1 on "keepalive". It's a shame (especially for long running server code) t= o do all the work,=0Ajust to find out at the end that the client has given = up.=0A=0AOr maybe there should be a way to cancel an operation if the clien= ts decides it does not want to wait any longer (PostgreSQL does that for ex= ample).=0AHere that would mean the server would need to check periodically = and coprocessors would need to be written to support that - so maybe that's= no-starter.=0A=0A=0Aasync RPC would be great too. asynchbase is a good exa= mple of such an API.=0A=0A=0A-- Lars=0A=0A=0A=0A___________________________= _____=0A From: Andrew Purtell =0ATo: "user@hbase.apach= e.org" =0ASent: Thursday, March 8, 2012 10:56 AM=0A= Subject: Re: Coprocessor execution with bulk data=0A =0AYou can increase th= e RPC timeout period to keep this from happening.=0A=0ABut maybe it makes s= ense to give our RPC a "keepalive" option for calls that may run for a long= time (like execCoprocessor)? =0A=0A=0AOr fold this into a broader rework i= nto a proper async RPC model.=0A=A0=0ABest regards,=0A=0A=0A=A0 =A0 - Andy= =0A=0AProblems worthy of attack prove their worth by hitting back. - Piet H= ein (via Tom White)=0A=0A=0A=0A----- Original Message -----=0A> From: Stack= =0A> To: user@hbase.apache.org=0A> Cc: =0A> Sent: Thursd= ay, March 8, 2012 9:14 AM=0A> Subject: Re: Coprocessor execution with bulk = data=0A> =0A> On Wed, Mar 7, 2012 at 10:59 PM, raghavendhra rahul=0A> wrote:=0A>>=A0 2012-03-08 12:03:09,475 WARN org.ap= ache.hadoop.ipc.HBaseServer: IPC Server=0A>>=A0 Responder, call execCoproce= ssor([B@50cb21, getProjection(), rpc version=3D1,=0A>>=A0 client version=3D= 0, methodsFingerPrint=3D0), rpc version=3D1, client version=3D29,=0A>>=A0 m= ethodsFingerPrint=3D54742778 from 10.184.17.26:46472: output error=0A>>=A0 = 2012-03-08 12:03:09,476 WARN org.apache.hadoop.ipc.HBaseServer: IPC Server= =0A>>=A0 handler 7 on 60020 caught: java.nio.channels.ClosedChannelExceptio= n=0A> =0A> =0A> Usually this means the client has gone away perhaps because= the=0A> processing was taking longer than the rpctimeout?=A0 Does the abov= e=0A> happen every time?=0A> =0A> St.Ack=0A> --1001534069-1803669202-1331239118=:73963--