Return-Path: Delivered-To: apmail-hadoop-hbase-dev-archive@minotaur.apache.org Received: (qmail 84391 invoked from network); 7 Feb 2009 20:36:30 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.2) by minotaur.apache.org with SMTP; 7 Feb 2009 20:36:30 -0000 Received: (qmail 71339 invoked by uid 500); 7 Feb 2009 20:36:30 -0000 Delivered-To: apmail-hadoop-hbase-dev-archive@hadoop.apache.org Received: (qmail 71314 invoked by uid 500); 7 Feb 2009 20:36:30 -0000 Mailing-List: contact hbase-dev-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: hbase-dev@hadoop.apache.org Delivered-To: mailing list hbase-dev@hadoop.apache.org Received: (qmail 71303 invoked by uid 99); 7 Feb 2009 20:36:30 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Sat, 07 Feb 2009 12:36:30 -0800 X-ASF-Spam-Status: No, hits=2.2 required=10.0 tests=HTML_MESSAGE,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of saint.ack@gmail.com designates 209.85.132.249 as permitted sender) Received: from [209.85.132.249] (HELO an-out-0708.google.com) (209.85.132.249) by apache.org (qpsmtpd/0.29) with ESMTP; Sat, 07 Feb 2009 20:36:21 +0000 Received: by an-out-0708.google.com with SMTP id d14so513525and.29 for ; Sat, 07 Feb 2009 12:36:00 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:mime-version:sender:received:in-reply-to :references:date:x-google-sender-auth:message-id:subject:from:to :content-type; bh=9mgCblOTGlrs4KDJrblHLCVs6bSmC/ZQ7hUmSW/Y4OE=; b=xl+z8wC23o4Wx7EfHv3r0ekjGUo8gscEcpf6pjCDj+33WtSu9mHol/q8FRjW2w/uA4 Pq1/G0SzdMETRUBydGYnya+3zhC+GJ997dVqxjoNxarW5PQWGzBbMEZoQoTB3ETmX9xw hL4sBiFklHcPtwuOWAJG8NBqDlTUKhXHsbF9g= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=mime-version:sender:in-reply-to:references:date :x-google-sender-auth:message-id:subject:from:to:content-type; b=LdOLLR/imcjJjJBxPqM4Vkb1AF+8pQIIRiBhaV5CDbkGuDZpJVLFbnaetd4u3TGwPi fLg17pn1EWvKtXdMPeEuGLi6fB7zY170Lv1CJE74KOGcpq4eEzwr/mdd2UZ3d9sm/u8B elTLy7MoIZTiF93grGfrFb34ZFfoMfAShZy9I= MIME-Version: 1.0 Sender: saint.ack@gmail.com Received: by 10.100.126.15 with SMTP id y15mr1961084anc.38.1234038960165; Sat, 07 Feb 2009 12:36:00 -0800 (PST) In-Reply-To: <91397.89414.qm@web65509.mail.ac4.yahoo.com> References: <853272.19024.qm@web65513.mail.ac4.yahoo.com> <91397.89414.qm@web65509.mail.ac4.yahoo.com> Date: Sat, 7 Feb 2009 12:36:00 -0800 X-Google-Sender-Auth: 1f4299f0aa2b22fe Message-ID: <7c962aed0902071236r5da2563eve651b826eff080d4@mail.gmail.com> Subject: Re: HADOOP-3856 From: stack To: hbase-dev@hadoop.apache.org, apurtell@apache.org Content-Type: multipart/alternative; boundary=0016e64615b0dc132404625a15d4 X-Virus-Checked: Checked by ClamAV on apache.org --0016e64615b0dc132404625a15d4 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit Did you see in the hadoop issue where Raghu talks of grizzly mayhaps been better suited because it has more accomodating community and its written more to the datanode level? Would suggest keeping Raghu in the loop. Perhaps by posting intermediary patches up against the hadoop issue. I can help pre-review patches and with testing. You are a good man Andrew Purtell. St.Ack On Fri, Feb 6, 2009 at 11:00 AM, Andrew Purtell wrote: > So it looks like a complete rewrite of the datanode network I/O > in the async model is necessary. I don't want to invest the time > if in the end it isn't enough to significantly affect HBase > stability in a positive way. > > Blocking in disk I/O will be out of scope. > > - Andy > > > > From: Andrew Purtell > > > > I have started work on this. The plan is to use selectable > > channels (set to blocking mode), a work queue, and a pool of > > worker threads to handle xceiver connections. > [...] > > However, it may be necessary to go fully async > [...] > > > > > --0016e64615b0dc132404625a15d4--