Return-Path: X-Original-To: apmail-hbase-user-archive@www.apache.org Delivered-To: apmail-hbase-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 6959175DA for ; Tue, 27 Dec 2011 23:31:35 +0000 (UTC) Received: (qmail 26073 invoked by uid 500); 27 Dec 2011 23:31:33 -0000 Delivered-To: apmail-hbase-user-archive@hbase.apache.org Received: (qmail 26040 invoked by uid 500); 27 Dec 2011 23:31:33 -0000 Mailing-List: contact user-help@hbase.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hbase.apache.org Delivered-To: mailing list user@hbase.apache.org Received: (qmail 26032 invoked by uid 99); 27 Dec 2011 23:31:33 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 27 Dec 2011 23:31:33 +0000 X-ASF-Spam-Status: No, hits=-0.7 required=5.0 tests=RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of saint.ack@gmail.com designates 209.85.214.169 as permitted sender) Received: from [209.85.214.169] (HELO mail-tul01m020-f169.google.com) (209.85.214.169) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 27 Dec 2011 23:31:27 +0000 Received: by obcwo8 with SMTP id wo8so10153001obc.14 for ; Tue, 27 Dec 2011 15:31:06 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=mime-version:sender:in-reply-to:references:date :x-google-sender-auth:message-id:subject:from:to:content-type; bh=2QXdquoaujcy2TavNB+zEx93ZvBT1klmlfHK3abPKl8=; b=GzUNZFOH9mrAVQhnuHniQgJGYAbO7p/Fbnu7grz4MJv9FfvW6s9o/dGyaonmRIfCpP OdSOtx/oY+0zn3R/0P1rKfeQxey8JUQ6JHazX0to51nQTuwhV+FgaV/0K13TtX37b+lf iT2s6rX0cvzwWu6Qyt52qnugByjYjROcrEXDU= MIME-Version: 1.0 Received: by 10.182.13.42 with SMTP id e10mr26736373obc.18.1325028666781; Tue, 27 Dec 2011 15:31:06 -0800 (PST) Sender: saint.ack@gmail.com Received: by 10.182.246.99 with HTTP; Tue, 27 Dec 2011 15:31:06 -0800 (PST) In-Reply-To: References: Date: Tue, 27 Dec 2011 15:31:06 -0800 X-Google-Sender-Auth: w6bMM2DbLguheTKThootEt0I9As Message-ID: Subject: Re: Thrift Architecture - Try #2 From: Stack To: user@hbase.apache.org Content-Type: text/plain; charset=ISO-8859-1 On Tue, Dec 27, 2011 at 7:12 AM, Bob Smith wrote: > Am I thinking about the Thrift client-server setup for HBase correctly? > Yes. > Does this seem like a good approach? If I have, say, a few dozen Thrift > server instances for a thousand users, will the requests through the 90XX > sockets block and buffer correctly so the Thrift servers will be pooled in > the eyes of the C/C++ processes? Thanks for any help you can provide. > Should work. Our frontend, SU's, which is php, gets to backend hbase cluster via thrift. There are 'thousands' of connections from the front-end into the cluster. You can scale the thriftserver layer with load independing of your middle-tier and hbase cluster scaling. Run the thrift servers on the middle-tier servers or on the hbase cluster nodes. The thing to watch out for is lack-of-bounds on thrift thread count but this has been fixed in hbase TRUNK IIRC (if you can't find issue, ask and will dig). St.Ack