Return-Path: X-Original-To: apmail-hbase-user-archive@www.apache.org Delivered-To: apmail-hbase-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 9908F7C22 for ; Sun, 17 Jul 2011 01:11:17 +0000 (UTC) Received: (qmail 90041 invoked by uid 500); 17 Jul 2011 01:11:16 -0000 Delivered-To: apmail-hbase-user-archive@hbase.apache.org Received: (qmail 89928 invoked by uid 500); 17 Jul 2011 01:11:15 -0000 Mailing-List: contact user-help@hbase.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hbase.apache.org Delivered-To: mailing list user@hbase.apache.org Received: (qmail 89920 invoked by uid 99); 17 Jul 2011 01:11:15 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Sun, 17 Jul 2011 01:11:15 +0000 X-ASF-Spam-Status: No, hits=-0.7 required=5.0 tests=FREEMAIL_FROM,RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of saint.ack@gmail.com designates 209.85.210.47 as permitted sender) Received: from [209.85.210.47] (HELO mail-pz0-f47.google.com) (209.85.210.47) by apache.org (qpsmtpd/0.29) with ESMTP; Sun, 17 Jul 2011 01:11:08 +0000 Received: by pzk36 with SMTP id 36so2806993pzk.6 for ; Sat, 16 Jul 2011 18:10:47 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=references:in-reply-to:mime-version:content-transfer-encoding :content-type:message-id:cc:x-mailer:from:subject:date:to; bh=T97/X83gdswqQKxYANQEsHOVLbihw5zrzqmJnJpVGQQ=; b=YxAHTdoJ3fC+rzcNSQJXWoD87d1DGtzL+DND8TtNsKXjEySPOrJTzpI1/ax2nn3Y6Z XuBLJrkVWuj86bgpx/JQKRoZEz7JYUXTjOuZ6YKa/J8/IcTnyVlWeeChD29uWoZJw0/x 6wZscmIz6vwWToWySffaF0trxuNpgBRIX8HVU= Received: by 10.68.31.10 with SMTP id w10mr6451972pbh.339.1310865046961; Sat, 16 Jul 2011 18:10:46 -0700 (PDT) Received: from [192.168.1.124] (adsl-71-141-108-57.dsl.snfc21.pacbell.net [71.141.108.57]) by mx.google.com with ESMTPS id m7sm1554131pbk.38.2011.07.16.18.10.45 (version=TLSv1/SSLv3 cipher=OTHER); Sat, 16 Jul 2011 18:10:46 -0700 (PDT) References: In-Reply-To: Mime-Version: 1.0 (iPhone Mail 8J2) Content-Transfer-Encoding: 7bit Content-Type: text/plain; charset=us-ascii Message-Id: Cc: "user@hbase.apache.org" X-Mailer: iPhone Mail (8J2) From: Stack Subject: Re: hbase table as a queue. Date: Sat, 16 Jul 2011 18:10:41 -0700 To: "user@hbase.apache.org" X-Virus-Checked: Checked by ClamAV on apache.org Yes. I should have mentioned this. Thanks Ted. On Jul 16, 2011, at 17:52, Ted Dunning wrote: > Up to a pretty high transaction rate, you can simply use Zookeeper, > especially if you check out a block of tasks at once. > > With blocks of 100-1000, you should be able to handle a million events per > second with very simple ZK data structures. > > On Sat, Jul 16, 2011 at 1:24 PM, Stack wrote: > >> Do not use locks. Doesn't scale. Maybe update a cell when task is >> taken out for processing. If too much time elapses since last update, >> maybe give it out again? >>