Return-Path: X-Original-To: apmail-hbase-user-archive@www.apache.org Delivered-To: apmail-hbase-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id DC157C1D2 for ; Mon, 14 May 2012 14:02:53 +0000 (UTC) Received: (qmail 55318 invoked by uid 500); 14 May 2012 14:02:52 -0000 Delivered-To: apmail-hbase-user-archive@hbase.apache.org Received: (qmail 55194 invoked by uid 500); 14 May 2012 14:02:52 -0000 Mailing-List: contact user-help@hbase.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hbase.apache.org Delivered-To: mailing list user@hbase.apache.org Received: (qmail 55186 invoked by uid 99); 14 May 2012 14:02:52 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 14 May 2012 14:02:52 +0000 X-ASF-Spam-Status: No, hits=-0.7 required=5.0 tests=RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of brock@cloudera.com designates 209.85.214.169 as permitted sender) Received: from [209.85.214.169] (HELO mail-ob0-f169.google.com) (209.85.214.169) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 14 May 2012 14:02:45 +0000 Received: by obbwd18 with SMTP id wd18so12030106obb.14 for ; Mon, 14 May 2012 07:02:25 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=20120113; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :content-type:content-transfer-encoding:x-gm-message-state; bh=gctTo7xqoseeTLG/4Xk6BmzsSKoFkg2wNsYqWL9KipQ=; b=DFj29+jqOHpcXFfozRP+Uo5MG4NggBdD6XmBw5U9Uc41mNt/lu8XGd2Zc+pc2nGe2I CQ6VgvP3Na7oUy8QGP2WffNY3VfoGBDTrcioEQ+O6DNvFwDSyVy1/ukt1tdVIQfFvoY3 IgYNWVO6jC6xu51jkaqamFIlfpPgphe83KjNUKKiqKNKSxAnH+jA+pkmUgkBK/fevjPH 2ftAAU4wZGwx6vZ9u0jq2lVFUKUiVUWNRbmmP3h2Peg1hBxSqgl17m2Twizo4zSod/mf 7FH3Ntcbvn0wykAVlrIQp/7k5LzApLnDxyjVZ6E8XmK4CsVVSm/2L3cB2NgJb4+Ixi5h 3qlQ== Received: by 10.182.149.9 with SMTP id tw9mr12292391obb.45.1337004145255; Mon, 14 May 2012 07:02:25 -0700 (PDT) MIME-Version: 1.0 Received: by 10.182.88.74 with HTTP; Mon, 14 May 2012 07:02:05 -0700 (PDT) In-Reply-To: References: From: Brock Noland Date: Mon, 14 May 2012 09:02:05 -0500 Message-ID: Subject: Re: from JMS into HBase To: user@hbase.apache.org Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable X-Gm-Message-State: ALoCoQk8CoAmhZtG2yXWhLVlojpfDWjjd8E/1MziGpj8HL7tjTJMXfOQrBVsSx2bIbhfYev4N1pU X-Virus-Checked: Checked by ClamAV on apache.org Hi, Sounds like a project for Flume: http://incubator.apache.org/flume/ I don't know the if the HBase Sink/JMS Source is committed yet but this sounds like an ideal use case for them. Disclaimer, I am a committer on Flume. Brock On Mon, May 14, 2012 at 7:17 AM, Faruk Berks=F6z wrote= : > Dear All, > > our hadoop cluster has 1 nn , 3 dd.Evey nodes has 1 TB hard disk and 4 GB > memory. > > Hadoop version is CDH3. > > We are trying to load some records (one record has approx. 250 bytes) fro= m > many jms queues into a hbase table. > > Is It possible to load records (For example 1.000.000 records in a second= ) > from many JMS queues into a HBase Table. > > What is the fastest way to do that ? > > > > Regards > > Faruk, --=20 Apache MRUnit - Unit testing MapReduce - http://incubator.apache.org/mrunit= /