Mailing-List: contact dev-help@camel.apache.org; run by ezmlm
Precedence: bulk
Reply-To: dev@camel.apache.org
Received-SPF: pass (nike.apache.org: domain of rfbringer@gmail.com designates
 209.85.212.45 as permitted sender)
MIME-Version: 1.0
Date: Mon, 26 Nov 2012 06:55:55 +0900
Message-ID: 
 <CAE7rsZ49DMhYbODwi1f9iHt3=8k07i7V1d7_W+xzybxDaAc+Zg@mail.gmail.com>
Subject: [camel-hbase]camel-hbase component performance improvement
From: Sotaro Kimura <rfbringer@gmail.com>
To: dev@camel.apache.org
Content-Type: multipart/mixed; boundary=20cf307c9c7c9a4a4004cf58e1c9

--20cf307c9c7c9a4a4004cf58e1c9
Content-Type: text/plain; charset=ISO-8859-1

Hi, all.

I'm testing hbase client using camel-hbase component.
But in this test, data put performance is low.
( about 20 put operation / second, I use Core i7 2700K machine.)

I confirmed performance bottleneck.
And I find bottleneck below

- Everytime camel-hbase component put data,
  camel-hbase component creates and closes HTableInterface.
- But HTableInterface create cost is high.
   So camel-hbase component performance is low.

I modified HBaseProducer using HTablePool,
data put performance is improved 20 operetion/second to 200 operation/second.

Modified source is below( and attach patchfile.txt)
-HBaseProducer.java(orig)
----------------------------
103        } finally {
104            table.close();
105        }
----------------------------

-HBaseProducer.java(improved)
----------------------------
103        } finally {
104            tablePool.putTable(table);
105        }
----------------------------

What should I do for contribution it.

regards.

-- 
#################################
Sotaro Kimura
<rfbringer@gmail.com>
#################################

--20cf307c9c7c9a4a4004cf58e1c9
Content-Type: text/plain; charset=US-ASCII; name="patchfile.txt"
Content-Disposition: attachment; filename="patchfile.txt"
Content-Transfer-Encoding: base64
X-Attachment-Id: f_h9yowisx0

LS0tIEhCYXNlUHJvZHVjZXIuamF2YS5vcmlnCTIwMTItMTAtMTEgMTI6MjM6NDAuMDAwMDAwMDAw
ICswOTAwCisrKyBIQmFzZVByb2R1Y2VyLmphdmEJMjAxMi0xMS0yNiAwNjoyOTowOS4wMDAwMDAw
MDAgKzA5MDAKQEAgLTEwMSw3ICsxMDEsNyBAQAogICAgICAgICAgICAgICAgIG1hcHBpbmdTdHJh
dGVneS5hcHBseVNjYW5SZXN1bHRzKGV4Y2hhbmdlLmdldE91dCgpLCBuZXcgSEJhc2VEYXRhKHNj
YW5PcGVyYXRpb25SZXN1bHQpKTsKICAgICAgICAgICAgIH0KICAgICAgICAgfSBmaW5hbGx5IHsK
LSAgICAgICAgICAgIHRhYmxlLmNsb3NlKCk7CisgICAgICAgICAgICB0YWJsZVBvb2wucHV0VGFi
bGUodGFibGUpOwogICAgICAgICB9CiAgICAgfQogCg==
--20cf307c9c7c9a4a4004cf58e1c9--