hbase-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Andrew Purtell (JIRA)" <j...@apache.org>
Subject [jira] Commented: (HBASE-794) Language neutral IPC as a first class component of HBase architecture
Date Sat, 02 May 2009 04:39:31 GMT

    [ https://issues.apache.org/jira/browse/HBASE-794?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12705224#action_12705224
] 

Andrew Purtell commented on HBASE-794:
--------------------------------------

Interesting head to head testing results here:

http://www.eishay.com/2009/03/more-on-benchmarking-java-serialization.html

But, I want retest using the latest trunk from both the protobuf and Thrift trees (I have
that also), using Bryan's recommendations for Thrift: TCompactProtocol, FramedTransport, and
THsHaServer. Also, comparisons for the HBase antcipiated use case of first class integration,
which in this context means all IPC/RPC between master, regionservers, and clients, not just
as a client access option:
* Insert of single BatchUpdate
* Insert of a batch of BatchUpdate
* Fetch single RowResult (equiv to scan with batching of 1 RowResult)
* Scan with batching of 30 RowResult
* Transactional table / secondary index transactions

This is why this issue lingers. We should either make a simulator or do direct addition of
test code on the master, regionservers, and client library that supports real actions. My
feeling is ultimately the latter option is the better one. Recently I had been waiting for
all of the architectural changes to the regionserver -- e.g. KeyValue -- to settle, and have
otherwise not had the available personal time. Both of those considerations have now changed.



> Language neutral IPC as a first class component of HBase architecture
> ---------------------------------------------------------------------
>
>                 Key: HBASE-794
>                 URL: https://issues.apache.org/jira/browse/HBASE-794
>             Project: Hadoop HBase
>          Issue Type: New Feature
>          Components: client, ipc, master, regionserver
>            Reporter: Andrew Purtell
>            Assignee: Andrew Purtell
>            Priority: Minor
>
> This issue considers making a language neutral IPC mechanism and wire format a first
class component of HBase architecture. Clients could talk to the master and regionserver using
this protocol instead of HRPC at their option.
> Options for language neutral IPC include:
> * Thrift: http://incubator.apache.org/thrift/
> * Protocol buffers: http://code.google.com/p/protobuf/
> * XDR: http://en.wikipedia.org/wiki/External_Data_Representation

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message