hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ryan rawson (JIRA)" <j...@apache.org>
Subject [jira] Commented: (HBASE-2368) BulkPut - Writable class compatible with TableRecordWriter for bulk puts agnostic of region server mapping at Mapper/Combiner level
Date Thu, 25 Mar 2010 00:19:27 GMT

    [ https://issues.apache.org/jira/browse/HBASE-2368?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12849546#action_12849546
] 

ryan rawson commented on HBASE-2368:
------------------------------------

one thing to keep in mind is we do not offer atomic guarantees for multiple rows or API calls.
 Suggesting that we do would be contrary to the actual situation on the ground.

Maybe Kay Kay can describe the specific performance problem he is having and we can come up
with a great way that makes everyone happy?

> BulkPut - Writable class  compatible with TableRecordWriter for bulk puts agnostic of
region server mapping at Mapper/Combiner level
> ------------------------------------------------------------------------------------------------------------------------------------
>
>                 Key: HBASE-2368
>                 URL: https://issues.apache.org/jira/browse/HBASE-2368
>             Project: Hadoop HBase
>          Issue Type: Improvement
>          Components: client
>            Reporter: Kay Kay
>             Fix For: 0.21.0
>
>         Attachments: HBASE-2368.patch
>
>
> TableRecordWriter currently accepts only a put/delete as writables. Some mapper processes
might want to consolidate the 'put's and insert them in bulk. Useful in combiners / mappers
- to send across a bunch of puts from one stage to another , while maintaining a very similar
region-server-mapping agnostic api at respective levels. 
> New type - BulkPut ( Writable ) introduced that is just a consolidation of Puts.  Eventually
, the TableRecordWriter bulk inserts the puts together into the hbase eco-system. 
> Patch made against trunk only. But since , it does not break any backward compatibility
- it can be an useful addition to the branch as well. 
> Let me know your comments on the same. 

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message