hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Anoop Sam John (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HBASE-14511) StoreFile.Writer Meta Plugin
Date Mon, 05 Oct 2015 05:19:26 GMT

    [ https://issues.apache.org/jira/browse/HBASE-14511?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14942936#comment-14942936
] 

Anoop Sam John commented on HBASE-14511:
----------------------------------------

Very useful jira
bq.String[] classNameList = classesStr.split(",");
Can use conf.getStrings()

bq.plugin.config(conf);
Better we can manadate All plugins to have a constructor with conf and pass it on construction?
Can use ReflectionUtil for object creation then.



> StoreFile.Writer Meta Plugin
> ----------------------------
>
>                 Key: HBASE-14511
>                 URL: https://issues.apache.org/jira/browse/HBASE-14511
>             Project: HBase
>          Issue Type: New Feature
>            Reporter: Vladimir Rodionov
>            Assignee: Vladimir Rodionov
>         Attachments: HBASE-14511.v1.patch, HBASE-14511.v2.patch
>
>
> During my work on a new compaction policies (HBASE-14468, HBASE-14477) I had to modify
the existing code of a StoreFile.Writer to add additional meta-info required by these new
 policies. I think that it should be done by means of a new Plugin framework, because this
seems to be a general capability/feature. 
> As a future enhancement this can become a part of a more general StoreFileWriter/Reader
plugin architecture. But I need only Meta section of a store file.
> This could be used, for example, to collect rowkeys distribution information during hfile
creation. This info can be used later to find the optimal region split key or to create optimal
set of sub-regions for M/R jobs or other jobs which can operate on a sub-region level.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message