hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "li xiang (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HBASE-14548) Expand how table coprocessor jar and dependency path can be specified
Date Mon, 27 Jun 2016 07:19:52 GMT

     [ https://issues.apache.org/jira/browse/HBASE-14548?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel

li xiang updated HBASE-14548:
    Attachment: HBASE-14548-1.2.0-v0.patch

The very first path is uploaded, to add the support of 
(1) specify a folder on HDFS, such as /user/hbase/
(2) wildcard, such as /user/hbase/*.jarå
I tested both based on HBase 1.2.0

The logic is 
1. For the path pattern specified, check if it is directory or not.
(1) If it is a directory, modify the pattern to append "*.jar". Patch v0 hardcodes to only
care about jar file if a directory is specified
(2) if it is not, keep pattern as it is
2. Use FileSystem.globStatus() to get all paths matching the pattern
3. For each path, do as before

> Expand how table coprocessor jar and dependency path can be specified
> ---------------------------------------------------------------------
>                 Key: HBASE-14548
>                 URL: https://issues.apache.org/jira/browse/HBASE-14548
>             Project: HBase
>          Issue Type: Improvement
>          Components: Coprocessors
>            Reporter: Jerry He
>            Assignee: li xiang
>         Attachments: HBASE-14548-1.2.0-v0.patch
> Currently you can specify the location of the coprocessor jar in the table coprocessor
> The problem is that it only allows you to specify one jar that implements the coprocessor.
 You will need to either bundle all the dependencies into this jar, or you will need to copy
the dependencies into HBase lib dir.
> The first option may not be ideal sometimes.  The second choice can be troublesome too,
particularly when the hbase region sever node and dirs are dynamically added/created.
> There are a couple things we can expand here.  We can allow the coprocessor attribute
to specify a directory location, probably on hdfs.
> We may even allow some wildcard in there.

This message was sent by Atlassian JIRA

View raw message