crunch-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Micah Whitacre (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (CRUNCH-387) Add support for mulitple HBase Scans on a single Source
Date Mon, 19 May 2014 21:27:39 GMT

    [ https://issues.apache.org/jira/browse/CRUNCH-387?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14002423#comment-14002423
] 

Micah Whitacre commented on CRUNCH-387:
---------------------------------------

It was added to the 0.96 (and higher) as well as the 0.94.x code stream for HBase but it might
require me to upgrade from 0.8's current 0.94.3 version.  Would that be an issue?  Looks like
0.94.5 would be the minimum[1] however I believe they are up to 0.94.15 as far as fix versions.
 I was hoping to get it into both code streams.

[1] - https://issues.apache.org/jira/browse/HBASE-3996

> Add support for mulitple HBase Scans on a single Source
> -------------------------------------------------------
>
>                 Key: CRUNCH-387
>                 URL: https://issues.apache.org/jira/browse/CRUNCH-387
>             Project: Crunch
>          Issue Type: Improvement
>          Components: IO
>            Reporter: Micah Whitacre
>            Assignee: Micah Whitacre
>         Attachments: CRUNCH-387.patch
>
>
> HBase recently added a new input format that supports multiple scan objects.[1]  We should
be able to change HBaseSourceTarget and FromHBase to support varargs on Scans to enable this
functionality.  
> [1] - https://hbase.apache.org/0.94/apidocs/org/apache/hadoop/hbase/mapreduce/MultiTableInputFormat.html



--
This message was sent by Atlassian JIRA
(v6.2#6252)

Mime
View raw message