crunch-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Micah Whitacre (JIRA)" <>
Subject [jira] [Created] (CRUNCH-478) Support TableSnapshotInputFormat
Date Mon, 20 Oct 2014 02:44:33 GMT
Micah Whitacre created CRUNCH-478:

             Summary: Support TableSnapshotInputFormat
                 Key: CRUNCH-478
             Project: Crunch
          Issue Type: Improvement
          Components: IO
            Reporter: Micah Whitacre
            Assignee: Micah Whitacre

With HBase 0.98, HBase now supports MR over HBase snapshots instead of active tables.[1] 
This looks to have significant performance impacts.   One thing that will be different about
this sort of I/O is that we will probably not have "target" support but instead only Source.
 HBase snapshots do a lot with how the files are stored/tracked such that it wouldn't really
make sense to support generating a snapshot.

[1] -

This message was sent by Atlassian JIRA

View raw message