hbase-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Gowtam Lal (JIRA)" <j...@apache.org>
Subject [jira] [Created] (HBASE-14833) HFileOutputFormat2 should allow for custom reducer logic
Date Wed, 18 Nov 2015 19:59:11 GMT
Gowtam Lal created HBASE-14833:

             Summary: HFileOutputFormat2 should allow for custom reducer logic
                 Key: HBASE-14833
                 URL: https://issues.apache.org/jira/browse/HBASE-14833
             Project: HBase
          Issue Type: Improvement
          Components: API, mapreduce
            Reporter: Gowtam Lal
            Priority: Minor

Right now, HFileOutputFormat2.configureIncrementalLoad() will configure a ReducerClass which
takes all input and passes it through to be written to an HFile. Unfortunately, this prevents
a user from plugging in his or her own logic for the Reduce phase. 

TableMapReduceUtil.initTableReducerJob() accepts a custom ReducerClass, allowing users to
operate on the tuples coming out of the MapperClass before they're written to output. Could
HFileOutputFormat2.configureIncrementalLoad() possibly do something similar?

This message was sent by Atlassian JIRA

View raw message