hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Gowtam Lal (JIRA)" <j...@apache.org>
Subject [jira] [Created] (HBASE-14833) HFileOutputFormat2 should allow for custom reducer logic
Date Wed, 18 Nov 2015 19:59:11 GMT
Gowtam Lal created HBASE-14833:
----------------------------------

             Summary: HFileOutputFormat2 should allow for custom reducer logic
                 Key: HBASE-14833
                 URL: https://issues.apache.org/jira/browse/HBASE-14833
             Project: HBase
          Issue Type: Improvement
          Components: API, mapreduce
            Reporter: Gowtam Lal
            Priority: Minor


Right now, HFileOutputFormat2.configureIncrementalLoad() will configure a ReducerClass which
takes all input and passes it through to be written to an HFile. Unfortunately, this prevents
a user from plugging in his or her own logic for the Reduce phase. 

TableMapReduceUtil.initTableReducerJob() accepts a custom ReducerClass, allowing users to
operate on the tuples coming out of the MapperClass before they're written to output. Could
HFileOutputFormat2.configureIncrementalLoad() possibly do something similar?



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message