hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ramkrishna.s.vasudevan (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HBASE-18649) Deprecate KV Usage in MR to move to Cells in 3.0
Date Wed, 04 Oct 2017 09:13:00 GMT

     [ https://issues.apache.org/jira/browse/HBASE-18649?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

ramkrishna.s.vasudevan updated HBASE-18649:
-------------------------------------------
    Release Note: 
All the mappers and reducers output type will be now of MapReduceCell type. No more KeyValue
type. How ever in branch-2 for compatibility we have allowed the older interfaces/classes
that work with KeyValue to stay in the code base but they have been marked as deprecated.

The following interfaces/classes have been deprecated in branch-2
Import#KeyValueWritableComparablePartitioner
Import#KeyValueWritableComparator
Import#KeyValueWritableComparable
Import#KeyValueReducer
Import#KeyValueSortImporter
Import#KeyValueImporter
KeyValueSortReducer
KeyValueSerialization
WALPlayer#WALKeyValueMapper

So any existing MR jobs that is using the above public interfaces/classes will continue to
work in branch-2 and the expected output value type of those mappers and reducers can continue
to be KeyValue type.

In branch-3 the mappers and reducers output will only expect MapReduceCell as the type and
will no longer work with KeyValue type.
The new public classes/interfaces added for branch-3 and in branch-2 are
CellSerialization
CellSortReducer
Import#CellWritableComparablePartitioner
Import#CellWritableComparable
Import#CellWritableComparator
Import#CellReducer
Import#CellSortImporter
Import#CellImporter
WALPlayer#WALCellMapper

> Deprecate KV Usage in MR to move to Cells in 3.0
> ------------------------------------------------
>
>                 Key: HBASE-18649
>                 URL: https://issues.apache.org/jira/browse/HBASE-18649
>             Project: HBase
>          Issue Type: Improvement
>          Components: API, mapreduce
>    Affects Versions: 2.0.0-alpha-2
>            Reporter: ramkrishna.s.vasudevan
>            Assignee: ramkrishna.s.vasudevan
>             Fix For: 2.0.0-beta-1
>
>         Attachments: HBASE-18649-branch-2_1.patch, HBASE-18649-branch-2_2.patch, HBASE-18649_branch-2.patch,
HBASE-18649-branch-2.patch, HBASE-18649_master_2.patch, HBASE-18649_master_3.patch, HBASE-18649_master_5.patch,
HBASE-18649_master_6.patch, HBASE-18649_master_6.patch, HBASE-18649_master.patch
>
>




--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Mime
View raw message