hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Owen O'Malley (JIRA)" <>
Subject [jira] [Updated] (HIVE-6060) Define API for RecordUpdater and UpdateReader
Date Wed, 05 Mar 2014 05:17:43 GMT


Owen O'Malley updated HIVE-6060:

    Attachment: h-6060.patch

This patch puts everything together:
* Defines AcidInputFormat and AcidOutputFormat.
* Extends OrcInputFormat and OrcOutputFormat to implement them.
* Creates AcidUtils to figure out which base and deltas need to be read.
* Provides raw interfaces that the compactor uses to re-write small files.
* Moves ValidTxnList and ValidTxnListImpl to common where they can be used by code in mapreduce
tasks and the metastore.
* Adds an interface to Orc Writers that provides callbacks when stripes are being written.
* Adds a method to Orc Writers that allow the client to write the current stripe to disk and
writes a temporary footer before the writer continues to write new stripes.

> Define API for RecordUpdater and UpdateReader
> ---------------------------------------------
>                 Key: HIVE-6060
>                 URL:
>             Project: Hive
>          Issue Type: Sub-task
>            Reporter: Owen O'Malley
>            Assignee: Owen O'Malley
>         Attachments: acid-io.patch, h-5317.patch, h-5317.patch, h-5317.patch, h-6060.patch,
> We need to define some new APIs for how Hive interacts with the file formats since it
needs to be much richer than the current RecordReader and RecordWriter.

This message was sent by Atlassian JIRA

View raw message