hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Owen O'Malley (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HIVE-6060) Define API for RecordUpdater and UpdateReader
Date Wed, 05 Mar 2014 05:17:43 GMT

     [ https://issues.apache.org/jira/browse/HIVE-6060?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Owen O'Malley updated HIVE-6060:
--------------------------------

    Attachment: h-6060.patch

This patch puts everything together:
* Defines AcidInputFormat and AcidOutputFormat.
* Extends OrcInputFormat and OrcOutputFormat to implement them.
* Creates AcidUtils to figure out which base and deltas need to be read.
* Provides raw interfaces that the compactor uses to re-write small files.
* Moves ValidTxnList and ValidTxnListImpl to common where they can be used by code in mapreduce
tasks and the metastore.
* Adds an interface to Orc Writers that provides callbacks when stripes are being written.
* Adds a method to Orc Writers that allow the client to write the current stripe to disk and
writes a temporary footer before the writer continues to write new stripes.

> Define API for RecordUpdater and UpdateReader
> ---------------------------------------------
>
>                 Key: HIVE-6060
>                 URL: https://issues.apache.org/jira/browse/HIVE-6060
>             Project: Hive
>          Issue Type: Sub-task
>            Reporter: Owen O'Malley
>            Assignee: Owen O'Malley
>         Attachments: acid-io.patch, h-5317.patch, h-5317.patch, h-5317.patch, h-6060.patch,
h-6060.patch
>
>
> We need to define some new APIs for how Hive interacts with the file formats since it
needs to be much richer than the current RecordReader and RecordWriter.



--
This message was sent by Atlassian JIRA
(v6.2#6252)

Mime
View raw message