hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Alan Gates (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HIVE-7078) Need file sink operators that work with ACID
Date Thu, 04 Sep 2014 15:44:51 GMT

     [ https://issues.apache.org/jira/browse/HIVE-7078?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Alan Gates updated HIVE-7078:
-----------------------------
    Attachment: HIVE-7078.patch

This patch changes FileSinkOperator to be aware of ACID operations and use RecordUpdater instead
of RecordWriter in these instances.

> Need file sink operators that work with ACID
> --------------------------------------------
>
>                 Key: HIVE-7078
>                 URL: https://issues.apache.org/jira/browse/HIVE-7078
>             Project: Hive
>          Issue Type: Sub-task
>          Components: Query Processor, Transactions
>            Reporter: Alan Gates
>            Assignee: Alan Gates
>         Attachments: HIVE-7078.WIP.patch, HIVE-7078.patch
>
>
> When writing records to tables that use an OutputFormat that implements AcidOutputFormat,
records will need to be written via a RecordUpdater instead of RecordWriter.  
> Rather than add this functionality to FileSinkOperator and VectorizedFileSinkOperator
I propose to add a new AcidFileSinkOperator that extends FileSinkOperator and a new AcidVectorizedFileSinkOperator
that extends VectorizedFileSinkOperator.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message