hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Prasanth Jayachandran (JIRA)" <j...@apache.org>
Subject [jira] [Created] (HIVE-12498) ACID: Setting OrcRecordUpdater.OrcOptions.tableProperties() has no effect
Date Mon, 23 Nov 2015 21:33:11 GMT
Prasanth Jayachandran created HIVE-12498:
--------------------------------------------

             Summary: ACID: Setting OrcRecordUpdater.OrcOptions.tableProperties() has no effect
                 Key: HIVE-12498
                 URL: https://issues.apache.org/jira/browse/HIVE-12498
             Project: Hive
          Issue Type: Bug
    Affects Versions: 1.3.0, 2.0.0
            Reporter: Prasanth Jayachandran
            Assignee: Prasanth Jayachandran


OrcRecordUpdater does not honor the  OrcRecordUpdater.OrcOptions.tableProperties()  setting.
 
It would need to translate the specified tableProperties (as listed in OrcTableProperties
enum)  to the properties that OrcWriter internally understands (listed in HiveConf.ConfVars).

This is needed for multiple clients.. like Streaming API and Compactor.

{noformat}
    Properties orcTblProps = ..   // get Orc Table Properties from MetaStore;
    AcidOutputFormat.Options updaterOptions =   new OrcRecordUpdater.OrcOptions(conf)
                                                     .inspector(..)
                                                     .bucket(..)
                                                     .minimumTransactionId(..)
                                                     .maximumTransactionId(..)
                                                     .tableProperties(orcTblProps); // <<==

    OrcOutputFormat orcOutput =   new ...
    orcOutput.getRecordUpdater(partitionPath, updaterOptions );

{noformat}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message