hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Lefty Leverenz (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-5728) Make ORC InputFormat/OutputFormat usable outside Hive
Date Sat, 09 Aug 2014 22:07:12 GMT

    [ https://issues.apache.org/jira/browse/HIVE-5728?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14091923#comment-14091923
] 

Lefty Leverenz commented on HIVE-5728:
--------------------------------------

This added four configuration parameters to HiveConf.java in 0.13.0.

*  *hive.exec.orc.default.row.index.stride*
*  *hive.exec.orc.default.buffer.size*
*  *hive.exec.orc.default.block.padding*
*  *hive.exec.orc.default.compress*

Note that the first parameter the patch changes just adds a line break -- *hive.exec.orc.dictionary.key.size.threshold*
was added by HIVE-4324 in 0.12.0.

The four new parameters are documented in the wiki here:

* [Configuration Properties -- hive.exec.orc.default.row.index.stride | https://cwiki.apache.org/confluence/display/Hive/Configuration+Properties#ConfigurationProperties-hive.exec.orc.default.row.index.stride]

* [Configuration Properties -- hive.exec.orc.default.buffer.size | https://cwiki.apache.org/confluence/display/Hive/Configuration+Properties#ConfigurationProperties-hive.exec.orc.default.buffer.size]

* [Configuration Properties -- hive.exec.orc.default.block.padding | https://cwiki.apache.org/confluence/display/Hive/Configuration+Properties#ConfigurationProperties-hive.exec.orc.default.block.padding]

* [Configuration Properties -- hive.exec.orc.default.compress | https://cwiki.apache.org/confluence/display/Hive/Configuration+Properties#ConfigurationProperties-hive.exec.orc.default.compress]

> Make ORC InputFormat/OutputFormat usable outside Hive
> -----------------------------------------------------
>
>                 Key: HIVE-5728
>                 URL: https://issues.apache.org/jira/browse/HIVE-5728
>             Project: Hive
>          Issue Type: Improvement
>          Components: File Formats
>            Reporter: Daniel Dai
>            Assignee: Daniel Dai
>             Fix For: 0.13.0
>
>         Attachments: HIVE-5728-1.patch, HIVE-5728-10.patch, HIVE-5728-2.patch, HIVE-5728-3.patch,
HIVE-5728-4.patch, HIVE-5728-5.patch, HIVE-5728-6.patch, HIVE-5728-7.patch, HIVE-5728-8.patch,
HIVE-5728-9.patch, HIVE-5728.10.patch, HIVE-5728.11.patch, HIVE-5728.12.patch, HIVE-5728.13.patch
>
>
> ORC InputFormat/OutputFormat is currently not usable outside Hive. There are several
issues need to solve:
> 1. Several class is not public, eg: OrcStruct
> 2. There is no InputFormat/OutputFormat for new api (Some tools such as Pig need new
api)
> 3. Has no way to push WriteOption to OutputFormat outside Hive



--
This message was sent by Atlassian JIRA
(v6.2#6252)

Mime
View raw message