hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Alan Gates (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-14870) OracleStore: RawStore implementation optimized for Oracle
Date Sat, 10 Dec 2016 00:50:58 GMT

    [ https://issues.apache.org/jira/browse/HIVE-14870?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15736848#comment-15736848
] 

Alan Gates commented on HIVE-14870:
-----------------------------------

Do you have code you could post showing the OracleStore?  Obviously it won't be ready for
inclusion but it would be helpful to see it.

Did you consider using array types to store things like columns and parameters?  I know this
will decrease portability since every database does collection types differently (and some
don't do them at all), but it would also remove additional calls or joins from a number of
operations.

Did you do any experimentation on the trade offs of duplicating data versus performance? 
For example, one could play with storing a storage descriptor in the partition or table object.
 Or serdes inside of a storage descriptor, etc.  This would obviously grow the amount of data
in the metastore but again reduce the number of calls or joins to fetch data.

> OracleStore: RawStore implementation optimized for Oracle
> ---------------------------------------------------------
>
>                 Key: HIVE-14870
>                 URL: https://issues.apache.org/jira/browse/HIVE-14870
>             Project: Hive
>          Issue Type: Improvement
>          Components: Metastore
>            Reporter: Chris Drome
>            Assignee: Chris Drome
>         Attachments: OracleStoreDesignProposal.pdf
>
>
> The attached document is a proposal for a RawStore implementation which is optimized
for Oracle and replaces DataNucleus. The document outlines schema changes, OracleStore implementation
details, and performance tests against ObjectStore, ObjectStore+DirectSQL, and OracleStore.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message