hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Sergey Shelukhin (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-9729) LLAP: design and implement proper metadata cache
Date Fri, 13 Mar 2015 02:03:38 GMT

    [ https://issues.apache.org/jira/browse/HIVE-9729?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14359786#comment-14359786
] 

Sergey Shelukhin commented on HIVE-9729:
----------------------------------------

Most of this is now committed, need to add some more tests (q file passes)

> LLAP: design and implement proper metadata cache
> ------------------------------------------------
>
>                 Key: HIVE-9729
>                 URL: https://issues.apache.org/jira/browse/HIVE-9729
>             Project: Hive
>          Issue Type: Sub-task
>            Reporter: Sergey Shelukhin
>            Assignee: Sergey Shelukhin
>             Fix For: llap
>
>
> Simple approach: add external priorities to data cache, read metadata parts of orc file
into it. Advantage: simple; consistent management (no need to coordinate sizes and eviction
between data and metadata caches, etc); disadvantage - have to decode every time.
> Maybe add decoded metadata cache on top - fixed size, small and opportunistic? Or some
other approach.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message