hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Shannon Ladymon (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-7926) long-lived daemons for query fragment execution, I/O and caching
Date Tue, 26 Jul 2016 00:05:20 GMT

    [ https://issues.apache.org/jira/browse/HIVE-7926?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15392890#comment-15392890
] 

Shannon Ladymon commented on HIVE-7926:
---------------------------------------

[~asears], thank you for creating the LLAP page and adding in an overview description of it.
 I've gone ahead and copied the rest of the design document into it as well as made some edits
to the overview:
* [ LLAP | https://cwiki.apache.org/confluence/display/Hive/LLAP]

The page will need to be revised since it still reads like a design document and is missing
a few sections, but it's a start.

[~sershe] and Andrew, feel free to make any modifications you'd like to what I added today
to fix/clarify the information.

> long-lived daemons for query fragment execution, I/O and caching
> ----------------------------------------------------------------
>
>                 Key: HIVE-7926
>                 URL: https://issues.apache.org/jira/browse/HIVE-7926
>             Project: Hive
>          Issue Type: New Feature
>            Reporter: Sergey Shelukhin
>            Assignee: Sergey Shelukhin
>              Labels: TODOC2.0
>             Fix For: 2.0.0
>
>         Attachments: LLAPdesigndocument.pdf
>
>
> We are proposing a new execution model for Hive that is a combination of existing process-based
tasks and long-lived daemons running on worker nodes. These nodes can take care of efficient
I/O, caching and query fragment execution, while heavy lifting like most joins, ordering,
etc. can be handled by tasks.
> The proposed model is not a 2-system solution for small and large queries; neither it
is a separate execution engine like MR or Tez. It can be used by any Hive execution engine,
if support is added; in future even external products (e.g. Pig) can use it.
> The document with high-level design we are proposing will be attached shortly.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message