hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Brock Noland (JIRA)" <>
Subject [jira] [Commented] (HIVE-7926) long-lived daemons for query fragment execution, I/O and caching
Date Tue, 16 Sep 2014 19:43:35 GMT


Brock Noland commented on HIVE-7926:


I noted that LLAP is turned on by default in the branch. When the work merged to trunk, I
think it should be disabled by default until it reaches maturity. I understand it's *very*
early and that you are working on a branch so please don't feel the need to act on this immediately.

> long-lived daemons for query fragment execution, I/O and caching
> ----------------------------------------------------------------
>                 Key: HIVE-7926
>                 URL:
>             Project: Hive
>          Issue Type: New Feature
>            Reporter: Sergey Shelukhin
>            Assignee: Sergey Shelukhin
>         Attachments: LLAPdesigndocument.pdf
> We are proposing a new execution model for Hive that is a combination of existing process-based
tasks and long-lived daemons running on worker nodes. These nodes can take care of efficient
I/O, caching and query fragment execution, while heavy lifting like most joins, ordering,
etc. can be handled by tasks.
> The proposed model is not a 2-system solution for small and large queries; neither it
is a separate execution engine like MR or Tez. It can be used by any Hive execution engine,
if support is added; in future even external products (e.g. Pig) can use it.
> The document with high-level design we are proposing will be attached shortly.

This message was sent by Atlassian JIRA

View raw message