hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Keren Ouaknine (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-1107) Generic parallel execution framework for Hive (and Pig, and ...)
Date Sun, 09 Sep 2012 12:23:07 GMT

    [ https://issues.apache.org/jira/browse/HIVE-1107?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13451584#comment-13451584
] 

Keren Ouaknine commented on HIVE-1107:
--------------------------------------

Thanks Bertrand, once we have the MR job out of Algebricks we can add YARN compatibility at
some point. The advantage being there's one plan to support rather than one for each query
language.

we implemented Pig2Algebricks for a join query and also wrote up the design for Algebricks2MR.
Design details, details on: http://www.kereno.com/gp/2012/09/09/convert-algebricks-to-mr-design-and-implementation/
Currently working on its implementation.

Ahmed, thanks for the link to 4495. Will keep on tracking this Jira.

                
> Generic parallel execution framework for Hive (and Pig, and ...)
> ----------------------------------------------------------------
>
>                 Key: HIVE-1107
>                 URL: https://issues.apache.org/jira/browse/HIVE-1107
>             Project: Hive
>          Issue Type: New Feature
>          Components: Query Processor
>            Reporter: Carl Steinbach
>
> Pig and Hive each have their own libraries for handling plan execution. As we prepare
to invest more time improving Hive's plan execution mechanism we should also start to consider
ways of building a generic plan execution mechanism that is capable of supporting the needs
of Hive and Pig, as well as other Hadoop data flow programming environments. 

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message