hadoop-hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Jeff Hammerbacher (JIRA)" <j...@apache.org>
Subject [jira] Commented: (HIVE-1541) More general dataflow execution backend
Date Sat, 14 Aug 2010 23:51:20 GMT

    [ https://issues.apache.org/jira/browse/HIVE-1541?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12898654#action_12898654
] 

Jeff Hammerbacher commented on HIVE-1541:
-----------------------------------------

In particular, it would be nice to avoid the startup overhead of Hadoop MapReduce with this
backend.

> More general dataflow execution backend
> ---------------------------------------
>
>                 Key: HIVE-1541
>                 URL: https://issues.apache.org/jira/browse/HIVE-1541
>             Project: Hadoop Hive
>          Issue Type: New Feature
>            Reporter: Jeff Hammerbacher
>
> With the recent open source release of Mesos (http://github.com/mesos/mesos), experimentation
at the query execution layer has become more feasible. Inspired by more general-purpose dataflow
systems like Volcano, Dryad, and Dremel, it would be interesting to explore a more general-purpose
dataflow execution system for Hive queries. One potential backend is the Hyracks project from
UCI: http://code.google.com/p/hyracks.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message