hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Joydeep Sen Sarma (JIRA)" <>
Subject [jira] Commented: (HIVE-566) support for submitting jobs to Elastic mapreduce cluster
Date Wed, 17 Jun 2009 14:48:08 GMT


Joydeep Sen Sarma commented on HIVE-566:

as a side-note - we will not be able to create tables over hdfs (at this moment) when using
EMR (at least going by the public documentation). all the tables (whether tmp or not) and
target directories will have to be in s3. however hive will be able to use hdfs to store intermediate
data when chaining map-reduce jobs.

> support for submitting jobs to Elastic mapreduce cluster
> --------------------------------------------------------
>                 Key: HIVE-566
>                 URL:
>             Project: Hadoop Hive
>          Issue Type: New Feature
>          Components: Query Processor
>            Reporter: Joydeep Sen Sarma
> EMR allows job submission to a cluster spawned by EMR via a webservices api or a ruby
client (currently). See
> Hive cli (or services) can submit jobs to EMR by using a command line just like MapRedTask
currently does for local mode execution. It should be possible to configure hive to use this
mode for job submission as well as configure any additional required EMR parameters.

This message is automatically generated by JIRA.
You can reply to this email to add a comment to the issue online.

View raw message