hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Eugene Koifman (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-5547) webhcat pig job submission should ship hive tar if -usehcatalog is specified
Date Wed, 23 Oct 2013 22:24:45 GMT

    [ https://issues.apache.org/jira/browse/HIVE-5547?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13803454#comment-13803454
] 

Eugene Koifman commented on HIVE-5547:
--------------------------------------

This works with Pig 12.  Pig 11 is looking for jdo2 library which is not part of Hive tar
file (Hive 13)

> webhcat pig job submission should ship hive tar if -usehcatalog is specified
> ----------------------------------------------------------------------------
>
>                 Key: HIVE-5547
>                 URL: https://issues.apache.org/jira/browse/HIVE-5547
>             Project: Hive
>          Issue Type: Bug
>          Components: WebHCat
>    Affects Versions: 0.12.0
>            Reporter: Eugene Koifman
>            Assignee: Eugene Koifman
>         Attachments: HIVE-5547.2.patch, HIVE-5547.patch
>
>
> Currently when when a Pig job is submitted through WebHCat and the Pig script uses HCatalog,
that means that Hive should be installed on the node in the cluster which ends up executing
the job.  For large clusters is this a manageability issue so we should use DistributedCache
to ship the Hive tar file to the target node as part of job submission
> TestPig_11 in hcatalog/src/test/e2e/templeton/tests/jobsubmission.conf has the test case
for this



--
This message was sent by Atlassian JIRA
(v6.1#6144)

Mime
View raw message