hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Vaibhav Gumashta (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-5092) Fix hiveserver2 mapreduce local job on Windows
Date Thu, 24 Apr 2014 06:45:16 GMT

    [ https://issues.apache.org/jira/browse/HIVE-5092?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13979359#comment-13979359
] 

Vaibhav Gumashta commented on HIVE-5092:
----------------------------------------

bq. There is no way to pass environment variable in hiveserver2.xml (weird but reality).

[~hsubramaniyan] [~shanyu] I'm a little unclear about this. From what I understand, hive.cmd
will generate a hiveserver2.xml file with the appropriate classpath in it, which services.msc
will read before starting the HiveServer2 service. Is there no way to read HADOOP_CLASSPATH
and add it to hiveserver2.xml from hive.cmd? 

> Fix hiveserver2 mapreduce local job on Windows
> ----------------------------------------------
>
>                 Key: HIVE-5092
>                 URL: https://issues.apache.org/jira/browse/HIVE-5092
>             Project: Hive
>          Issue Type: Bug
>          Components: HiveServer2, Windows
>            Reporter: Daniel Dai
>            Assignee: Hari Sankar Sivarama Subramaniyan
>         Attachments: HIVE-5092-1.patch, HIVE-5092.2.patch, HIVE-5092.3.patch
>
>
> Hiveserver2 fail on Mapreduce local job fail. For example:
> {code}
> select /*+ MAPJOIN(v) */ registration from studenttab10k s join votertab10k v on (s.name
= v.name);
> {code}
> The root cause is "class not found" in the local hadoop job (MapredLocalTask.execute).
HADOOP_CLASSPATH does not include $HIVE_HOME/lib. Set HADOOP_CLASSPATH correctly will fix
the issue.
> However, there is one complexity in Windows. We start Hiveserver2 using Windows service
console (services.msc), which takes hiveserver2.xml generated by hive.cmd. There is no way
to pass environment variable in hiveserver2.xml (weird but reality). I attach a patch which
pass it through command line arguments and relay to HADOOP_CLASSPATH in Hive code. 



--
This message was sent by Atlassian JIRA
(v6.2#6252)

Mime
View raw message