ambari-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Dmitry Lysnichenko (JIRA)" <j...@apache.org>
Subject [jira] [Resolved] (AMBARI-9821) Need to update HIVE_AUX_JARS_PATH in hive-env.sh
Date Thu, 26 Feb 2015 19:35:04 GMT

     [ https://issues.apache.org/jira/browse/AMBARI-9821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Dmitry Lysnichenko resolved AMBARI-9821.
----------------------------------------
    Resolution: Fixed

Committed to trunk and to branch-2.0.0

> Need to update HIVE_AUX_JARS_PATH in hive-env.sh
> ------------------------------------------------
>
>                 Key: AMBARI-9821
>                 URL: https://issues.apache.org/jira/browse/AMBARI-9821
>             Project: Ambari
>          Issue Type: Bug
>          Components: ambari-server
>    Affects Versions: 1.7.0
>            Reporter: Dmitry Lysnichenko
>            Assignee: Dmitry Lysnichenko
>             Fix For: 2.0.0
>
>
>  Hivecli fails to start after upgrade of HDP 2.1 to HDP 2.2.
> {code}
> After upgrading to HDP 2.2, hive fails to start with the following errors:
> > hive 
> 15/02/17 11:07:32 WARN conf.HiveConf: HiveConf of name hive.optimize.mapjoin.mapreduce
does not exist 
> 15/02/17 11:07:32 WARN conf.HiveConf: HiveConf of name hive.heapsize does not exist 
> 15/02/17 11:07:32 WARN conf.HiveConf: HiveConf of name hive.metastore.direct.sql.batch.size
does not exist 
> 15/02/17 11:07:32 WARN conf.HiveConf: HiveConf of name hive.server2.enable.impersonation
does not exist 
> 15/02/17 11:07:32 WARN conf.HiveConf: HiveConf of name hive.semantic.analyzer.factory.impl
does not exist 
> 15/02/17 11:07:32 WARN conf.HiveConf: HiveConf of name hive.auto.convert.sortmerge.join.noconditionaltask
does not exist
> Logging initialized using configuration in file:/etc/hive/conf/hive-log4j.properties

> SLF4J: Class path contains multiple SLF4J bindings. 
> SLF4J: Found binding in jar:file:/usr/hdp/2.2.0.0-2041/hadoop/lib/slf4j-log4j12-1.7.5.jar!/org/slf4j/impl/StaticLoggerBinder.class

> SLF4J: Found binding in jar:file:/usr/hdp/2.2.0.0-2041/hive/lib/hive-jdbc-0.14.0.2.2.0.0-2041-standalone.jar!/org/slf4j/impl/StaticLoggerBinder.class

> SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation. 
> SLF4J: Actual binding is of type org.slf4j.impl.Log4jLoggerFactory
> Exception in thread "main" java.lang.RuntimeException: java.io.IOException: Previous
writer likely failed to write hdfs://host1:8020/tmp/hive/v800493/_tez_session_dir/e40df1ce-d258-4a14-844f-d6c39b2d60cf/hive-hcatalog-core-*.jar.
Failing because I am unlikely to write too. Exception in thread "main" java.lang.RuntimeException:
java.io.IOException: Previous writer likely failed to write hdfs://host1:8020/tmp/hive/v800493/_tez_session_dir/e40df1ce-d258-4a14-844f-d6c39b2d60cf/hive-hcatalog-core-*.jar.
Failing because I am unlikely to write too. 
> at org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.java:457) 
> at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:672) 
> at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:616) 
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) 
> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) 
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)

> at java.lang.reflect.Method.invoke(Method.java:606) 
> at org.apache.hadoop.util.RunJar.run(RunJar.java:221) 
> at org.apache.hadoop.util.RunJar.main(RunJar.java:136) 
> Caused by: java.io.IOException: Previous writer likely failed to write hdfs://host1:8020/tmp/hive/v800493/_tez_session_dir/e40df1ce-d258-4a14-844f-d6c39b2d60cf/hive-hcatalog-core-*.jar.
Failing because I am unlikely to write too. Caused by: java.io.IOException: Previous writer
likely failed to write hdfs://host1:8020/tmp/hive/v800493/_tez_session_dir/e40df1ce-d258-4a14-844f-d6c39b2d60cf/hive-hcatalog-core-*.jar.
Failing because I am unlikely to write too. 
> at org.apache.hadoop.hive.ql.exec.tez.DagUtils.localizeResource(DagUtils.java:983) 
> at org.apache.hadoop.hive.ql.exec.tez.DagUtils.addTempResources(DagUtils.java:857) 
> at org.apache.hadoop.hive.ql.exec.tez.DagUtils.localizeTempFilesFromConf(DagUtils.java:800)

> at org.apache.hadoop.hive.ql.exec.tez.TezSessionState.refreshLocalResourcesFromConf(TezSessionState.java:228)

> at org.apache.hadoop.hive.ql.exec.tez.TezSessionState.open(TezSessionState.java:154)

> at org.apache.hadoop.hive.ql.exec.tez.TezSessionState.open(TezSessionState.java:122)

> at org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.java:454) 
> {code}
> unable to access the hivecli. also unable to perform hive queries using Tez.
> WORK AROUND:
> In the hive-env.sh
> Folder containing extra libraries required for hive compilation/execution can be controlled
by:
> if [ "$ {HIVE_AUX_JARS_PATH}" != "" ]; then 
> export HIVE_AUX_JARS_PATH=${HIVE_AUX_JARS_PATH}
> elif [ -d "/usr/hdp/current/hive-webhcat/share/hcatalog" ]; then 
> export HIVE_AUX_JARS_PATH=/usr/hdp/current/hive-webhcat/share/hcatalog 
> fi



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message