hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Thejas M Nair (JIRA)" <j...@apache.org>
Subject [jira] [Comment Edited] (HIVE-6962) NoSuchMethodError exception when using HIVE 0.13 with Hadoop 1.0.4
Date Thu, 01 May 2014 22:37:17 GMT

    [ https://issues.apache.org/jira/browse/HIVE-6962?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13987069#comment-13987069
] 

Thejas M Nair edited comment on HIVE-6962 at 5/1/14 10:36 PM:
--------------------------------------------------------------

After changes in HIVE-7001, you would see this with pre hadoop 1.2 versions, only if hive.server2.enable.doAs=true
(and ofcourse you are running the query through HS2). I hope to get HIVE-7001 into hive 0.13.1
.

The workaround for those versions while using that combination would be to set fs.permissions.umask-mode
as described above (Verified that this works).
ie. add this in hive-site.xml -

{code}
  <property>
    <name>fs.permissions.umask-mode</name>
    <value>022</value>
    <description> Setting a value for fs.permissions.umask-mode to work around issue
in HIVE-6962.
 It has no impact in hadoop 1.x line on hdfs operations.
    </description>
  </property>
{code}


was (Author: thejas):
After changes in HIVE-7001, you would see this with pre hadoop 1.2 versions, only if hive.server2.enable.doAs=true
(and ofcourse you are running the query through HS2). I hope to get HIVE-7001 into hive 0.13.1
.

The workaround for those versions while using that combination would be to set fs.permissions.umask-mode
as described above (I haven't tested that myself, but if somebody validates that and responds
on the jira, it would be great).
ie. add this in hive-site.xml -

{code}
  <property>
    <name>fs.permissions.umask-mode</name>
    <value>022</value>
    <description> Setting a value for fs.permissions.umask-mode to work around issue
in HIVE-6962.
 It has no impact in hadoop 1.x line on hdfs operations.
    </description>
  </property>
{code}

> NoSuchMethodError exception when using HIVE 0.13 with Hadoop 1.0.4
> ------------------------------------------------------------------
>
>                 Key: HIVE-6962
>                 URL: https://issues.apache.org/jira/browse/HIVE-6962
>             Project: Hive
>          Issue Type: Bug
>          Components: Query Processor
>    Affects Versions: 0.13.0
>         Environment: Hadoop 1.0.4
>            Reporter: Sun Rui
>
> Use HIVE 0.13 with Hadoop 1.0.4. When executing a query, get the following exception:
> {noformat}
> Exception in thread "main" java.lang.NoSuchMethodError: org.apache.hadoop.conf.Configuration.unset(Ljava/lang/String;)V
> 	at org.apache.hadoop.hive.ql.exec.Utilities.createDirsWithPermission(Utilities.java:3416)
> 	at org.apache.hadoop.hive.ql.exec.Utilities.createDirsWithPermission(Utilities.java:3401)
> 	at org.apache.hadoop.hive.ql.Context.getScratchDir(Context.java:214)
> 	at org.apache.hadoop.hive.ql.Context.getMRScratchDir(Context.java:265)
> 	at org.apache.hadoop.hive.ql.Context.getMRTmpPath(Context.java:323)
> 	at org.apache.hadoop.hive.ql.parse.SemanticAnalyzer.getMetaData(SemanticAnalyzer.java:1442)
> 	at org.apache.hadoop.hive.ql.parse.SemanticAnalyzer.getMetaData(SemanticAnalyzer.java:1192)
> 	at org.apache.hadoop.hive.ql.parse.SemanticAnalyzer.analyzeInternal(SemanticAnalyzer.java:9209)
> 	at org.apache.hadoop.hive.ql.parse.BaseSemanticAnalyzer.analyze(BaseSemanticAnalyzer.java:327)
> 	at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:391)
> 	at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:291)
> 	at org.apache.hadoop.hive.ql.Driver.compileInternal(Driver.java:944)
> 	at org.apache.hadoop.hive.ql.Driver.runInternal(Driver.java:1009)
> 	at org.apache.hadoop.hive.ql.Driver.run(Driver.java:880)
> 	at org.apache.hadoop.hive.ql.Driver.run(Driver.java:870)
> 	at org.apache.hadoop.hive.cli.CliDriver.processLocalCmd(CliDriver.java:268)
> 	at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:220)
> 	at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:423)
> 	at org.apache.hadoop.hive.cli.CliDriver.executeDriver(CliDriver.java:792)
> 	at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:686)
> 	at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:625)
> 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
> 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> 	at java.lang.reflect.Method.invoke(Method.java:597)
> 	at org.apache.hadoop.util.RunJar.main(RunJar.java:156)
> {noformat}
> This is because there is no unset() method in some versions of Hadoop.



--
This message was sent by Atlassian JIRA
(v6.2#6252)

Mime
View raw message