hive-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Juan Carlos <juc...@gmail.com>
Subject Hive-server2 trying to execute local mapreduce
Date Wed, 05 Nov 2014 08:45:56 GMT
I have a secured and HA hdfs cluster, and I have been trying to execute a
join operation with beeline CLI.

My issue is that it try to execute mapreduce localy instead by yarn. I set
parameters

    <property>
        <name>mapreduce.framework.name</name>
        <value>yarn</value>
    </property>

    <property>
        <name>mapred.job.tracker</name>
        <value>anything</value>
    </property>

I'm using hive 0.13 and hadoop 2.2.0

In logs I see this:
ERROR [pool-2-thread-2]: mr.MapredLocalTask
(MapredLocalTask.java:execute(282)) - Exception: Cannot run program
"/usr/lib/hadoop/bin/hadoop" (in directory "/root"): error=13, Permission
denied
2014-11-05 09:31:33,368 ERROR [pool-2-thread-2]: ql.Driver
(SessionState.java:printError(545)) - FAILED: Execution Error, return code
1 from org.apache.hadoop.hive.ql.exec.mr.MapredLocalTask
2014-11-05 09:31:33,368 INFO  [pool-2-thread-2]: log.PerfLogger
(PerfLogger.java:PerfLogEnd(135)) - </PERFLOG method=Driver.execute
start=1415176292766 end=1415176293368 duration=602
from=org.apache.hadoop.hive.ql.Driver>
2014-11-05 09:31:33,368 INFO  [pool-2-thread-2]: log.PerfLogger
(PerfLogger.java:PerfLogBegin(108)) - <PERFLOG method=releaseLocks
from=org.apache.hadoop.hive.ql.Driver>
2014-11-05 09:31:33,368 INFO  [pool-2-thread-2]: ZooKeeperHiveLockManager
(ZooKeeperHiveLockManager.java:releaseLocks(254)) -  about to release lock
for default/sample_08
2014-11-05 09:31:33,429 INFO  [pool-2-thread-2]: ZooKeeperHiveLockManager
(ZooKeeperHiveLockManager.java:releaseLocks(254)) -  about to release lock
for default/sample_07
2014-11-05 09:31:33,514 INFO  [pool-2-thread-2]: ZooKeeperHiveLockManager
(ZooKeeperHiveLockManager.java:releaseLocks(254)) -  about to release lock
for default
2014-11-05 09:31:33,675 INFO  [pool-2-thread-2]: log.PerfLogger
(PerfLogger.java:PerfLogEnd(135)) - </PERFLOG method=releaseLocks
start=1415176293368 end=1415176293675 duration=307
from=org.apache.hadoop.hive.ql.Driver>
2014-11-05 09:31:33,815 ERROR [pool-2-thread-2]: operation.Operation
(SQLOperation.java:run(202)) - Error running hive query:
org.apache.hive.service.cli.HiveSQLException: Error while processing
statement: FAILED: Execution Error, return code 1 from
org.apache.hadoop.hive.ql.exec.mr.MapredLocalTask
    at
org.apache.hive.service.cli.operation.SQLOperation.runInternal(SQLOperation.java:146)
    at
org.apache.hive.service.cli.operation.SQLOperation.access$000(SQLOperation.java:68)
    at
org.apache.hive.service.cli.operation.SQLOperation$1$1.run(SQLOperation.java:199)
    at java.security.AccessController.doPrivileged(Native Method)
    at javax.security.auth.Subject.doAs(Subject.java:415)
    at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1491)
    at
org.apache.hadoop.hive.shims.HadoopShimsSecure.doAs(HadoopShimsSecure.java:493)
    at
org.apache.hive.service.cli.operation.SQLOperation$1.run(SQLOperation.java:208)
    at
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
    at java.util.concurrent.FutureTask.run(FutureTask.java:262)
    at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
    at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
    at java.lang.Thread.run(Thread.java:744)


Any idea? Anyone could point me what else to check?

Regards

Mime
View raw message