giraph-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Eli Reisman <apache.mail...@gmail.com>
Subject Re: giraph build for CDH 4.3 M/R auth issues
Date Sun, 10 Nov 2013 20:27:21 GMT
In the Hadoop working dir for the job attempt I thought there's a jobToken
directory added that will hold the token? Anyone?


On Sat, Oct 12, 2013 at 5:33 PM, Schena, Brendan <Brendan.Schena@fmr.com>wrote:

> Hello – I recently built giraph for CDH 4.3. Unfortunately I am having
> issues running the example code below. I can run other M/R via java – hive
> – oozie etc…
>
> I looked at the SaslNettyClient.java and found the HADOOP_TOKEN_FILE_LOCATION config
not sure if it is getting set or not. I don’t know how or what that variable should get
set to. Any ideas or help would be appreciated!
>
>
>
> Command I run:
>
>
>
> hadoop jar
> ./giraph-core/target/giraph-1.1.0-SNAPSHOT-for-hadoop-2.0.0-cdh4.3.0-jar-with-dependencies.jar
> org.apache.giraph.benchmark.PageRankBenchmark
> -Dmapred.child.java-opts="-Xmx64g -Xms64g XX:+UseConcMarkSweepGC
> -XX:-UseGCOverheadLimit" -Dgiraph.zkList=zookeeper.node.com:2181-Dgiraph.authenticate=true
-e 1 -s 3 -v -V 50000 -w 2
>
>
>
> JobTracker Log:
>
>
>
> 2013-10-12 19:56:50,130 FATAL org.apache.hadoop.mapred.Child: Error
> running child : java.lang.NoSuchMethodError:
> org.apache.hadoop.mapreduce.security.TokenCache.loadTokens(Ljava/lang/String;Lorg/apache/hadoop/mapred/JobConf;)Lorg/apache/hadoop/security/Credentials;
>
>                     at
> org.apache.giraph.comm.netty.SaslNettyClient.createJobToken(SaslNettyClient.java:105)
>
>                     at
> org.apache.giraph.comm.netty.SaslNettyClient.<init>(SaslNettyClient.java:70)
>
>                     at
> org.apache.giraph.comm.netty.NettyClient.authenticateOnChannel(NettyClient.java:494)
>
>                     at
> org.apache.giraph.comm.netty.NettyClient.authenticate(NettyClient.java:469)
>
>                     at
> org.apache.giraph.comm.netty.NettyWorkerClient.authenticate(NettyWorkerClient.java:175)
>
>                     at
> org.apache.giraph.comm.netty.NettyWorkerClient.setup(NettyWorkerClient.java:166)
>
>                     at
> org.apache.giraph.worker.BspServiceWorker.setup(BspServiceWorker.java:494)
>
>                     at
> org.apache.giraph.graph.GraphTaskManager.execute(GraphTaskManager.java:246)
>
>                     at
> org.apache.giraph.graph.GraphMapper.run(GraphMapper.java:91)
>
>                     at
> org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:672)
>
>                     at
> org.apache.hadoop.mapred.MapTask.run(MapTask.java:330)
>
>                     at org.apache.hadoop.mapred.Child$4.run(Child.java:268)
>
>                     at java.security.AccessController.doPrivileged(Native
> Method)
>
>                     at javax.security.auth.Subject.doAs(Subject.java:396)
>
>                     at
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1408)
>
>                     at org.apache.hadoop.mapred.Child.main(Child.java:262)
>

Mime
View raw message