giraph-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Schena, Brendan" <Brendan.Sch...@fmr.com>
Subject giraph build for CDH 4.3 M/R auth issues
Date Sun, 13 Oct 2013 00:33:18 GMT
Hello - I recently built giraph for CDH 4.3. Unfortunately I am having issues running the example
code below. I can run other M/R via java - hive - oozie etc...

I looked at the SaslNettyClient.java and found the HADOOP_TOKEN_FILE_LOCATION config not sure
if it is getting set or not. I don't know how or what that variable should get set to. Any
ideas or help would be appreciated!

Command I run:

hadoop jar ./giraph-core/target/giraph-1.1.0-SNAPSHOT-for-hadoop-2.0.0-cdh4.3.0-jar-with-dependencies.jar
org.apache.giraph.benchmark.PageRankBenchmark -Dmapred.child.java-opts="-Xmx64g -Xms64g XX:+UseConcMarkSweepGC
-XX:-UseGCOverheadLimit" -Dgiraph.zkList=zookeeper.node.com:2181 -Dgiraph.authenticate=true
-e 1 -s 3 -v -V 50000 -w 2

JobTracker Log:

2013-10-12 19:56:50,130 FATAL org.apache.hadoop.mapred.Child: Error running child : java.lang.NoSuchMethodError:
org.apache.hadoop.mapreduce.security.TokenCache.loadTokens(Ljava/lang/String;Lorg/apache/hadoop/mapred/JobConf;)Lorg/apache/hadoop/security/Credentials;
                    at org.apache.giraph.comm.netty.SaslNettyClient.createJobToken(SaslNettyClient.java:105)
                    at org.apache.giraph.comm.netty.SaslNettyClient.<init>(SaslNettyClient.java:70)
                    at org.apache.giraph.comm.netty.NettyClient.authenticateOnChannel(NettyClient.java:494)
                    at org.apache.giraph.comm.netty.NettyClient.authenticate(NettyClient.java:469)
                    at org.apache.giraph.comm.netty.NettyWorkerClient.authenticate(NettyWorkerClient.java:175)
                    at org.apache.giraph.comm.netty.NettyWorkerClient.setup(NettyWorkerClient.java:166)
                    at org.apache.giraph.worker.BspServiceWorker.setup(BspServiceWorker.java:494)
                    at org.apache.giraph.graph.GraphTaskManager.execute(GraphTaskManager.java:246)
                    at org.apache.giraph.graph.GraphMapper.run(GraphMapper.java:91)
                    at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:672)
                    at org.apache.hadoop.mapred.MapTask.run(MapTask.java:330)
                    at org.apache.hadoop.mapred.Child$4.run(Child.java:268)
                    at java.security.AccessController.doPrivileged(Native Method)
                    at javax.security.auth.Subject.doAs(Subject.java:396)
                    at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1408)
                    at org.apache.hadoop.mapred.Child.main(Child.java:262)

Mime
View raw message