hama-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Skater Xu (JIRA)" <j...@apache.org>
Subject [jira] [Comment Edited] (HAMA-673) Integrate new service layers
Date Mon, 03 Feb 2014 12:06:13 GMT

    [ https://issues.apache.org/jira/browse/HAMA-673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13889428#comment-13889428
] 

Skater Xu edited comment on HAMA-673 at 2/3/14 12:06 PM:
---------------------------------------------------------

I have built the binary and integrated with hadoop 2.1.0beta, there is still problems when
start BSPMater, seems code is changed.
2014-02-03 03:55:53,289 FATAL org.apache.hama.BSPMasterRunner: java.lang.VerifyError: class
org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$RecoverLeaseRequestProto
overrides final method getUnknownFields.()Lcom/google/protobuf/UnknownFieldSet;
        at java.lang.ClassLoader.defineClass1(Native Method)
        at java.lang.ClassLoader.defineClass(ClassLoader.java:800)
        at java.security.SecureClassLoader.defineClass(SecureClassLoader.java:142)
        at java.net.URLClassLoader.defineClass(URLClassLoader.java:449)
        at java.net.URLClassLoader.access$100(URLClassLoader.java:71)
        at java.net.URLClassLoader$1.run(URLClassLoader.java:361)
        at java.net.URLClassLoader$1.run(URLClassLoader.java:355)
        at java.security.AccessController.doPrivileged(Native Method)
        at java.net.URLClassLoader.findClass(URLClassLoader.java:354)
        at java.lang.ClassLoader.loadClass(ClassLoader.java:425)
        at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:308)
        at java.lang.ClassLoader.loadClass(ClassLoader.java:358)
        at java.lang.Class.getDeclaredMethods0(Native Method)
        at java.lang.Class.privateGetDeclaredMethods(Class.java:2531)
        at java.lang.Class.privateGetPublicMethods(Class.java:2651)
        at java.lang.Class.privateGetPublicMethods(Class.java:2661)
        at java.lang.Class.getMethods(Class.java:1467)
        at sun.misc.ProxyGenerator.generateClassFile(ProxyGenerator.java:426)
        at sun.misc.ProxyGenerator.generateProxyClass(ProxyGenerator.java:323)
        at java.lang.reflect.Proxy.getProxyClass0(Proxy.java:636)
        at java.lang.reflect.Proxy.newProxyInstance(Proxy.java:722)
        at org.apache.hadoop.ipc.ProtobufRpcEngine.getProxy(ProtobufRpcEngine.java:92)
        at org.apache.hadoop.ipc.RPC.getProtocolProxy(RPC.java:537)
        at org.apache.hadoop.hdfs.NameNodeProxies.createNNProxyWithClientProtocol(NameNodeProxies.java:262)
        at org.apache.hadoop.hdfs.NameNodeProxies.createNonHAProxy(NameNodeProxies.java:169)
        at org.apache.hadoop.hdfs.NameNodeProxies.createProxy(NameNodeProxies.java:130)
        at org.apache.hadoop.hdfs.DFSClient.<init>(DFSClient.java:482)
        at org.apache.hadoop.hdfs.DFSClient.<init>(DFSClient.java:445)
        at org.apache.hadoop.hdfs.DistributedFileSystem.initialize(DistributedFileSystem.java:136)
        at org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:2429)
        at org.apache.hadoop.fs.FileSystem.access$200(FileSystem.java:88)
        at org.apache.hadoop.fs.FileSystem$Cache.getInternal(FileSystem.java:2463)
        at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:2445)
        at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:363)
        at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:165)
        at org.apache.hama.bsp.BSPMaster.<init>(BSPMaster.java:317)
        at org.apache.hama.bsp.BSPMaster.startMaster(BSPMaster.java:489)
        at org.apache.hama.bsp.BSPMaster.startMaster(BSPMaster.java:475)
        at org.apache.hama.BSPMasterRunner.run(BSPMasterRunner.java:46)
        at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
        at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:84)
        at org.apache.hama.BSPMasterRunner.main(BSPMasterRunner.java:56)


was (Author: skater):
I have build the binary and integrate with hadoop 2.1.0beta, there is still problems when
start BSPMater, seems code is changed.
2014-02-03 03:55:53,289 FATAL org.apache.hama.BSPMasterRunner: java.lang.VerifyError: class
org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$RecoverLeaseRequestProto
overrides final method getUnknownFields.()Lcom/google/protobuf/UnknownFieldSet;
        at java.lang.ClassLoader.defineClass1(Native Method)
        at java.lang.ClassLoader.defineClass(ClassLoader.java:800)
        at java.security.SecureClassLoader.defineClass(SecureClassLoader.java:142)
        at java.net.URLClassLoader.defineClass(URLClassLoader.java:449)
        at java.net.URLClassLoader.access$100(URLClassLoader.java:71)
        at java.net.URLClassLoader$1.run(URLClassLoader.java:361)
        at java.net.URLClassLoader$1.run(URLClassLoader.java:355)
        at java.security.AccessController.doPrivileged(Native Method)
        at java.net.URLClassLoader.findClass(URLClassLoader.java:354)
        at java.lang.ClassLoader.loadClass(ClassLoader.java:425)
        at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:308)
        at java.lang.ClassLoader.loadClass(ClassLoader.java:358)
        at java.lang.Class.getDeclaredMethods0(Native Method)
        at java.lang.Class.privateGetDeclaredMethods(Class.java:2531)
        at java.lang.Class.privateGetPublicMethods(Class.java:2651)
        at java.lang.Class.privateGetPublicMethods(Class.java:2661)
        at java.lang.Class.getMethods(Class.java:1467)
        at sun.misc.ProxyGenerator.generateClassFile(ProxyGenerator.java:426)
        at sun.misc.ProxyGenerator.generateProxyClass(ProxyGenerator.java:323)
        at java.lang.reflect.Proxy.getProxyClass0(Proxy.java:636)
        at java.lang.reflect.Proxy.newProxyInstance(Proxy.java:722)
        at org.apache.hadoop.ipc.ProtobufRpcEngine.getProxy(ProtobufRpcEngine.java:92)
        at org.apache.hadoop.ipc.RPC.getProtocolProxy(RPC.java:537)
        at org.apache.hadoop.hdfs.NameNodeProxies.createNNProxyWithClientProtocol(NameNodeProxies.java:262)
        at org.apache.hadoop.hdfs.NameNodeProxies.createNonHAProxy(NameNodeProxies.java:169)
        at org.apache.hadoop.hdfs.NameNodeProxies.createProxy(NameNodeProxies.java:130)
        at org.apache.hadoop.hdfs.DFSClient.<init>(DFSClient.java:482)
        at org.apache.hadoop.hdfs.DFSClient.<init>(DFSClient.java:445)
        at org.apache.hadoop.hdfs.DistributedFileSystem.initialize(DistributedFileSystem.java:136)
        at org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:2429)
        at org.apache.hadoop.fs.FileSystem.access$200(FileSystem.java:88)
        at org.apache.hadoop.fs.FileSystem$Cache.getInternal(FileSystem.java:2463)
        at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:2445)
        at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:363)
        at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:165)
        at org.apache.hama.bsp.BSPMaster.<init>(BSPMaster.java:317)
        at org.apache.hama.bsp.BSPMaster.startMaster(BSPMaster.java:489)
        at org.apache.hama.bsp.BSPMaster.startMaster(BSPMaster.java:475)
        at org.apache.hama.BSPMasterRunner.run(BSPMasterRunner.java:46)
        at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
        at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:84)
        at org.apache.hama.BSPMasterRunner.main(BSPMasterRunner.java:56)

> Integrate new service layers
> ----------------------------
>
>                 Key: HAMA-673
>                 URL: https://issues.apache.org/jira/browse/HAMA-673
>             Project: Hama
>          Issue Type: Sub-task
>          Components: bsp core, build , yarn
>            Reporter: Thomas Jungblut
>         Attachments: yarn-hama-diagram.pptx
>
>
> Integrate the services, messaging/synchronization/scheduler into YARN.
> The master must startup all the master services.



--
This message was sent by Atlassian JIRA
(v6.1.5#6160)

Mime
View raw message