falcon-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Arpit Gupta (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (FALCON-276) falcon/prism services should fail to start if exceptions are encountered during bootup
Date Fri, 24 Jan 2014 18:21:38 GMT

    [ https://issues.apache.org/jira/browse/FALCON-276?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13881242#comment-13881242
] 

Arpit Gupta commented on FALCON-276:
------------------------------------

Here are some examples of exceptions seen

{code}
2014-01-22 20:14:00,134 WARN  - [main:] ~ The short-circuit local reads feature cannot be
used because libhadoop cannot be loaded. (BlockReaderLocal:69)
2014-01-22 20:14:00,193 INFO  - [main:] ~ Initializing service : org.apache.falcon.entity.store.ConfigurationStore
(ServiceInitializer:44)
2014-01-22 20:14:00,273 FATAL - [main:] ~ Failed to initialize service org.apache.falcon.entity.store.ConfigurationStore
(ServiceInitializer:48)
java.lang.ClassCastException: org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$GetListingRequestProto
cannot be cast to com.google.protobuf.Message
        at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:203)
        at $Proxy22.getListing(Unknown Source)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
        at java.lang.reflect.Method.invoke(Method.java:597)
        at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:186)
        at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:102)
        at $Proxy22.getListing(Unknown Source)
        at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getListing(ClientNamenodeProtocolTranslatorPB.java:484)
        at org.apache.hadoop.hdfs.DFSClient.listPaths(DFSClient.java:1713)
        at org.apache.hadoop.hdfs.DFSClient.listPaths(DFSClient.java:1696)
        at org.apache.hadoop.hdfs.DistributedFileSystem.listStatusInternal(DistributedFileSystem.java:640)
        at org.apache.hadoop.hdfs.DistributedFileSystem.access$600(DistributedFileSystem.java:92)
        at org.apache.hadoop.hdfs.DistributedFileSystem$14.doCall(DistributedFileSystem.java:702)
        at org.apache.hadoop.hdfs.DistributedFileSystem$14.doCall(DistributedFileSystem.java:698)
        at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81)
        at org.apache.hadoop.hdfs.DistributedFileSystem.listStatus(DistributedFileSystem.java:698)
        at org.apache.hadoop.fs.Globber.listStatus(Globber.java:69)
        at org.apache.hadoop.fs.Globber.glob(Globber.java:207)
        at org.apache.hadoop.fs.FileSystem.globStatus(FileSystem.java:1624)
        at org.apache.falcon.entity.store.ConfigurationStore.init(ConfigurationStore.java:110)
        at org.apache.falcon.service.ServiceInitializer.initialize(ServiceInitializer.java:46)
        at org.apache.falcon.listener.ContextStartupListener.contextInitialized(ContextStartupListener.java:55)
        at org.mortbay.jetty.handler.ContextHandler.startContext(ContextHandler.java:549)
        at org.mortbay.jetty.servlet.Context.startContext(Context.java:136)
        at org.mortbay.jetty.webapp.WebAppContext.startContext(WebAppContext.java:1282)
        at org.mortbay.jetty.handler.ContextHandler.doStart(ContextHandler.java:518)
        at org.mortbay.jetty.webapp.WebAppContext.doStart(WebAppContext.java:499)
        at org.mortbay.component.AbstractLifeCycle.start(AbstractLifeCycle.java:50)
        at org.mortbay.jetty.handler.HandlerWrapper.doStart(HandlerWrapper.java:130)
        at org.mortbay.jetty.Server.doStart(Server.java:224)
        at org.mortbay.component.AbstractLifeCycle.start(AbstractLifeCycle.java:50)
        at org.apache.falcon.util.EmbeddedServer.start(EmbeddedServer.java:45)
        at org.apache.falcon.Main.main(Main.java:90)
2014-01-22 20:14:00,274 ERROR - [main:] ~ Failed startup of context org.mortbay.jetty.webapp.WebAppContext@10f1f34a{/,/usr/lib/falcon-distributed/server/webapp/falcon.war}
(log:87)
java.lang.RuntimeException: org.apache.falcon.FalconException: java.lang.ClassCastException:
org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$GetListingRequestProto
cannot be cast to com.google.protobuf.Message
        at org.apache.falcon.listener.ContextStartupListener.contextInitialized(ContextStartupListener.java:58)
        at org.mortbay.jetty.handler.ContextHandler.startContext(ContextHandler.java:549)
        at org.mortbay.jetty.servlet.Context.startContext(Context.java:136)
        at org.mortbay.jetty.webapp.WebAppContext.startContext(WebAppContext.java:1282)
        at org.mortbay.jetty.handler.ContextHandler.doStart(ContextHandler.java:518)
        at org.mortbay.jetty.webapp.WebAppContext.doStart(WebAppContext.java:499)
        at org.mortbay.component.AbstractLifeCycle.start(AbstractLifeCycle.java:50)
        at org.mortbay.jetty.handler.HandlerWrapper.doStart(HandlerWrapper.java:130)
        at org.mortbay.jetty.Server.doStart(Server.java:224)
        at org.mortbay.component.AbstractLifeCycle.start(AbstractLifeCycle.java:50)
        at org.apache.falcon.util.EmbeddedServer.start(EmbeddedServer.java:45)
        at org.apache.falcon.Main.main(Main.java:90)
Caused by: org.apache.falcon.FalconException: java.lang.ClassCastException: org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$GetListingRequestProto
cannot be cast to com.google.protobuf.Message
        at org.apache.falcon.service.ServiceInitializer.initialize(ServiceInitializer.java:49)
        at org.apache.falcon.listener.ContextStartupListener.contextInitialized(ContextStartupListener.java:55)
        ... 11 more
Caused by: java.lang.ClassCastException: org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$GetListingRequestProto
cannot be cast to com.google.protobuf.Message
        at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:203)
        at $Proxy22.getListing(Unknown Source)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
        at java.lang.reflect.Method.invoke(Method.java:597)
        at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:186)
        at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:102)
{code}


{code}
2014-01-24 17:08:02,596 WARN  - [main:] ~ Unable to load native-hadoop library for your platform...
using builtin-java classes where applicable (NativeCodeLoader:62)
2014-01-24 17:08:03,394 WARN  - [main:] ~ failed org.mortbay.jetty.webapp.WebAppContext@3ebc312f{/,/usr/lib/falcon-distributed/server/webapp/falcon.war}:
java.lang.NoClassDefFoundError: org/apache/hadoop/
fs/BatchedRemoteIterator$BatchedEntries (log:76)
2014-01-24 17:08:03,395 ERROR - [main:] ~ Error starting handlers (log:87)
java.lang.NoClassDefFoundError: org/apache/hadoop/fs/BatchedRemoteIterator$BatchedEntries
        at org.apache.hadoop.hdfs.NameNodeProxies.createNNProxyWithClientProtocol(NameNodeProxies.java:364)
        at org.apache.hadoop.hdfs.NameNodeProxies.createNonHAProxy(NameNodeProxies.java:235)
        at org.apache.hadoop.hdfs.NameNodeProxies.createProxy(NameNodeProxies.java:139)
        at org.apache.hadoop.hdfs.DFSClient.<init>(DFSClient.java:563)
        at org.apache.hadoop.hdfs.DFSClient.<init>(DFSClient.java:506)
        at org.apache.hadoop.hdfs.DistributedFileSystem.initialize(DistributedFileSystem.java:142)
        at org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:2316)
        at org.apache.hadoop.fs.FileSystem.access$200(FileSystem.java:90)
        at org.apache.hadoop.fs.FileSystem$Cache.getInternal(FileSystem.java:2350)
        at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:2332)
        at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:369)
        at org.apache.falcon.entity.store.ConfigurationStore.<init>(ConfigurationStore.java:88)
        at org.apache.falcon.entity.store.ConfigurationStore.<clinit>(ConfigurationStore.java:57)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
        at java.lang.reflect.Method.invoke(Method.java:597)
        at org.apache.falcon.util.ReflectionUtils.getInstanceByClassName(ReflectionUtils.java:49)
        at org.apache.falcon.service.ServiceInitializer.initialize(ServiceInitializer.java:42)
        at org.apache.falcon.listener.ContextStartupListener.contextInitialized(ContextStartupListener.java:55)
        at org.mortbay.jetty.handler.ContextHandler.startContext(ContextHandler.java:549)
        at org.mortbay.jetty.servlet.Context.startContext(Context.java:136)
        at org.mortbay.jetty.webapp.WebAppContext.startContext(WebAppContext.java:1282)
        at org.mortbay.jetty.handler.ContextHandler.doStart(ContextHandler.java:518)
        at org.mortbay.jetty.webapp.WebAppContext.doStart(WebAppContext.java:499)
        at org.mortbay.component.AbstractLifeCycle.start(AbstractLifeCycle.java:50)
        at org.mortbay.jetty.handler.HandlerWrapper.doStart(HandlerWrapper.java:130)
        at org.mortbay.jetty.Server.doStart(Server.java:224)
        at org.mortbay.component.AbstractLifeCycle.start(AbstractLifeCycle.java:50)
        at org.apache.falcon.util.EmbeddedServer.start(EmbeddedServer.java:45)
:        at org.apache.falcon.util.EmbeddedServer.start(EmbeddedServer.java:45)
        at org.apache.falcon.Main.main(Main.java:90)
Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.fs.BatchedRemoteIterator$BatchedEntries
        at java.net.URLClassLoader$1.run(URLClassLoader.java:202)
        at java.security.AccessController.doPrivileged(Native Method)
        at java.net.URLClassLoader.findClass(URLClassLoader.java:190)
        at java.lang.ClassLoader.loadClass(ClassLoader.java:306)
        at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
        at java.lang.ClassLoader.loadClass(ClassLoader.java:247)
        at org.mortbay.jetty.webapp.WebAppClassLoader.loadClass(WebAppClassLoader.java:401)
        at org.mortbay.jetty.webapp.WebAppClassLoader.loadClass(WebAppClassLoader.java:363)
        ... 31 more
{code}


> falcon/prism services should fail to start if exceptions are encountered during bootup
> --------------------------------------------------------------------------------------
>
>                 Key: FALCON-276
>                 URL: https://issues.apache.org/jira/browse/FALCON-276
>             Project: Falcon
>          Issue Type: Bug
>    Affects Versions: 0.4
>            Reporter: Arpit Gupta
>
> I noticed that when starting falcon and prism the services started up but i could not
run the falcon admin -version command. Upon looking at the application logs i saw exception.

> It would be a much better if the service fails to start when exceptions are encountered
and throws an error so the service start commands fail.



--
This message was sent by Atlassian JIRA
(v6.1.5#6160)

Mime
View raw message