falcon-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Sandeep Samudrala <sandys...@gmail.com>
Subject Re: Unable to submit cluster definition
Date Sat, 07 Jan 2017 04:18:10 GMT
Please add "falcon.current.colo=eng" to both runtime.properties in prism
and falcon and then try it out.

On Sat, Jan 7, 2017 at 12:30 AM, Aaron Turner <synfinatic@gmail.com> wrote:

> I guess that will work for now.  At some point I'm sure we'll want
> that feature.  Anyways, made progress, but now I'm stuck again.
>
> error from the falcon submit command is now:
>
> $ ./bin/falcon entity -submit -debug -type cluster -file
> /etc/falcon/cluster.xml
> Hadoop is installed, adding hadoop classpath to falcon classpath
> SLF4J: Class path contains multiple SLF4J bindings.
> SLF4J: Found binding in
> [jar:file:/usr/lib/falcon-server/client/lib/falcon-cli-
> 0.10.jar!/org/slf4j/impl/StaticLoggerBinder.class]
> SLF4J: Found binding in
> [jar:file:/usr/lib/falcon-server/client/lib/slf4j-
> log4j12-1.7.5.jar!/org/slf4j/impl/StaticLoggerBinder.class]
> SLF4J: Found binding in
> [jar:file:/usr/lib/zookeeper/lib/slf4j-log4j12-1.7.5.jar!/org/slf4j/impl/
> StaticLoggerBinder.class]
> SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an
> explanation.
> SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory]
> POST http://localhost:16444/api/entities/submit/cluster returned a
> response status of 400 Bad Request
> ERROR: Bad Request;eng/Current colo (default) is not eng
>
> ok, that seems straight forward... just need to check my
> runtime.properties files:
>
> Here is what I have for both server/prism runtime.properties:
>
> #### To configure falcon servers with prism ####
> #prism should have the following properties
> *.all.colos=eng
> *.falcon.eng.endpoint=http://localhost:15000
>
> # falcon server should have the following properties
> *.current.colo=eng
>
> That looks good to me??
>
> and my cluster.xml:
>
> <?xml version="1.0" encoding="UTF-8"?>
> <!-- https://falcon.apache.org/EntitySpecification.html#
> Cluster_Specification
> -->
> <cluster colo="eng" description="test cluster" name="hdpt"
>     xmlns="uri:falcon:cluster:0.1"
>     xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance">
>    <interfaces>
>    ...
>    </interfaces>
>    ...
> </cluster>
>
> Again, colo=eng?  I tried specifying the -colo eng flag on the falcon
> CLI, but it complains that's not valid.
>
> prism logs:
>
> 2017-01-06 10:49:38,838 DEBUG - [352083716@qtp-771418758-0 -
> 6f5eb00b-836d-4575-bb58-ef723fcbc741:] ~ Audit: aaron_turner/127.0.0.1
> performed request
> http://localhost:16444/api/options?user.name=aaron_turner (127.0.0.1)
> at time 2017-01-06T18:49Z (FalconAuditFilter:86)
> 2017-01-06 10:49:38,839 INFO  - [352083716@qtp-771418758-0 -
> 6f5eb00b-836d-4575-bb58-ef723fcbc741:] ~ Audit: aaron_turner@127.0.0.1
> performed http://localhost:16444/api/options?user.name=aaron_turner
> (127.0.0.1) at 2017-01-06T18:49Z (AUDIT:48)
> 2017-01-06 10:49:38,839 INFO  - [352083716@qtp-771418758-0 -
> 6f5eb00b-836d-4575-bb58-ef723fcbc741:] ~ Audit: aaron_turner@127.0.0.1
> performed http://localhost:16444/api/options?user.name=aaron_turner
> (127.0.0.1) at 2017-01-06T18:49Z (AUDIT:48)
> 2017-01-06 10:49:38,843 DEBUG - [352083716@qtp-771418758-0 -
> 693cda15-070c-4bc9-84af-cff6f7ca577e:] ~ Audit: aaron_turner/127.0.0.1
> performed request
> http://localhost:16444/api/options?user.name=aaron_
> turner&user.name=aaron_turner
> (127.0.0.1) at time 2017-01-06T18:49Z (FalconAuditFilter:86)
> 2017-01-06 10:49:38,844 INFO  - [352083716@qtp-771418758-0 -
> 693cda15-070c-4bc9-84af-cff6f7ca577e:] ~ Audit: aaron_turner@127.0.0.1
> performed http://localhost:16444/api/options?user.name=aaron_
> turner&user.name=aaron_turner
> (127.0.0.1) at 2017-01-06T18:49Z (AUDIT:48)
> 2017-01-06 10:49:38,844 INFO  - [352083716@qtp-771418758-0 -
> 693cda15-070c-4bc9-84af-cff6f7ca577e:] ~ Audit: aaron_turner@127.0.0.1
> performed http://localhost:16444/api/options?user.name=aaron_
> turner&user.name=aaron_turner
> (127.0.0.1) at 2017-01-06T18:49Z (AUDIT:48)
> 2017-01-06 10:49:39,202 INFO  - [352083716@qtp-771418758-0 -
> 92f2ac46-dc50-4ec8-ba9b-e3977cdab9f7:aaron_turner:
> POST//entities/submit/cluster]
> ~ Logging in aaron_turner (CurrentUser:65)
> 2017-01-06 10:49:39,202 INFO  - [352083716@qtp-771418758-0 -
> 92f2ac46-dc50-4ec8-ba9b-e3977cdab9f7:aaron_turner:
> POST//entities/submit/cluster]
> ~ Request from authenticated user: aaron_turner,
> URL=/api/entities/submit/cluster, doAs user: null
> (FalconAuthenticationFilter:185)
> 2017-01-06 10:49:39,207 INFO  - [352083716@qtp-771418758-0 -
> 92f2ac46-dc50-4ec8-ba9b-e3977cdab9f7:aaron_turner:
> POST//entities/submit/cluster]
> ~ Parsed Entity: hdpt (EntityParser:94)
> 2017-01-06 10:49:39,207 DEBUG - [352083716@qtp-771418758-0 -
> 92f2ac46-dc50-4ec8-ba9b-e3977cdab9f7:aaron_turner:
> POST//entities/submit/cluster]
> ~ Executing http://localhost:15000/secure/sync/submit/cluster?colo=eng&
> (HTTPChannel:96)
> 2017-01-06 10:49:39,209 INFO  - [352083716@qtp-771418758-0 -
> 92f2ac46-dc50-4ec8-ba9b-e3977cdab9f7:aaron_turner:
> POST//entities/submit/cluster]
> ~ Configuring client with /usr/lib/falcon-prism/conf/prism.keystore
> (SecureHTTPChannel:56)
> 2017-01-06 10:49:39,325 ERROR - [352083716@qtp-771418758-0 -
> 92f2ac46-dc50-4ec8-ba9b-e3977cdab9f7:aaron_turner:
> POST//entities/submit/cluster]
> ~ Request failed: 400 (HTTPChannel:123)
> 2017-01-06 10:49:39,329 ERROR - [352083716@qtp-771418758-0 -
> 92f2ac46-dc50-4ec8-ba9b-e3977cdab9f7:aaron_turner:
> POST//entities/submit/cluster]
> ~ Request failed (HTTPChannel:131)
> org.apache.falcon.FalconWebException
> at org.apache.falcon.FalconWebException.newAPIException(
> FalconWebException.java:62)
> at org.apache.falcon.FalconWebException.newAPIException(
> FalconWebException.java:54)
> at org.apache.falcon.resource.channel.HTTPChannel.invoke(
> HTTPChannel.java:124)
> at org.apache.falcon.resource.proxy.SchedulableEntityManagerProxy$
> 2.doExecute(SchedulableEntityManagerProxy.java:176)
> at org.apache.falcon.resource.proxy.SchedulableEntityManagerProxy$
> EntityProxy.execute(SchedulableEntityManagerProxy.java:841)
> at org.apache.falcon.resource.proxy.SchedulableEntityManagerProxy.
> submit_aroundBody2(SchedulableEntityManagerProxy.java:178)
> at org.apache.falcon.resource.proxy.SchedulableEntityManagerProxy$
> AjcClosure3.run(SchedulableEntityManagerProxy.java:1)
> at org.aspectj.runtime.reflect.JoinPointImpl.proceed(
> JoinPointImpl.java:149)
> at org.apache.falcon.aspect.AbstractFalconAspect.logAroundMonitored(
> AbstractFalconAspect.java:51)
> at org.apache.falcon.resource.proxy.SchedulableEntityManagerProxy.submit(
> SchedulableEntityManagerProxy.java:156)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at sun.reflect.NativeMethodAccessorImpl.invoke(
> NativeMethodAccessorImpl.java:62)
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(
> DelegatingMethodAccessorImpl.java:43)
> at java.lang.reflect.Method.invoke(Method.java:498)
> at com.sun.jersey.spi.container.JavaMethodInvokerFactory$1.invoke(
> JavaMethodInvokerFactory.java:60)
> at com.sun.jersey.server.impl.model.method.dispatch.
> AbstractResourceMethodDispatchProvider$TypeOutInvoker._dispatch(
> AbstractResourceMethodDispatchProvider.java:185)
> at com.sun.jersey.server.impl.model.method.dispatch.
> ResourceJavaMethodDispatcher.dispatch(ResourceJavaMethodDispatcher.
> java:75)
> at com.sun.jersey.server.impl.uri.rules.HttpMethodRule.
> accept(HttpMethodRule.java:288)
> at com.sun.jersey.server.impl.uri.rules.RightHandPathRule.
> accept(RightHandPathRule.java:147)
> at com.sun.jersey.server.impl.uri.rules.ResourceClassRule.
> accept(ResourceClassRule.java:108)
> at com.sun.jersey.server.impl.uri.rules.RightHandPathRule.
> accept(RightHandPathRule.java:147)
> at com.sun.jersey.server.impl.uri.rules.RootResourceClassesRule.accept(
> RootResourceClassesRule.java:84)
> at com.sun.jersey.server.impl.application.WebApplicationImpl._
> handleRequest(WebApplicationImpl.java:1469)
> at com.sun.jersey.server.impl.application.WebApplicationImpl._
> handleRequest(WebApplicationImpl.java:1400)
> at com.sun.jersey.server.impl.application.WebApplicationImpl.
> handleRequest(WebApplicationImpl.java:1349)
> at com.sun.jersey.server.impl.application.WebApplicationImpl.
> handleRequest(WebApplicationImpl.java:1339)
> at com.sun.jersey.spi.container.servlet.WebComponent.service(
> WebComponent.java:416)
> at com.sun.jersey.spi.container.servlet.ServletContainer.
> service(ServletContainer.java:537)
> at com.sun.jersey.spi.container.servlet.ServletContainer.
> service(ServletContainer.java:699)
> at javax.servlet.http.HttpServlet.service(HttpServlet.java:820)
> at org.mortbay.jetty.servlet.ServletHolder.handle(ServletHolder.java:511)
> at org.mortbay.jetty.servlet.ServletHandler$CachedChain.
> doFilter(ServletHandler.java:1221)
> at org.apache.falcon.security.FalconAuthorizationFilter.doFilter(
> FalconAuthorizationFilter.java:108)
> at org.mortbay.jetty.servlet.ServletHandler$CachedChain.
> doFilter(ServletHandler.java:1212)
> at org.apache.falcon.security.FalconAuthenticationFilter$2.doFilter(
> FalconAuthenticationFilter.java:188)
> at org.apache.hadoop.security.authentication.server.
> AuthenticationFilter.doFilter(AuthenticationFilter.java:622)
> at org.apache.hadoop.security.authentication.server.
> AuthenticationFilter.doFilter(AuthenticationFilter.java:574)
> at org.apache.falcon.security.FalconAuthenticationFilter.doFilter(
> FalconAuthenticationFilter.java:197)
> at org.mortbay.jetty.servlet.ServletHandler$CachedChain.
> doFilter(ServletHandler.java:1212)
> at org.apache.falcon.security.FalconAuditFilter.doFilter(
> FalconAuditFilter.java:64)
> at org.mortbay.jetty.servlet.ServletHandler$CachedChain.
> doFilter(ServletHandler.java:1212)
> at org.apache.falcon.security.HostnameFilter.doFilter(
> HostnameFilter.java:82)
> at org.mortbay.jetty.servlet.ServletHandler$CachedChain.
> doFilter(ServletHandler.java:1212)
> at org.mortbay.jetty.servlet.ServletHandler.handle(
> ServletHandler.java:399)
> at org.mortbay.jetty.security.SecurityHandler.handle(
> SecurityHandler.java:216)
> at org.mortbay.jetty.servlet.SessionHandler.handle(
> SessionHandler.java:182)
> at org.mortbay.jetty.handler.ContextHandler.handle(
> ContextHandler.java:767)
> at org.mortbay.jetty.webapp.WebAppContext.handle(WebAppContext.java:450)
> at org.mortbay.jetty.handler.HandlerWrapper.handle(
> HandlerWrapper.java:152)
> at org.mortbay.jetty.Server.handle(Server.java:326)
> at org.mortbay.jetty.HttpConnection.handleRequest(HttpConnection.java:542)
> at org.mortbay.jetty.HttpConnection$RequestHandler.
> content(HttpConnection.java:945)
> at org.mortbay.jetty.HttpParser.parseNext(HttpParser.java:756)
> at org.mortbay.jetty.HttpParser.parseAvailable(HttpParser.java:218)
> at org.mortbay.jetty.HttpConnection.handle(HttpConnection.java:404)
> at org.mortbay.jetty.bio.SocketConnector$Connection.
> run(SocketConnector.java:228)
> at org.mortbay.thread.QueuedThreadPool$PoolThread.
> run(QueuedThreadPool.java:582)
> 2017-01-06 10:49:39,330 INFO  - [352083716@qtp-771418758-0 -
> 92f2ac46-dc50-4ec8-ba9b-e3977cdab9f7:aaron_turner:
> POST//entities/submit/cluster]
> ~ {Action:submit, Dimensions:{colo=NULL, entityType=cluster}, Status:
> FAILED, Time-taken:126927782 ns} (METRIC:38)
> 2017-01-06 10:49:39,330 ERROR - [352083716@qtp-771418758-0 -
> 92f2ac46-dc50-4ec8-ba9b-e3977cdab9f7:aaron_turner:
> POST//entities/submit/cluster]
> ~ Exception in sending Notification from
> EmailNotificationPlugin:java.lang.NullPointerException
> (EmailNotificationPlugin:71)
> 2017-01-06 10:49:39,331 DEBUG - [352083716@qtp-771418758-0 -
> 92f2ac46-dc50-4ec8-ba9b-e3977cdab9f7:] ~ Audit: aaron_turner/127.0.0.1
> performed request http://localhost:16444/api/entities/submit/cluster
> (127.0.0.1) at time 2017-01-06T18:49Z (FalconAuditFilter:86)
> 2017-01-06 10:49:39,331 INFO  - [352083716@qtp-771418758-0 -
> 92f2ac46-dc50-4ec8-ba9b-e3977cdab9f7:] ~ Audit: aaron_turner@127.0.0.1
> performed http://localhost:16444/api/entities/submit/cluster
> (127.0.0.1) at 2017-01-06T18:49Z (AUDIT:48)
> 2017-01-06 10:49:39,331 INFO  - [352083716@qtp-771418758-0 -
> 92f2ac46-dc50-4ec8-ba9b-e3977cdab9f7:] ~ Audit: aaron_turner@127.0.0.1
> performed http://localhost:16444/api/entities/submit/cluster
> (127.0.0.1) at 2017-01-06T18:49Z (AUDIT:48)
>
> server logs:
>
> 2017-01-06 10:55:07,924 INFO  - [1234586997@qtp-1262548561-0 -
> 7cfdfb26-83c4-40c8-889c-13ff938d7ffd:aaron_turner:
> POST//sync/submit/cluster]
> ~ Logging in aaron_turner (CurrentUser:65)
> 2017-01-06 10:55:07,924 INFO  - [1234586997@qtp-1262548561-0 -
> 7cfdfb26-83c4-40c8-889c-13ff938d7ffd:aaron_turner:
> POST//sync/submit/cluster]
> ~ Request from authenticated user: aaron_turner,
> URL=/secure/sync/submit/cluster?colo=eng&&user.name=aaron_turner, doAs
> user: null (FalconAuthenticationFilter:185)
> 2017-01-06 10:55:07,925 DEBUG - [1234586997@qtp-1262548561-0 -
> 7cfdfb26-83c4-40c8-889c-13ff938d7ffd:] ~ Audit: aaron_turner/127.0.0.1
> performed request
> http://localhost:15000/secure/sync/submit/cluster?colo=eng&&
> user.name=aaron_turner
> (127.0.0.1) at time 2017-01-06T18:55Z (FalconAuditFilter:86)
> 2017-01-06 10:55:07,925 INFO  - [1234586997@qtp-1262548561-0 -
> 7cfdfb26-83c4-40c8-889c-13ff938d7ffd:] ~ Audit: aaron_turner@127.0.0.1
> performed http://localhost:15000/secure/sync/submit/cluster?colo=eng&&
> user.name=aaron_turner
> (127.0.0.1) at 2017-01-06T18:55Z (AUDIT:48)
> 2017-01-06 10:55:07,926 INFO  - [1234586997@qtp-1262548561-0 -
> 7cfdfb26-83c4-40c8-889c-13ff938d7ffd:] ~ Audit: aaron_turner@127.0.0.1
> performed http://localhost:15000/secure/sync/submit/cluster?colo=eng&&
> user.name=aaron_turner
> (127.0.0.1) at 2017-01-06T18:55Z (AUDIT:48)
>
> I'm guessing the prism backtrace is significant, but I don't see a
> smoking gun in the server log which explains what is going on.  If I
> connect to tcp/15000 I can login as "aaron_turner" in the falcon
> server web UI just fine.
> --
> Aaron Turner
> https://synfin.net/         Twitter: @synfinatic
> Those who would give up essential Liberty, to purchase a little temporary
> Safety, deserve neither Liberty nor Safety.
>     -- Benjamin Franklin
>
>
> On Thu, Jan 5, 2017 at 7:11 PM, Pallavi Rao <pallavi.rao@inmobi.com>
> wrote:
> > Aaron,
> > If you don't plan to use the graph API, you can disable
> MetadataMappingService
> > (by commenting out that line) in the startup.properties as a work-around.
> >
> > On Thu, Jan 5, 2017 at 11:48 PM, Aaron Turner <synfinatic@gmail.com>
> wrote:
> >
> >> Ok, I think I see what my problem is.
> >>
> >> First, my falcon-prism/conf/runtime.properties had:
> >>
> >> prism.falcon.local.endpoint=http://localhost:16444
> >>
> >> which pointed back at itself, not:
> >>
> >> prism.falcon.local.endpoint=http://localhost:15000
> >>
> >> which points at falcon server.  So I fixed that and restarted
> >> falcon-prism.  Now I get a different error:
> >>
> >> POST http://localhost:16444/api/entities/submit/cluster returned a
> >> response status of 400 Bad Request
> >> ERROR: Bad Request;local/org.apache.falcon.FalconException::org.
> >> apache.falcon.FalconException:
> >> <html>
> >> <head>
> >> <meta http-equiv="Content-Type" content="text/html;
> charset=ISO-8859-1"/>
> >> <title>Error 503 SERVICE_UNAVAILABLE</title>
> >> </head>
> >> <body>
> >> <h2>HTTP ERROR: 503</h2>
> >> <p>Problem accessing /secure/sync/submit/cluster. Reason:
> >> <pre>    SERVICE_UNAVAILABLE</pre></p>
> >> <hr /><i><small>Powered by Jetty://</small></i>
> >>
> >> The prism.application.log now says it's trying to talk to falcon-server:
> >>
> >> 2017-01-05 10:12:53,952 DEBUG - [352083716@qtp-771418758-0 -
> >> 9149b35e-3554-4775-bbd3-5ce30761ead8:aaron_turner:
> >> POST//entities/submit/cluster]
> >> ~ Executing http://localhost:15000/secure/sync/submit/cluster?colo=
> local&
> >> (HTTPChannel:96)
> >> 2017-01-05 10:12:53,953 INFO  - [352083716@qtp-771418758-0 -
> >> 9149b35e-3554-4775-bbd3-5ce30761ead8:aaron_turner:
> >> POST//entities/submit/cluster]
> >> ~ Configuring client with /usr/lib/falcon-prism/conf/prism.keystore
> >> (SecureHTTPChannel:56)
> >> 2017-01-05 10:12:54,033 ERROR - [352083716@qtp-771418758-0 -
> >> 9149b35e-3554-4775-bbd3-5ce30761ead8:aaron_turner:
> >> POST//entities/submit/cluster]
> >> ~ Request failed: 503 (HTTPChannel:127)
> >> 2017-01-05 10:12:54,035 ERROR - [352083716@qtp-771418758-0 -
> >> 9149b35e-3554-4775-bbd3-5ce30761ead8:aaron_turner:
> >> POST//entities/submit/cluster]
> >> ~ Request failed (HTTPChannel:134)
> >>
> >> Trying in my browser to connect to tcp/15000 gives me the same 503
> >> error.  So I went looking in the falcon.application.log for what the
> >> problem is:
> >>
> >>
> >> 2017-01-05 10:09:05,551 INFO  - [main:] ~ Initializing graph db
> >> (MetadataMappingService:143)
> >> 2017-01-05 10:09:05,610 INFO  - [main:] ~ The HBase version
> >> 1.2.0-cdh5.8.2 is not explicitly supported by Titan.  Loading Titan's
> >> compatibility layer for its most recent supported HBase version (1.1)
> >> (HBaseCompatLoader:57)
> >>
> >> <snip>
> >>
> >> 2017-01-05 10:09:05,832 WARN  - [main:] ~
> >> hbase.regionserver.global.memstore.upperLimit is deprecated by
> >> hbase.regionserver.global.memstore.size (HeapMemorySizeUtil:55)
> >> 2017-01-05 10:09:06,084 WARN  - [main:] ~ The short-circuit local
> >> reads feature cannot be used because libhadoop cannot be loaded.
> >> (DomainSocketFactory:117)
> >> 2017-01-05 10:09:06,088 INFO  - [main:] ~ Set a new configuration for
> >> the first time. (N:110)
> >> 2017-01-05 10:09:06,119 INFO  - [main:] ~ mapred.task.id is
> >> deprecated. Instead, use mapreduce.task.attempt.id (deprecation:1174)
> >> 2017-01-05 10:09:06,120 INFO  - [main:] ~ Scheduling statistics report
> >> every 2000 millisecs (u:110)
> >> 2017-01-05 10:09:06,120 INFO  - [main:] ~ Initialized the distributed
> >> file system (ThrottledDistributedFileSystem:110)
> >> 2017-01-05 10:09:06,421 INFO  - [main:] ~ hadoop.native.lib is
> >> deprecated. Instead, use io.native.lib.available (deprecation:1174)
> >> 2017-01-05 10:09:06,514 WARN  - [main:] ~
> >> hbase.regionserver.global.memstore.upperLimit is deprecated by
> >> hbase.regionserver.global.memstore.size (HeapMemorySizeUtil:55)
> >> 2017-01-05 10:09:06,521 ERROR - [main:] ~ Failed to initialize service
> >> org.apache.falcon.metadata.MetadataMappingService
> >> (ServiceInitializer:49)
> >> java.lang.RuntimeException: GraphFactory could not instantiate this
> >> Graph implementation [com.thinkaurelius.titan.core.TitanFactory].
> >> at com.tinkerpop.blueprints.GraphFactory.open(GraphFactory.java:50)
> >> at org.apache.falcon.metadata.MetadataMappingService.initializeGraphDB(
> >> MetadataMappingService.java:146)
> >> at org.apache.falcon.metadata.MetadataMappingService.init(
> >> MetadataMappingService.java:113)
> >> at org.apache.falcon.service.ServiceInitializer.initialize(
> >> ServiceInitializer.java:47)
> >> at org.apache.falcon.listener.ContextStartupListener.
> contextInitialized(
> >> ContextStartupListener.java:56)
> >> at org.mortbay.jetty.handler.ContextHandler.startContext(
> >> ContextHandler.java:550)
> >> at org.mortbay.jetty.servlet.Context.startContext(Context.java:136)
> >> at org.mortbay.jetty.webapp.WebAppContext.startContext(
> >> WebAppContext.java:1282)
> >> at org.mortbay.jetty.handler.ContextHandler.doStart(
> >> ContextHandler.java:519)
> >> at org.mortbay.jetty.webapp.WebAppContext.doStart(
> WebAppContext.java:499)
> >> at org.mortbay.component.AbstractLifeCycle.start(
> >> AbstractLifeCycle.java:50)
> >> at org.mortbay.jetty.handler.HandlerWrapper.doStart(
> >> HandlerWrapper.java:130)
> >> at org.mortbay.jetty.Server.doStart(Server.java:224)
> >> at org.mortbay.component.AbstractLifeCycle.start(
> >> AbstractLifeCycle.java:50)
> >> at org.apache.falcon.util.EmbeddedServer.start(EmbeddedServer.java:58)
> >> at org.apache.falcon.FalconServer.main(FalconServer.java:118)
> >> Caused by: java.lang.reflect.InvocationTargetException
> >> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> >> at sun.reflect.NativeMethodAccessorImpl.invoke(
> >> NativeMethodAccessorImpl.java:62)
> >> at sun.reflect.DelegatingMethodAccessorImpl.invoke(
> >> DelegatingMethodAccessorImpl.java:43)
> >> at java.lang.reflect.Method.invoke(Method.java:498)
> >> at com.tinkerpop.blueprints.GraphFactory.open(GraphFactory.java:45)
> >> ... 15 more
> >> Caused by: java.lang.NoSuchMethodError:
> >> org.apache.hadoop.hbase.HTableDescriptor.addFamily(
> >> Lorg/apache/hadoop/hbase/HColumnDescriptor;)Lorg/apache/hadoop/hbase/
> >> HTableDescriptor;
> >> at com.thinkaurelius.titan.diskstorage.hbase.HBaseCompat1_1.
> >> addColumnFamilyToTableDescriptor(HBaseCompat1_1.java:49)
> >> at com.thinkaurelius.titan.diskstorage.hbase.
> >> HBaseStoreManager.createTable(HBaseStoreManager.java:728)
> >> at com.thinkaurelius.titan.diskstorage.hbase.HBaseStoreManager.
> >> ensureTableExists(HBaseStoreManager.java:711)
> >> at com.thinkaurelius.titan.diskstorage.hbase.HBaseStoreManager.
> >> getLocalKeyPartition(HBaseStoreManager.java:511)
> >> at com.thinkaurelius.titan.diskstorage.hbase.HBaseStoreManager.
> >> getDeployment(HBaseStoreManager.java:352)
> >> at com.thinkaurelius.titan.diskstorage.hbase.
> >> HBaseStoreManager.getFeatures(HBaseStoreManager.java:395)
> >> at com.thinkaurelius.titan.graphdb.configuration.
> >> GraphDatabaseConfiguration.<init>(GraphDatabaseConfiguration.java:1276)
> >> at com.thinkaurelius.titan.core.TitanFactory.open(TitanFactory.java:93)
> >> at com.thinkaurelius.titan.core.TitanFactory.open(TitanFactory.java:73)
> >> ... 20 more
> >> 2017-01-05 10:09:06,524 ERROR - [main:] ~ Failed startup of context
> >> org.mortbay.jetty.webapp.WebAppContext@6caf7803{/,/usr/
> >> lib/falcon-server/server/webapp/falcon}
> >> (log:87)
> >> java.lang.RuntimeException: org.apache.falcon.FalconException:
> >> java.lang.RuntimeException: GraphFactory could not instantiate this
> >> Graph implementation [com.thinkaurelius.titan.core.TitanFactory].
> >> at org.apache.falcon.listener.ContextStartupListener.
> contextInitialized(
> >> ContextStartupListener.java:59)
> >> at org.mortbay.jetty.handler.ContextHandler.startContext(
> >> ContextHandler.java:550)
> >> at org.mortbay.jetty.servlet.Context.startContext(Context.java:136)
> >> at org.mortbay.jetty.webapp.WebAppContext.startContext(
> >> WebAppContext.java:1282)
> >> at org.mortbay.jetty.handler.ContextHandler.doStart(
> >> ContextHandler.java:519)
> >> at org.mortbay.jetty.webapp.WebAppContext.doStart(
> WebAppContext.java:499)
> >> at org.mortbay.component.AbstractLifeCycle.start(
> >> AbstractLifeCycle.java:50)
> >> at org.mortbay.jetty.handler.HandlerWrapper.doStart(
> >> HandlerWrapper.java:130)
> >> at org.mortbay.jetty.Server.doStart(Server.java:224)
> >> at org.mortbay.component.AbstractLifeCycle.start(
> >> AbstractLifeCycle.java:50)
> >> at org.apache.falcon.util.EmbeddedServer.start(EmbeddedServer.java:58)
> >> at org.apache.falcon.FalconServer.main(FalconServer.java:118)
> >> Caused by: org.apache.falcon.FalconException:
> >> java.lang.RuntimeException: GraphFactory could not instantiate this
> >> Graph implementation [com.thinkaurelius.titan.core.TitanFactory].
> >> at org.apache.falcon.service.ServiceInitializer.initialize(
> >> ServiceInitializer.java:50)
> >> at org.apache.falcon.listener.ContextStartupListener.
> contextInitialized(
> >> ContextStartupListener.java:56)
> >> ... 11 more
> >> Caused by: java.lang.RuntimeException: GraphFactory could not
> >> instantiate this Graph implementation
> >> [com.thinkaurelius.titan.core.TitanFactory].
> >> at com.tinkerpop.blueprints.GraphFactory.open(GraphFactory.java:50)
> >> at org.apache.falcon.metadata.MetadataMappingService.initializeGraphDB(
> >> MetadataMappingService.java:146)
> >> at org.apache.falcon.metadata.MetadataMappingService.init(
> >> MetadataMappingService.java:113)
> >> at org.apache.falcon.service.ServiceInitializer.initialize(
> >> ServiceInitializer.java:47)
> >> ... 12 more
> >> Caused by: java.lang.reflect.InvocationTargetException
> >> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> >> at sun.reflect.NativeMethodAccessorImpl.invoke(
> >> NativeMethodAccessorImpl.java:62)
> >> at sun.reflect.DelegatingMethodAccessorImpl.invoke(
> >> DelegatingMethodAccessorImpl.java:43)
> >> at java.lang.reflect.Method.invoke(Method.java:498)
> >> at com.tinkerpop.blueprints.GraphFactory.open(GraphFactory.java:45)
> >> ... 15 more
> >> Caused by: java.lang.NoSuchMethodError:
> >> org.apache.hadoop.hbase.HTableDescriptor.addFamily(
> >> Lorg/apache/hadoop/hbase/HColumnDescriptor;)Lorg/apache/hadoop/hbase/
> >> HTableDescriptor;
> >> at com.thinkaurelius.titan.diskstorage.hbase.HBaseCompat1_1.
> >> addColumnFamilyToTableDescriptor(HBaseCompat1_1.java:49)
> >> at com.thinkaurelius.titan.diskstorage.hbase.
> >> HBaseStoreManager.createTable(HBaseStoreManager.java:728)
> >> at com.thinkaurelius.titan.diskstorage.hbase.HBaseStoreManager.
> >> ensureTableExists(HBaseStoreManager.java:711)
> >> at com.thinkaurelius.titan.diskstorage.hbase.HBaseStoreManager.
> >> getLocalKeyPartition(HBaseStoreManager.java:511)
> >> at com.thinkaurelius.titan.diskstorage.hbase.HBaseStoreManager.
> >> getDeployment(HBaseStoreManager.java:352)
> >> at com.thinkaurelius.titan.diskstorage.hbase.
> >> HBaseStoreManager.getFeatures(HBaseStoreManager.java:395)
> >> at com.thinkaurelius.titan.graphdb.configuration.
> >> GraphDatabaseConfiguration.<init>(GraphDatabaseConfiguration.java:1276)
> >> at com.thinkaurelius.titan.core.TitanFactory.open(TitanFactory.java:93)
> >> at com.thinkaurelius.titan.core.TitanFactory.open(TitanFactory.java:73)
> >> ... 20 more
> >> 2017-01-05 10:09:06,525 INFO  - [main:] ~ Started
> >> SocketConnector@0.0.0.0:15000 (log:67)
> >> 2017-01-05 10:14:04,983 INFO  - [Thread-16:] ~ config.location is set,
> >> using: /usr/lib/falcon-server/conf/runtime.properties
> >> (ApplicationProperties:120)
> >> 2017-01-05 10:14:04,983 INFO  - [Thread-16:] ~ Initializing
> >> org.apache.falcon.util.RuntimeProperties properties with domain falcon
> >> (ApplicationProperties:156)
> >> 2017-01-05 10:14:04,983 DEBUG - [Thread-16:] ~
> >> feed.retry.policy=exp-backoff (ApplicationProperties:162)
> >> 2017-01-05 10:14:04,983 DEBUG - [Thread-16:] ~
> >> feed.retry.frequency=minutes(5) (ApplicationProperties:162)
> >> 2017-01-05 10:14:04,983 DEBUG - [Thread-16:] ~
> >> workflow.status.retry.count=30 (ApplicationProperties:162)
> >> 2017-01-05 10:14:04,983 DEBUG - [Thread-16:] ~
> >> falcon.service.ProxyUserService.proxyuser.#USER#.hosts=*
> >> (ApplicationProperties:162)
> >> 2017-01-05 10:14:04,984 DEBUG - [Thread-16:] ~ feed.late.allowed=true
> >> (ApplicationProperties:162)
> >> 2017-01-05 10:14:04,984 DEBUG - [Thread-16:] ~
> >> webservices.default.results.per.page=10 (ApplicationProperties:162)
> >> 2017-01-05 10:14:04,984 DEBUG - [Thread-16:] ~
> >> feed.retry.onTimeout=false (ApplicationProperties:162)
> >> 2017-01-05 10:14:04,984 DEBUG - [Thread-16:] ~
> >> falcon.jms.notification.enabled=true (ApplicationProperties:162)
> >> 2017-01-05 10:14:04,984 DEBUG - [Thread-16:] ~
> >> falcon.retention.keep.instances.beyond.validity=true
> >> (ApplicationProperties:162)
> >> 2017-01-05 10:14:04,984 DEBUG - [Thread-16:] ~
> >> feed.late.policy=exp-backoff (ApplicationProperties:162)
> >> 2017-01-05 10:14:04,984 DEBUG - [Thread-16:] ~ current.colo=local
> >> (ApplicationProperties:162)
> >> 2017-01-05 10:14:04,984 DEBUG - [Thread-16:] ~ domain=falcon
> >> (ApplicationProperties:162)
> >> 2017-01-05 10:14:04,984 DEBUG - [Thread-16:] ~
> >> feed.late.frequency=hours(3) (ApplicationProperties:162)
> >> 2017-01-05 10:14:04,984 DEBUG - [Thread-16:] ~
> >> falcon.skip.dryrun=false (ApplicationProperties:162)
> >> 2017-01-05 10:14:04,984 DEBUG - [Thread-16:] ~ feed.retry.attempts=3
> >> (ApplicationProperties:162)
> >> 2017-01-05 10:14:04,984 DEBUG - [Thread-16:] ~
> >> falcon.service.ProxyUserService.proxyuser.#USER#.groups=*
> >> (ApplicationProperties:162)
> >> 2017-01-05 10:14:04,984 INFO  - [Thread-16:] ~ config.location is set,
> >> using: /usr/lib/falcon-server/conf/runtime.properties
> >> (ApplicationProperties:120)
> >> 2017-01-05 10:14:04,985 INFO  - [Thread-16:] ~ Initializing
> >> org.apache.falcon.util.RuntimeProperties properties with domain falcon
> >> (ApplicationProperties:156)
> >> 2017-01-05 10:14:04,985 DEBUG - [Thread-16:] ~
> >> feed.retry.policy=exp-backoff (ApplicationProperties:162)
> >> 2017-01-05 10:14:04,985 DEBUG - [Thread-16:] ~
> >> feed.retry.frequency=minutes(5) (ApplicationProperties:162)
> >> 2017-01-05 10:14:04,985 DEBUG - [Thread-16:] ~
> >> workflow.status.retry.count=30 (ApplicationProperties:162)
> >> 2017-01-05 10:14:04,985 DEBUG - [Thread-16:] ~
> >> falcon.service.ProxyUserService.proxyuser.#USER#.hosts=*
> >> (ApplicationProperties:162)
> >> 2017-01-05 10:14:04,985 DEBUG - [Thread-16:] ~ feed.late.allowed=true
> >> (ApplicationProperties:162)
> >> 2017-01-05 10:14:04,985 DEBUG - [Thread-16:] ~
> >> webservices.default.results.per.page=10 (ApplicationProperties:162)
> >> 2017-01-05 10:14:04,985 DEBUG - [Thread-16:] ~
> >> feed.retry.onTimeout=false (ApplicationProperties:162)
> >> 2017-01-05 10:14:04,985 DEBUG - [Thread-16:] ~
> >> falcon.jms.notification.enabled=true (ApplicationProperties:162)
> >> 2017-01-05 10:14:04,985 DEBUG - [Thread-16:] ~
> >> falcon.retention.keep.instances.beyond.validity=true
> >> (ApplicationProperties:162)
> >> 2017-01-05 10:14:04,985 DEBUG - [Thread-16:] ~
> >> feed.late.policy=exp-backoff (ApplicationProperties:162)
> >> 2017-01-05 10:14:04,985 DEBUG - [Thread-16:] ~ current.colo=local
> >> (ApplicationProperties:162)
> >> 2017-01-05 10:14:04,985 DEBUG - [Thread-16:] ~ domain=falcon
> >> (ApplicationProperties:162)
> >> 2017-01-05 10:14:04,985 DEBUG - [Thread-16:] ~
> >> feed.late.frequency=hours(3) (ApplicationProperties:162)
> >> 2017-01-05 10:14:04,985 DEBUG - [Thread-16:] ~
> >> falcon.skip.dryrun=false (ApplicationProperties:162)
> >> 2017-01-05 10:14:04,985 DEBUG - [Thread-16:] ~ feed.retry.attempts=3
> >> (ApplicationProperties:162)
> >> 2017-01-05 10:14:04,985 DEBUG - [Thread-16:] ~
> >> falcon.service.ProxyUserService.proxyuser.#USER#.groups=*
> >> (ApplicationProperties:162)
> >>
> >> So it appears my problem is that CDH5.8.2 is shipping a more recent
> >> version of Hbase then Titan supports?  Not sure if there is a work
> >> around or should I switch to BerkeleyDB?
> >>
> >
> > --
> > _____________________________________________________________
> > The information contained in this communication is intended solely for
> the
> > use of the individual or entity to whom it is addressed and others
> > authorized to receive it. It may contain confidential or legally
> privileged
> > information. If you are not the intended recipient you are hereby
> notified
> > that any disclosure, copying, distribution or taking any action in
> reliance
> > on the contents of this information is strictly prohibited and may be
> > unlawful. If you have received this communication in error, please notify
> > us immediately by responding to this email and then delete it from your
> > system. The firm is neither liable for the proper and complete
> transmission
> > of the information contained in this communication nor for any delay in
> its
> > receipt.
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message