falcon-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Ajay Yadav <ajayn...@gmail.com>
Subject Re: Cluster entity vertex must exist
Date Tue, 26 Jul 2016 13:34:29 GMT
Is it possible for you to try the latest stable release 0.9?

Around 0.6/0.6.1 graph db (used by Apache Falcon to store instances) of
Apache Falcon had several issues so I will strongly recommend upgrading.



On Tue, 26 Jul 2016 at 19:00 Margus Roo <margus@roo.ee> wrote:

> Hi
>
> I am using falcon 0.6.1
>
> When I am trying to submit process or feed I am getting error:
>
> Cluster entity vertex must exist
>
> In case I just restarted falcon server then I can submit process or feed:
>
> [margusja@hadoopnn2 ~]$ falcon entity -submit -type process -file web3.xml
> falcon/default/Submit successful (process) sign--web3
>
> But after I deleted process:
>
> [margusja@hadoopnn2 ~]$ falcon entity -delete -type process -name
> sign--web3
> falcon/default/sign--web3(process) removed successfully (KILLED in ENGINE)
>
> And I try to submit again then I am getting:
>
> [margusja@hadoopnn2 ~]$ falcon entity -submit -type process -file web3.xml
> ERROR: Bad
> Request;default/org.apache.falcon.FalconWebException::org.apache.falcon.FalconException:
> java.lang.RuntimeException: java.lang.IllegalStateException: Cluster entity
> vertex must exist: Cluster2
>
> and in log:
>
> 2016-07-26 16:28:26,873 INFO  - [63390@qtp-1536471117-0 -
> aa4fe6b0-3d10-4fcd-b8fe-d83ee9e6f7b7:] ~ HttpServletRequest RemoteUser is
> null (Servlets:47)
> 2016-07-26 16:28:26,873 INFO  - [63390@qtp-1536471117-0 -
> aa4fe6b0-3d10-4fcd-b8fe-d83ee9e6f7b7:] ~ HttpServletRequest user.name
> param value is margusja (Servlets:53)
> 2016-07-26 16:28:27,010 INFO  - [2138332724@qtp-1536471117-3 -
> b0cea0a4-efff-48c8-a81f-5c9ffda411a7:] ~ HttpServletRequest RemoteUser is
> null (Servlets:47)
> 2016-07-26 16:28:27,011 INFO  - [2138332724@qtp-1536471117-3 -
> b0cea0a4-efff-48c8-a81f-5c9ffda411a7:] ~ HttpServletRequest user.name
> param value is margusja (Servlets:53)
> 2016-07-26 16:28:27,358 INFO  - [2138332724@qtp-1536471117-3 -
> 1e1fa678-4426-4398-b942-348c5742cc68:] ~ HttpServletRequest RemoteUser is
> falcon (Servlets:47)
> 2016-07-26 16:28:27,359 INFO  - [2138332724@qtp-1536471117-3 -
> 1e1fa678-4426-4398-b942-348c5742cc68:falcon:POST//entities/submit/process]
> ~ Logging in falcon (CurrentUser:65)
> 2016-07-26 16:28:27,359 INFO  - [2138332724@qtp-1536471117-3 -
> 1e1fa678-4426-4398-b942-348c5742cc68:falcon:POST//entities/submit/process]
> ~ Request from authenticated user: falcon,
> URL=/api/entities/submit/process, doAs user: null
> (FalconAuthenticationFilter:185)
> 2016-07-26 16:28:27,362 INFO  - [2138332724@qtp-1536471117-3 -
> 1e1fa678-4426-4398-b942-348c5742cc68:falcon:POST//entities/submit/process]
> ~ Parsed Entity: sign--web3 (EntityParser:95)
> 2016-07-26 16:28:27,364 INFO  - [2138332724@qtp-1536471117-3 -
> 1e1fa678-4426-4398-b942-348c5742cc68:falcon:POST//entities/submit/process]
> ~ Parsed Entity: sign--web3 (EntityParser:95)
> 2016-07-26 16:28:27,381 INFO  - [2138332724@qtp-1536471117-3 -
> 1e1fa678-4426-4398-b942-348c5742cc68:falcon:POST//entities/submit/process]
> ~ Creating FS for the login user falcon, impersonation not required
> (HadoopClientFactory:191)
> 2016-07-26 16:28:27,406 INFO  - [2138332724@qtp-1536471117-3 -
> 1e1fa678-4426-4398-b942-348c5742cc68:falcon:POST//entities/submit/process]
> ~ Persisted configuration PROCESS/sign--web3 (ConfigurationStore:371)
> 2016-07-26 16:28:27,407 INFO  - [2138332724@qtp-1536471117-3 -
> 1e1fa678-4426-4398-b942-348c5742cc68:falcon:POST//entities/submit/process]
> ~ Adding lineage for entity: sign--web3, type: PROCESS
> (MetadataMappingService:209)
> 2016-07-26 16:28:27,409 INFO  - [2138332724@qtp-1536471117-3 -
> 1e1fa678-4426-4398-b942-348c5742cc68:falcon:POST//entities/submit/process]
> ~ Adding process entity: sign--web3 (EntityRelationshipGraphBuilder:131)
> 2016-07-26 16:28:27,465 ERROR - [2138332724@qtp-1536471117-3 -
> 1e1fa678-4426-4398-b942-348c5742cc68:falcon:POST//entities/submit/process]
> ~ Illegal State: Cluster entity vertex must exist for Cluster2
> (EntityRelationshipGraphBuilder:173)
> 2016-07-26 16:28:27,476 INFO  - [2138332724@qtp-1536471117-3 -
> 1e1fa678-4426-4398-b942-348c5742cc68:falcon:POST//entities/submit/process]
> ~ Adding process entity: sign--web3 (EntityRelationshipGraphBuilder:131)
> 2016-07-26 16:28:27,497 ERROR - [2138332724@qtp-1536471117-3 -
> 1e1fa678-4426-4398-b942-348c5742cc68:falcon:POST//entities/submit/process]
> ~ Illegal State: Cluster entity vertex must exist for Cluster2
> (EntityRelationshipGraphBuilder:173)
> 2016-07-26 16:28:27,518 INFO  - [2138332724@qtp-1536471117-3 -
> 1e1fa678-4426-4398-b942-348c5742cc68:falcon:POST//entities/submit/process]
> ~ Adding process entity: sign--web3 (EntityRelationshipGraphBuilder:131)
> 2016-07-26 16:28:27,536 ERROR - [2138332724@qtp-1536471117-3 -
> 1e1fa678-4426-4398-b942-348c5742cc68:falcon:POST//entities/submit/process]
> ~ Illegal State: Cluster entity vertex must exist for Cluster2
> (EntityRelationshipGraphBuilder:173)
> 2016-07-26 16:28:27,537 ERROR - [2138332724@qtp-1536471117-3 -
> 1e1fa678-4426-4398-b942-348c5742cc68:falcon:POST//entities/submit/process]
> ~ Unable to persist entity object (AbstractEntityManager:198)
> org.apache.falcon.FalconException: java.lang.RuntimeException:
> java.lang.IllegalStateException: Cluster entity vertex must exist: Cluster2
>         at
> org.apache.falcon.metadata.MetadataMappingService.onAdd(MetadataMappingService.java:223)
>         at
> org.apache.falcon.entity.store.ConfigurationStore.onAdd(ConfigurationStore.java:259)
>         at
> org.apache.falcon.entity.store.ConfigurationStore.publish(ConfigurationStore.java:219)
>         at
> org.apache.falcon.resource.AbstractEntityManager.submitInternal(AbstractEntityManager.java:414)
>         at
> org.apache.falcon.resource.AbstractEntityManager.submit(AbstractEntityManager.java:195)
>         at
> org.apache.falcon.resource.ConfigSyncService.submit(ConfigSyncService.java:50)
>         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>         at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
>         at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>         at java.lang.reflect.Method.invoke(Method.java:497)
>         at
> org.apache.falcon.resource.channel.IPCChannel.invoke(IPCChannel.java:49)
>         at
> org.apache.falcon.resource.proxy.SchedulableEntityManagerProxy$1.doExecute(SchedulableEntityManagerProxy.java:139)
>         at
> org.apache.falcon.resource.proxy.SchedulableEntityManagerProxy$EntityProxy.execute(SchedulableEntityManagerProxy.java:577)
>         at
> org.apache.falcon.resource.proxy.SchedulableEntityManagerProxy.submit_aroundBody0(SchedulableEntityManagerProxy.java:141)
>         at
> org.apache.falcon.resource.proxy.SchedulableEntityManagerProxy$AjcClosure1.run(SchedulableEntityManagerProxy.java:1)
>         at
> org.aspectj.runtime.reflect.JoinPointImpl.proceed(JoinPointImpl.java:149)
>         at
> org.apache.falcon.aspect.AbstractFalconAspect.logAroundMonitored(AbstractFalconAspect.java:51)
>         at
> org.apache.falcon.resource.proxy.SchedulableEntityManagerProxy.submit(SchedulableEntityManagerProxy.java:119)
>         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>         at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
>         at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>         at java.lang.reflect.Method.invoke(Method.java:497)
>         at
> com.sun.jersey.spi.container.JavaMethodInvokerFactory$1.invoke(JavaMethodInvokerFactory.java:60)
>         at
> com.sun.jersey.server.impl.model.method.dispatch.AbstractResourceMethodDispatchProvider$TypeOutInvoker._dispatch(AbstractResourceMethodDispatchProvider.java:185)
>         at
> com.sun.jersey.server.impl.model.method.dispatch.ResourceJavaMethodDispatcher.dispatch(ResourceJavaMethodDispatcher.java:75)
>         at
> com.sun.jersey.server.impl.uri.rules.HttpMethodRule.accept(HttpMethodRule.java:288)
>         at
> com.sun.jersey.server.impl.uri.rules.RightHandPathRule.accept(RightHandPathRule.java:147)
>
> ...
>
> Caused by: java.lang.RuntimeException: java.lang.IllegalStateException:
> Cluster entity vertex must exist: Cluster2
>         at
> com.tinkerpop.blueprints.util.TransactionRetryStrategy$AbstractRetryStrategy.execute(TransactionRetryStrategy.java:176)
>         at
> com.tinkerpop.blueprints.util.TransactionRetryHelper.use(TransactionRetryHelper.java:115)
>         at
> com.tinkerpop.blueprints.util.TransactionRetryHelper.exponentialBackoff(TransactionRetryHelper.java:94)
>         at
> org.apache.falcon.metadata.MetadataMappingService.onAdd(MetadataMappingService.java:211)
>         ... 64 more
> Caused by: java.lang.IllegalStateException: Cluster entity vertex must
> exist: Cluster2
>         at
> org.apache.falcon.metadata.EntityRelationshipGraphBuilder.addRelationToCluster(EntityRelationshipGraphBuilder.java:174)
>         at
> org.apache.falcon.metadata.EntityRelationshipGraphBuilder.addProcessEntity(EntityRelationshipGraphBuilder.java:140)
>         at
> org.apache.falcon.metadata.EntityRelationshipGraphBuilder.addEntity(EntityRelationshipGraphBuilder.java:62)
>         at
> org.apache.falcon.metadata.MetadataMappingService$1.execute(MetadataMappingService.java:215)
>         at
> org.apache.falcon.metadata.MetadataMappingService$1.execute(MetadataMappingService.java:212)
>         at
> com.tinkerpop.blueprints.util.TransactionRetryStrategy$AbstractRetryStrategy.execute(TransactionRetryStrategy.java:146)
>         ... 67 more
> 2016-07-26 16:28:27,541 ERROR - [2138332724@qtp-1536471117-3 -
> 1e1fa678-4426-4398-b942-348c5742cc68:falcon:POST//entities/submit/process]
> ~ Action failed: Bad Request
> Error: java.lang.RuntimeException: java.lang.IllegalStateException:
> Cluster entity vertex must exist: Cluster2 (FalconWebException:83)
> 2016-07-26 16:28:27,542 ERROR - [2138332724@qtp-1536471117-3 -
> 1e1fa678-4426-4398-b942-348c5742cc68:falcon:POST//entities/submit/process]
> ~ Action failed: Bad Request
> Error:
> default/org.apache.falcon.FalconWebException::org.apache.falcon.FalconException:
> java.lang.RuntimeException: java.lang.IllegalStateException: Cluster entity
> vertex must exist: Cluster2
>  (FalconWebException:83)
> 2016-07-26 16:28:27,542 INFO  - [2138332724@qtp-1536471117-3 -
> 1e1fa678-4426-4398-b942-348c5742cc68:falcon:POST//entities/submit/process]
> ~ {Action:submit, Dimensions:{colo=NULL, entityType=process}, Status:
> FAILED, Time-taken:182944401 ns} (METRIC:38)
> ~
>
>
> Any hints?
>
>
>
> --
> Margus (margusja) Roohttp://margus.roo.ee
> skype: margusja
> +372 51 48 780
>
>

Mime
View raw message