falcon-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Margus Roo <mar...@roo.ee>
Subject Re: Cluster entity vertex must exist
Date Wed, 27 Jul 2016 08:46:02 GMT
Great! It helped!

That is the impact I hoped from userlist :)

Margus (margusja) Roo
http://margus.roo.ee
skype: margusja
+372 51 48 780

On 27/07/16 11:27, Pallavi Rao wrote:
> Margus,
> Looks like the problem you are facing is similar to what is reported 
> in FALCON-1955 <https://issues.apache.org/jira/browse/FALCON-1955>. 
> And, the workaround is similar too. The problem goes away on restart, 
> but, comes back later. Guess, will need to dig deeper for a fix.
>
> If you are NOT using any of the metadata APIs of Falcon (/falcon 
> metadata/ commands of the CLI), you can disable the service in 
> startup.properties temporarily till we have a fix for FALCON-1955 
> <https://issues.apache.org/jira/browse/FALCON-1955>, so that your 
> entity submission is not blocked on this.
>
> On Wed, Jul 27, 2016 at 1:35 PM, Margus Roo <margus@roo.ee 
> <mailto:margus@roo.ee>> wrote:
>
>     As I understand thous lines will define db in startup.properties file
>
>     *.falcon.graph.storage.backend=berkeleyje
>     *.falcon.graph.storage.directory=/tmp/hadoop/falcon/data/lineage/graphdb
>
>     in directory /tmp/hadoop/falcon/data/lineage/graphdb I have files
>
>     -rw-r--r-- 1 falcon hadoop 65K Jul 27 11:01 00000000.jdb
>     -rw-r--r-- 1 falcon hadoop   0 Jul 26 14:25 je.info.0
>     -rw-r--r-- 1 falcon hadoop   0 Jul 26 14:25 je.info.0.lck
>     -rw-r--r-- 1 falcon hadoop   0 Jul 26 14:25 je.lck
>
>     Is it possible to connect using some utilit and check what is
>     wrong inside? I can delete /tmp/hadoop/falcon/data/lineage/graphdb
>     and restart falcon but after some time the problem is back.
>
>     I can create a new Cluster in example Cluster3 and it works
>     without problems. But I have loads of feeds and processes are
>     working with Cluster2 (the problematic).
>
>     Is there any workaround to fix Cluster2 ?
>
>
>     Margus (margusja) Roo
>     http://margus.roo.ee
>     skype: margusja
>     +372 51 48 780
>
>     On 26/07/16 16:34, Ajay Yadav wrote:
>>     Is it possible for you to try the latest stable release 0.9?
>>
>>     Around 0.6/0.6.1 graph db (used by Apache Falcon to store
>>     instances) of Apache Falcon had several issues so I will strongly
>>     recommend upgrading.
>>
>>
>>
>>     On Tue, 26 Jul 2016 at 19:00 Margus Roo <margus@roo.ee
>>     <mailto:margus@roo.ee>> wrote:
>>
>>         Hi
>>
>>         I am using falcon 0.6.1
>>
>>         When I am trying to submit process or feed I am getting error:
>>
>>         Cluster entity vertex must exist
>>
>>         In case I just restarted falcon server then I can submit
>>         process or feed:
>>
>>         [margusja@hadoopnn2 ~]$ falcon entity -submit -type process
>>         -file web3.xml
>>         falcon/default/Submit successful (process) sign--web3
>>
>>         But after I deleted process:
>>
>>         [margusja@hadoopnn2 ~]$ falcon entity -delete -type process
>>         -name sign--web3
>>         falcon/default/sign--web3(process) removed successfully
>>         (KILLED in ENGINE)
>>
>>         And I try to submit again then I am getting:
>>
>>         [margusja@hadoopnn2 ~]$ falcon entity -submit -type process
>>         -file web3.xml
>>         ERROR: Bad
>>         Request;default/org.apache.falcon.FalconWebException::org.apache.falcon.FalconException:
>>         java.lang.RuntimeException: java.lang.IllegalStateException:
>>         Cluster entity vertex must exist: Cluster2
>>
>>         and in log:
>>
>>         2016-07-26 16:28:26,873 INFO  - [63390@qtp-1536471117-0 -
>>         aa4fe6b0-3d10-4fcd-b8fe-d83ee9e6f7b7:] ~ HttpServletRequest
>>         RemoteUser is null (Servlets:47)
>>         2016-07-26 16:28:26,873 INFO  - [63390@qtp-1536471117-0 -
>>         aa4fe6b0-3d10-4fcd-b8fe-d83ee9e6f7b7:] ~ HttpServletRequest
>>         user.name <http://user.name> param value is margusja
>>         (Servlets:53)
>>         2016-07-26 16:28:27,010 INFO  - [2138332724@qtp-1536471117-3
>>         - b0cea0a4-efff-48c8-a81f-5c9ffda411a7:] ~ HttpServletRequest
>>         RemoteUser is null (Servlets:47)
>>         2016-07-26 16:28:27,011 INFO  - [2138332724@qtp-1536471117-3
>>         - b0cea0a4-efff-48c8-a81f-5c9ffda411a7:] ~ HttpServletRequest
>>         user.name <http://user.name> param value is margusja
>>         (Servlets:53)
>>         2016-07-26 16:28:27,358 INFO  - [2138332724@qtp-1536471117-3
>>         - 1e1fa678-4426-4398-b942-348c5742cc68:] ~ HttpServletRequest
>>         RemoteUser is falcon (Servlets:47)
>>         2016-07-26 16:28:27,359 INFO  - [2138332724@qtp-1536471117-3
>>         -
>>         1e1fa678-4426-4398-b942-348c5742cc68:falcon:POST//entities/submit/process]
>>         ~ Logging in falcon (CurrentUser:65)
>>         2016-07-26 16:28:27,359 INFO  - [2138332724@qtp-1536471117-3
>>         -
>>         1e1fa678-4426-4398-b942-348c5742cc68:falcon:POST//entities/submit/process]
>>         ~ Request from authenticated user: falcon,
>>         URL=/api/entities/submit/process, doAs user: null
>>         (FalconAuthenticationFilter:185)
>>         2016-07-26 16:28:27,362 INFO  - [2138332724@qtp-1536471117-3
>>         -
>>         1e1fa678-4426-4398-b942-348c5742cc68:falcon:POST//entities/submit/process]
>>         ~ Parsed Entity: sign--web3 (EntityParser:95)
>>         2016-07-26 16:28:27,364 INFO  - [2138332724@qtp-1536471117-3
>>         -
>>         1e1fa678-4426-4398-b942-348c5742cc68:falcon:POST//entities/submit/process]
>>         ~ Parsed Entity: sign--web3 (EntityParser:95)
>>         2016-07-26 16:28:27,381 INFO  - [2138332724@qtp-1536471117-3
>>         -
>>         1e1fa678-4426-4398-b942-348c5742cc68:falcon:POST//entities/submit/process]
>>         ~ Creating FS for the login user falcon, impersonation not
>>         required (HadoopClientFactory:191)
>>         2016-07-26 16:28:27,406 INFO  - [2138332724@qtp-1536471117-3
>>         -
>>         1e1fa678-4426-4398-b942-348c5742cc68:falcon:POST//entities/submit/process]
>>         ~ Persisted configuration PROCESS/sign--web3
>>         (ConfigurationStore:371)
>>         2016-07-26 16:28:27,407 INFO  - [2138332724@qtp-1536471117-3
>>         -
>>         1e1fa678-4426-4398-b942-348c5742cc68:falcon:POST//entities/submit/process]
>>         ~ Adding lineage for entity: sign--web3, type: PROCESS
>>         (MetadataMappingService:209)
>>         2016-07-26 16:28:27,409 INFO  - [2138332724@qtp-1536471117-3
>>         -
>>         1e1fa678-4426-4398-b942-348c5742cc68:falcon:POST//entities/submit/process]
>>         ~ Adding process entity: sign--web3
>>         (EntityRelationshipGraphBuilder:131)
>>         2016-07-26 16:28:27,465 ERROR - [2138332724@qtp-1536471117-3
>>         -
>>         1e1fa678-4426-4398-b942-348c5742cc68:falcon:POST//entities/submit/process]
>>         ~ Illegal State: Cluster entity vertex must exist for
>>         Cluster2 (EntityRelationshipGraphBuilder:173)
>>         2016-07-26 16:28:27,476 INFO  - [2138332724@qtp-1536471117-3
>>         -
>>         1e1fa678-4426-4398-b942-348c5742cc68:falcon:POST//entities/submit/process]
>>         ~ Adding process entity: sign--web3
>>         (EntityRelationshipGraphBuilder:131)
>>         2016-07-26 16:28:27,497 ERROR - [2138332724@qtp-1536471117-3
>>         -
>>         1e1fa678-4426-4398-b942-348c5742cc68:falcon:POST//entities/submit/process]
>>         ~ Illegal State: Cluster entity vertex must exist for
>>         Cluster2 (EntityRelationshipGraphBuilder:173)
>>         2016-07-26 16:28:27,518 INFO  - [2138332724@qtp-1536471117-3
>>         -
>>         1e1fa678-4426-4398-b942-348c5742cc68:falcon:POST//entities/submit/process]
>>         ~ Adding process entity: sign--web3
>>         (EntityRelationshipGraphBuilder:131)
>>         2016-07-26 16:28:27,536 ERROR - [2138332724@qtp-1536471117-3
>>         -
>>         1e1fa678-4426-4398-b942-348c5742cc68:falcon:POST//entities/submit/process]
>>         ~ Illegal State: Cluster entity vertex must exist for
>>         Cluster2 (EntityRelationshipGraphBuilder:173)
>>         2016-07-26 16:28:27,537 ERROR - [2138332724@qtp-1536471117-3
>>         -
>>         1e1fa678-4426-4398-b942-348c5742cc68:falcon:POST//entities/submit/process]
>>         ~ Unable to persist entity object (AbstractEntityManager:198)
>>         org.apache.falcon.FalconException:
>>         java.lang.RuntimeException: java.lang.IllegalStateException:
>>         Cluster entity vertex must exist: Cluster2
>>                 at
>>         org.apache.falcon.metadata.MetadataMappingService.onAdd(MetadataMappingService.java:223)
>>                 at
>>         org.apache.falcon.entity.store.ConfigurationStore.onAdd(ConfigurationStore.java:259)
>>                 at
>>         org.apache.falcon.entity.store.ConfigurationStore.publish(ConfigurationStore.java:219)
>>                 at
>>         org.apache.falcon.resource.AbstractEntityManager.submitInternal(AbstractEntityManager.java:414)
>>                 at
>>         org.apache.falcon.resource.AbstractEntityManager.submit(AbstractEntityManager.java:195)
>>                 at
>>         org.apache.falcon.resource.ConfigSyncService.submit(ConfigSyncService.java:50)
>>                 at
>>         sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>>                 at
>>         sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
>>                 at
>>         sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>>                 at java.lang.reflect.Method.invoke(Method.java:497)
>>                 at
>>         org.apache.falcon.resource.channel.IPCChannel.invoke(IPCChannel.java:49)
>>                 at
>>         org.apache.falcon.resource.proxy.SchedulableEntityManagerProxy$1.doExecute(SchedulableEntityManagerProxy.java:139)
>>                 at
>>         org.apache.falcon.resource.proxy.SchedulableEntityManagerProxy$EntityProxy.execute(SchedulableEntityManagerProxy.java:577)
>>                 at
>>         org.apache.falcon.resource.proxy.SchedulableEntityManagerProxy.submit_aroundBody0(SchedulableEntityManagerProxy.java:141)
>>                 at
>>         org.apache.falcon.resource.proxy.SchedulableEntityManagerProxy$AjcClosure1.run(SchedulableEntityManagerProxy.java:1)
>>                 at
>>         org.aspectj.runtime.reflect.JoinPointImpl.proceed(JoinPointImpl.java:149)
>>                 at
>>         org.apache.falcon.aspect.AbstractFalconAspect.logAroundMonitored(AbstractFalconAspect.java:51)
>>                 at
>>         org.apache.falcon.resource.proxy.SchedulableEntityManagerProxy.submit(SchedulableEntityManagerProxy.java:119)
>>                 at
>>         sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>>                 at
>>         sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
>>                 at
>>         sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>>                 at java.lang.reflect.Method.invoke(Method.java:497)
>>                 at
>>         com.sun.jersey.spi.container.JavaMethodInvokerFactory$1.invoke(JavaMethodInvokerFactory.java:60)
>>                 at
>>         com.sun.jersey.server.impl.model.method.dispatch.AbstractResourceMethodDispatchProvider$TypeOutInvoker._dispatch(AbstractResourceMethodDispatchProvider.java:185)
>>                 at
>>         com.sun.jersey.server.impl.model.method.dispatch.ResourceJavaMethodDispatcher.dispatch(ResourceJavaMethodDispatcher.java:75)
>>                 at
>>         com.sun.jersey.server.impl.uri.rules.HttpMethodRule.accept(HttpMethodRule.java:288)
>>                 at
>>         com.sun.jersey.server.impl.uri.rules.RightHandPathRule.accept(RightHandPathRule.java:147)
>>
>>         ...
>>
>>         Caused by: java.lang.RuntimeException:
>>         java.lang.IllegalStateException: Cluster entity vertex must
>>         exist: Cluster2
>>                 at
>>         com.tinkerpop.blueprints.util.TransactionRetryStrategy$AbstractRetryStrategy.execute(TransactionRetryStrategy.java:176)
>>                 at
>>         com.tinkerpop.blueprints.util.TransactionRetryHelper.use(TransactionRetryHelper.java:115)
>>                 at
>>         com.tinkerpop.blueprints.util.TransactionRetryHelper.exponentialBackoff(TransactionRetryHelper.java:94)
>>                 at
>>         org.apache.falcon.metadata.MetadataMappingService.onAdd(MetadataMappingService.java:211)
>>                 ... 64 more
>>         Caused by: java.lang.IllegalStateException: Cluster entity
>>         vertex must exist: Cluster2
>>                 at
>>         org.apache.falcon.metadata.EntityRelationshipGraphBuilder.addRelationToCluster(EntityRelationshipGraphBuilder.java:174)
>>                 at
>>         org.apache.falcon.metadata.EntityRelationshipGraphBuilder.addProcessEntity(EntityRelationshipGraphBuilder.java:140)
>>                 at
>>         org.apache.falcon.metadata.EntityRelationshipGraphBuilder.addEntity(EntityRelationshipGraphBuilder.java:62)
>>                 at
>>         org.apache.falcon.metadata.MetadataMappingService$1.execute(MetadataMappingService.java:215)
>>                 at
>>         org.apache.falcon.metadata.MetadataMappingService$1.execute(MetadataMappingService.java:212)
>>                 at
>>         com.tinkerpop.blueprints.util.TransactionRetryStrategy$AbstractRetryStrategy.execute(TransactionRetryStrategy.java:146)
>>                 ... 67 more
>>         2016-07-26 16:28:27,541 ERROR - [2138332724@qtp-1536471117-3
>>         -
>>         1e1fa678-4426-4398-b942-348c5742cc68:falcon:POST//entities/submit/process]
>>         ~ Action failed: Bad Request
>>         Error: java.lang.RuntimeException:
>>         java.lang.IllegalStateException: Cluster entity vertex must
>>         exist: Cluster2 (FalconWebException:83)
>>         2016-07-26 16:28:27,542 ERROR - [2138332724@qtp-1536471117-3
>>         -
>>         1e1fa678-4426-4398-b942-348c5742cc68:falcon:POST//entities/submit/process]
>>         ~ Action failed: Bad Request
>>         Error:
>>         default/org.apache.falcon.FalconWebException::org.apache.falcon.FalconException:
>>         java.lang.RuntimeException: java.lang.IllegalStateException:
>>         Cluster entity vertex must exist: Cluster2
>>          (FalconWebException:83)
>>         2016-07-26 16:28:27,542 INFO  - [2138332724@qtp-1536471117-3
>>         -
>>         1e1fa678-4426-4398-b942-348c5742cc68:falcon:POST//entities/submit/process]
>>         ~ {Action:submit, Dimensions:{colo=NULL, entityType=process},
>>         Status: FAILED, Time-taken:182944401 ns} (METRIC:38)
>>         ~
>>
>>
>>         Any hints?
>>
>>
>>
>>         -- 
>>         Margus (margusja) Roo
>>         http://margus.roo.ee
>>         skype: margusja
>>         +372 51 48 780
>>
>
>
>
> _____________________________________________________________
> The information contained in this communication is intended solely for 
> the use of the individual or entity to whom it is addressed and others 
> authorized to receive it. It may contain confidential or legally 
> privileged information. If you are not the intended recipient you are 
> hereby notified that any disclosure, copying, distribution or taking 
> any action in reliance on the contents of this information is strictly 
> prohibited and may be unlawful. If you have received this 
> communication in error, please notify us immediately by responding to 
> this email and then delete it from your system. The firm is neither 
> liable for the proper and complete transmission of the information 
> contained in this communication nor for any delay in its receipt. 


Mime
View raw message