falcon-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Pallavi Rao <pallavi....@inmobi.com>
Subject Re: Cluster entity vertex must exist
Date Wed, 27 Jul 2016 08:27:51 GMT
Margus,
Looks like the problem you are facing is similar to what is reported in
FALCON-1955 <https://issues.apache.org/jira/browse/FALCON-1955>. And, the
workaround is similar too. The problem goes away on restart, but, comes
back later. Guess, will need to dig deeper for a fix.

If you are NOT using any of the metadata APIs of Falcon (*falcon metadata*
commands of the CLI), you can disable the service in startup.properties
temporarily till we have a fix for FALCON-1955
<https://issues.apache.org/jira/browse/FALCON-1955>, so that your entity
submission is not blocked on this.

On Wed, Jul 27, 2016 at 1:35 PM, Margus Roo <margus@roo.ee> wrote:

> As I understand thous lines will define db in startup.properties file
>
> *.falcon.graph.storage.backend=berkeleyje
> *.falcon.graph.storage.directory=/tmp/hadoop/falcon/data/lineage/graphdb
>
> in directory /tmp/hadoop/falcon/data/lineage/graphdb I have files
>
> -rw-r--r-- 1 falcon hadoop 65K Jul 27 11:01 00000000.jdb
> -rw-r--r-- 1 falcon hadoop   0 Jul 26 14:25 je.info.0
> -rw-r--r-- 1 falcon hadoop   0 Jul 26 14:25 je.info.0.lck
> -rw-r--r-- 1 falcon hadoop   0 Jul 26 14:25 je.lck
>
> Is it possible to connect using some utilit and check what is wrong
> inside? I can delete /tmp/hadoop/falcon/data/lineage/graphdb and restart
> falcon but after some time the problem is back.
>
> I can create a new Cluster in example Cluster3 and it works without
> problems. But I have loads of feeds and processes are working with Cluster2
> (the problematic).
>
> Is there any workaround to fix Cluster2 ?
>
>
> Margus (margusja) Roohttp://margus.roo.ee
> skype: margusja
> +372 51 48 780
>
> On 26/07/16 16:34, Ajay Yadav wrote:
>
> Is it possible for you to try the latest stable release 0.9?
>
> Around 0.6/0.6.1 graph db (used by Apache Falcon to store instances) of
> Apache Falcon had several issues so I will strongly recommend upgrading.
>
>
>
> On Tue, 26 Jul 2016 at 19:00 Margus Roo <margus@roo.ee> wrote:
>
>> Hi
>>
>> I am using falcon 0.6.1
>>
>> When I am trying to submit process or feed I am getting error:
>>
>> Cluster entity vertex must exist
>>
>> In case I just restarted falcon server then I can submit process or feed:
>>
>> [margusja@hadoopnn2 ~]$ falcon entity -submit -type process -file
>> web3.xml
>> falcon/default/Submit successful (process) sign--web3
>>
>> But after I deleted process:
>>
>> [margusja@hadoopnn2 ~]$ falcon entity -delete -type process -name
>> sign--web3
>> falcon/default/sign--web3(process) removed successfully (KILLED in ENGINE)
>>
>> And I try to submit again then I am getting:
>>
>> [margusja@hadoopnn2 ~]$ falcon entity -submit -type process -file
>> web3.xml
>> ERROR: Bad
>> Request;default/org.apache.falcon.FalconWebException::org.apache.falcon.FalconException:
>> java.lang.RuntimeException: java.lang.IllegalStateException: Cluster entity
>> vertex must exist: Cluster2
>>
>> and in log:
>>
>> 2016-07-26 16:28:26,873 INFO  - [63390@qtp-1536471117-0 -
>> aa4fe6b0-3d10-4fcd-b8fe-d83ee9e6f7b7:] ~ HttpServletRequest RemoteUser is
>> null (Servlets:47)
>> 2016-07-26 16:28:26,873 INFO  - [63390@qtp-1536471117-0 -
>> aa4fe6b0-3d10-4fcd-b8fe-d83ee9e6f7b7:] ~ HttpServletRequest user.name
>> param value is margusja (Servlets:53)
>> 2016-07-26 16:28:27,010 INFO  - [2138332724@qtp-1536471117-3 -
>> b0cea0a4-efff-48c8-a81f-5c9ffda411a7:] ~ HttpServletRequest RemoteUser is
>> null (Servlets:47)
>> 2016-07-26 16:28:27,011 INFO  - [2138332724@qtp-1536471117-3 -
>> b0cea0a4-efff-48c8-a81f-5c9ffda411a7:] ~ HttpServletRequest user.name
>> param value is margusja (Servlets:53)
>> 2016-07-26 16:28:27,358 INFO  - [2138332724@qtp-1536471117-3 -
>> 1e1fa678-4426-4398-b942-348c5742cc68:] ~ HttpServletRequest RemoteUser is
>> falcon (Servlets:47)
>> 2016-07-26 16:28:27,359 INFO  - [2138332724@qtp-1536471117-3 -
>> 1e1fa678-4426-4398-b942-348c5742cc68:falcon:POST//entities/submit/process]
>> ~ Logging in falcon (CurrentUser:65)
>> 2016-07-26 16:28:27,359 INFO  - [2138332724@qtp-1536471117-3 -
>> 1e1fa678-4426-4398-b942-348c5742cc68:falcon:POST//entities/submit/process]
>> ~ Request from authenticated user: falcon,
>> URL=/api/entities/submit/process, doAs user: null
>> (FalconAuthenticationFilter:185)
>> 2016-07-26 16:28:27,362 INFO  - [2138332724@qtp-1536471117-3 -
>> 1e1fa678-4426-4398-b942-348c5742cc68:falcon:POST//entities/submit/process]
>> ~ Parsed Entity: sign--web3 (EntityParser:95)
>> 2016-07-26 16:28:27,364 INFO  - [2138332724@qtp-1536471117-3 -
>> 1e1fa678-4426-4398-b942-348c5742cc68:falcon:POST//entities/submit/process]
>> ~ Parsed Entity: sign--web3 (EntityParser:95)
>> 2016-07-26 16:28:27,381 INFO  - [2138332724@qtp-1536471117-3 -
>> 1e1fa678-4426-4398-b942-348c5742cc68:falcon:POST//entities/submit/process]
>> ~ Creating FS for the login user falcon, impersonation not required
>> (HadoopClientFactory:191)
>> 2016-07-26 16:28:27,406 INFO  - [2138332724@qtp-1536471117-3 -
>> 1e1fa678-4426-4398-b942-348c5742cc68:falcon:POST//entities/submit/process]
>> ~ Persisted configuration PROCESS/sign--web3 (ConfigurationStore:371)
>> 2016-07-26 16:28:27,407 INFO  - [2138332724@qtp-1536471117-3 -
>> 1e1fa678-4426-4398-b942-348c5742cc68:falcon:POST//entities/submit/process]
>> ~ Adding lineage for entity: sign--web3, type: PROCESS
>> (MetadataMappingService:209)
>> 2016-07-26 16:28:27,409 INFO  - [2138332724@qtp-1536471117-3 -
>> 1e1fa678-4426-4398-b942-348c5742cc68:falcon:POST//entities/submit/process]
>> ~ Adding process entity: sign--web3 (EntityRelationshipGraphBuilder:131)
>> 2016-07-26 16:28:27,465 ERROR - [2138332724@qtp-1536471117-3 -
>> 1e1fa678-4426-4398-b942-348c5742cc68:falcon:POST//entities/submit/process]
>> ~ Illegal State: Cluster entity vertex must exist for Cluster2
>> (EntityRelationshipGraphBuilder:173)
>> 2016-07-26 16:28:27,476 INFO  - [2138332724@qtp-1536471117-3 -
>> 1e1fa678-4426-4398-b942-348c5742cc68:falcon:POST//entities/submit/process]
>> ~ Adding process entity: sign--web3 (EntityRelationshipGraphBuilder:131)
>> 2016-07-26 16:28:27,497 ERROR - [2138332724@qtp-1536471117-3 -
>> 1e1fa678-4426-4398-b942-348c5742cc68:falcon:POST//entities/submit/process]
>> ~ Illegal State: Cluster entity vertex must exist for Cluster2
>> (EntityRelationshipGraphBuilder:173)
>> 2016-07-26 16:28:27,518 INFO  - [2138332724@qtp-1536471117-3 -
>> 1e1fa678-4426-4398-b942-348c5742cc68:falcon:POST//entities/submit/process]
>> ~ Adding process entity: sign--web3 (EntityRelationshipGraphBuilder:131)
>> 2016-07-26 16:28:27,536 ERROR - [2138332724@qtp-1536471117-3 -
>> 1e1fa678-4426-4398-b942-348c5742cc68:falcon:POST//entities/submit/process]
>> ~ Illegal State: Cluster entity vertex must exist for Cluster2
>> (EntityRelationshipGraphBuilder:173)
>> 2016-07-26 16:28:27,537 ERROR - [2138332724@qtp-1536471117-3 -
>> 1e1fa678-4426-4398-b942-348c5742cc68:falcon:POST//entities/submit/process]
>> ~ Unable to persist entity object (AbstractEntityManager:198)
>> org.apache.falcon.FalconException: java.lang.RuntimeException:
>> java.lang.IllegalStateException: Cluster entity vertex must exist: Cluster2
>>         at
>> org.apache.falcon.metadata.MetadataMappingService.onAdd(MetadataMappingService.java:223)
>>         at
>> org.apache.falcon.entity.store.ConfigurationStore.onAdd(ConfigurationStore.java:259)
>>         at
>> org.apache.falcon.entity.store.ConfigurationStore.publish(ConfigurationStore.java:219)
>>         at
>> org.apache.falcon.resource.AbstractEntityManager.submitInternal(AbstractEntityManager.java:414)
>>         at
>> org.apache.falcon.resource.AbstractEntityManager.submit(AbstractEntityManager.java:195)
>>         at
>> org.apache.falcon.resource.ConfigSyncService.submit(ConfigSyncService.java:50)
>>         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>>         at
>> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
>>         at
>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>>         at java.lang.reflect.Method.invoke(Method.java:497)
>>         at
>> org.apache.falcon.resource.channel.IPCChannel.invoke(IPCChannel.java:49)
>>         at
>> org.apache.falcon.resource.proxy.SchedulableEntityManagerProxy$1.doExecute(SchedulableEntityManagerProxy.java:139)
>>         at
>> org.apache.falcon.resource.proxy.SchedulableEntityManagerProxy$EntityProxy.execute(SchedulableEntityManagerProxy.java:577)
>>         at
>> org.apache.falcon.resource.proxy.SchedulableEntityManagerProxy.submit_aroundBody0(SchedulableEntityManagerProxy.java:141)
>>         at
>> org.apache.falcon.resource.proxy.SchedulableEntityManagerProxy$AjcClosure1.run(SchedulableEntityManagerProxy.java:1)
>>         at
>> org.aspectj.runtime.reflect.JoinPointImpl.proceed(JoinPointImpl.java:149)
>>         at
>> org.apache.falcon.aspect.AbstractFalconAspect.logAroundMonitored(AbstractFalconAspect.java:51)
>>         at
>> org.apache.falcon.resource.proxy.SchedulableEntityManagerProxy.submit(SchedulableEntityManagerProxy.java:119)
>>         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>>         at
>> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
>>         at
>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>>         at java.lang.reflect.Method.invoke(Method.java:497)
>>         at
>> com.sun.jersey.spi.container.JavaMethodInvokerFactory$1.invoke(JavaMethodInvokerFactory.java:60)
>>         at
>> com.sun.jersey.server.impl.model.method.dispatch.AbstractResourceMethodDispatchProvider$TypeOutInvoker._dispatch(AbstractResourceMethodDispatchProvider.java:185)
>>         at
>> com.sun.jersey.server.impl.model.method.dispatch.ResourceJavaMethodDispatcher.dispatch(ResourceJavaMethodDispatcher.java:75)
>>         at
>> com.sun.jersey.server.impl.uri.rules.HttpMethodRule.accept(HttpMethodRule.java:288)
>>         at
>> com.sun.jersey.server.impl.uri.rules.RightHandPathRule.accept(RightHandPathRule.java:147)
>>
>> ...
>>
>> Caused by: java.lang.RuntimeException: java.lang.IllegalStateException:
>> Cluster entity vertex must exist: Cluster2
>>         at
>> com.tinkerpop.blueprints.util.TransactionRetryStrategy$AbstractRetryStrategy.execute(TransactionRetryStrategy.java:176)
>>         at
>> com.tinkerpop.blueprints.util.TransactionRetryHelper.use(TransactionRetryHelper.java:115)
>>         at
>> com.tinkerpop.blueprints.util.TransactionRetryHelper.exponentialBackoff(TransactionRetryHelper.java:94)
>>         at
>> org.apache.falcon.metadata.MetadataMappingService.onAdd(MetadataMappingService.java:211)
>>         ... 64 more
>> Caused by: java.lang.IllegalStateException: Cluster entity vertex must
>> exist: Cluster2
>>         at
>> org.apache.falcon.metadata.EntityRelationshipGraphBuilder.addRelationToCluster(EntityRelationshipGraphBuilder.java:174)
>>         at
>> org.apache.falcon.metadata.EntityRelationshipGraphBuilder.addProcessEntity(EntityRelationshipGraphBuilder.java:140)
>>         at
>> org.apache.falcon.metadata.EntityRelationshipGraphBuilder.addEntity(EntityRelationshipGraphBuilder.java:62)
>>         at
>> org.apache.falcon.metadata.MetadataMappingService$1.execute(MetadataMappingService.java:215)
>>         at
>> org.apache.falcon.metadata.MetadataMappingService$1.execute(MetadataMappingService.java:212)
>>         at
>> com.tinkerpop.blueprints.util.TransactionRetryStrategy$AbstractRetryStrategy.execute(TransactionRetryStrategy.java:146)
>>         ... 67 more
>> 2016-07-26 16:28:27,541 ERROR - [2138332724@qtp-1536471117-3 -
>> 1e1fa678-4426-4398-b942-348c5742cc68:falcon:POST//entities/submit/process]
>> ~ Action failed: Bad Request
>> Error: java.lang.RuntimeException: java.lang.IllegalStateException:
>> Cluster entity vertex must exist: Cluster2 (FalconWebException:83)
>> 2016-07-26 16:28:27,542 ERROR - [2138332724@qtp-1536471117-3 -
>> 1e1fa678-4426-4398-b942-348c5742cc68:falcon:POST//entities/submit/process]
>> ~ Action failed: Bad Request
>> Error:
>> default/org.apache.falcon.FalconWebException::org.apache.falcon.FalconException:
>> java.lang.RuntimeException: java.lang.IllegalStateException: Cluster entity
>> vertex must exist: Cluster2
>>  (FalconWebException:83)
>> 2016-07-26 16:28:27,542 INFO  - [2138332724@qtp-1536471117-3 -
>> 1e1fa678-4426-4398-b942-348c5742cc68:falcon:POST//entities/submit/process]
>> ~ {Action:submit, Dimensions:{colo=NULL, entityType=process}, Status:
>> FAILED, Time-taken:182944401 ns} (METRIC:38)
>> ~
>>
>>
>> Any hints?
>>
>>
>>
>> --
>> Margus (margusja) Roohttp://margus.roo.ee
>> skype: margusja
>> +372 51 48 780
>>
>>
>

-- 
_____________________________________________________________
The information contained in this communication is intended solely for the 
use of the individual or entity to whom it is addressed and others 
authorized to receive it. It may contain confidential or legally privileged 
information. If you are not the intended recipient you are hereby notified 
that any disclosure, copying, distribution or taking any action in reliance 
on the contents of this information is strictly prohibited and may be 
unlawful. If you have received this communication in error, please notify 
us immediately by responding to this email and then delete it from your 
system. The firm is neither liable for the proper and complete transmission 
of the information contained in this communication nor for any delay in its 
receipt.

Mime
View raw message