falcon-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Pallavi Rao (JIRA)" <j...@apache.org>
Subject [jira] [Resolved] (FALCON-1420) NPE in MetadataMappingService when adding process instance executed
Date Mon, 31 Aug 2015 04:34:45 GMT

     [ https://issues.apache.org/jira/browse/FALCON-1420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Pallavi Rao resolved FALCON-1420.
---------------------------------
    Resolution: Duplicate

[~sowmyaramesh], I had run into the same issue few days ago and I have made a patch available.

> NPE in MetadataMappingService when adding process instance executed
> -------------------------------------------------------------------
>
>                 Key: FALCON-1420
>                 URL: https://issues.apache.org/jira/browse/FALCON-1420
>             Project: Falcon
>          Issue Type: Bug
>    Affects Versions: 0.7
>            Reporter: Sowmya Ramesh
>
> FALCON-1091  changed value of property WorkflowExecutionArgs.OUTPUT_FEED_NAMES.getName()
"NONE" to "IGNORE"  in ProcessExecutionCoordinatorBuilder.initializeOutputPaths which has
introduced the bug. For a process if there are no output feed MetadataMappingService should
not go ahead to add output feed instance.
> Message:
> 2015-08-28 23:43:48,798 INFO  - [ActiveMQ Session Task:] ~ Adding lineage for context
WorkflowExecutionContext{{brokerImplClass=org.apache.activemq.ActiveMQConnectionFactory, operation=GENERATE,
contextType=POST_PROCESSING, logDir=hdfs://sandbox.hortonworks.com:8020/apps/falcon/primaryCluster/staging/falcon/workflows/process/replication-monthly/logs/job-2015-08-28-23-00//,
falconInputFeeds=NONE, cluster=primaryCluster, brokerTTL=4320, entityType=PROCESS, workflowEngineUrl=http://sandbox.hortonworks.com:11000/oozie/,
brokerUrl=tcp://sandbox.hortonworks.com:61616, entityName=replication-monthly, userBrokerImplClass=org.apache.activemq.ActiveMQConnectionFactory,
subflowId=0000033-150727232450793-oozie-oozi-W@user-action, falconInPaths=IGNORE, userJMSNotificationEnabled=true,
timeStamp=2015-08-28-23-39, feedInstancePaths=IGNORE, userWorkflowVersion=1.0, workflowUser=ambari-qa,
workflowId=0000033-150727232450793-oozie-oozi-W, userBrokerUrl=tcp://sandbox.hortonworks.com:61616?daemon=true,
status=SUCCEEDED, contextFile=hdfs://sandbox.hortonworks.com:8020/apps/falcon/primaryCluster/staging/falcon/workflows/process/replication-monthly/logs/job-2015-08-28-23-00/replication-monthly-wf-post-exec-context.json,
userWorkflowName=hdfs-dr-workflow, nominalTime=2015-08-28-23-00, feedNames=IGNORE, runId=0,
userWorkflowEngine=oozie}} (MetadataMappingService:261)
> Exception:
> {noformat}
> 2015-08-28 23:43:49,607 ERROR - [ActiveMQ Session Task:] ~ Error in listener org.apache.falcon.metadata.MetadataMappingService
(WorkflowJobEndNotificationService:104)
> org.apache.falcon.FalconException: java.lang.RuntimeException: java.lang.NullPointerException
> 	at org.apache.falcon.metadata.MetadataMappingService.onSuccess(MetadataMappingService.java:274)
> 	at org.apache.falcon.workflow.WorkflowJobEndNotificationService.notifySuccess(WorkflowJobEndNotificationService.java:101)
> 	at org.apache.falcon.messaging.JMSMessageConsumer.onSuccess(JMSMessageConsumer.java:138)
> 	at org.apache.falcon.messaging.JMSMessageConsumer.onMessage(JMSMessageConsumer.java:110)
> 	at org.apache.activemq.ActiveMQMessageConsumer.dispatch(ActiveMQMessageConsumer.java:1229)
> 	at org.apache.activemq.ActiveMQSessionExecutor.dispatch(ActiveMQSessionExecutor.java:134)
> 	at org.apache.activemq.ActiveMQSessionExecutor.iterate(ActiveMQSessionExecutor.java:205)
> 	at org.apache.activemq.thread.PooledTaskRunner.runTask(PooledTaskRunner.java:122)
> 	at org.apache.activemq.thread.PooledTaskRunner$1.run(PooledTaskRunner.java:43)
> 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
> 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
> 	at java.lang.Thread.run(Thread.java:745)
> Caused by: java.lang.RuntimeException: java.lang.NullPointerException
> 	at com.tinkerpop.blueprints.util.TransactionRetryStrategy$AbstractRetryStrategy.execute(TransactionRetryStrategy.java:176)
> 	at com.tinkerpop.blueprints.util.TransactionRetryHelper.use(TransactionRetryHelper.java:115)
> 	at com.tinkerpop.blueprints.util.TransactionRetryHelper.exponentialBackoff(TransactionRetryHelper.java:94)
> 	at org.apache.falcon.metadata.MetadataMappingService.onSuccess(MetadataMappingService.java:263)
> 	... 11 more
> Caused by: java.lang.NullPointerException
> 	at org.apache.falcon.entity.FeedHelper.getCluster(FeedHelper.java:80)
> 	at org.apache.falcon.entity.FeedHelper.getStorageType(FeedHelper.java:235)
> 	at org.apache.falcon.metadata.InstanceRelationshipGraphBuilder.getFeedInstanceName(InstanceRelationshipGraphBuilder.java:280)
> 	at org.apache.falcon.metadata.InstanceRelationshipGraphBuilder.addFeedInstance(InstanceRelationshipGraphBuilder.java:245)
> 	at org.apache.falcon.metadata.InstanceRelationshipGraphBuilder.addOutputFeedInstances(InstanceRelationshipGraphBuilder.java:151)
> 	at org.apache.falcon.metadata.MetadataMappingService.onProcessInstanceExecuted(MetadataMappingService.java:304)
> 	at org.apache.falcon.metadata.MetadataMappingService.onSuccessfulExecution(MetadataMappingService.java:282)
> 	at org.apache.falcon.metadata.MetadataMappingService.access$100(MetadataMappingService.java:53)
> 	at org.apache.falcon.metadata.MetadataMappingService$3.execute(MetadataMappingService.java:267)
> 	at org.apache.falcon.metadata.MetadataMappingService$3.execute(MetadataMappingService.java:264)
> 	at com.tinkerpop.blueprints.util.TransactionRetryStrategy$AbstractRetryStrategy.execute(TransactionRetryStrategy.java:146)
> 	... 14 more
> {noformat}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message