falcon-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Pragya Mittal (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (FALCON-1694) Status API shows params along with instance status
Date Thu, 24 Dec 2015 07:46:49 GMT

     [ https://issues.apache.org/jira/browse/FALCON-1694?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Pragya Mittal updated FALCON-1694:
----------------------------------
    Description: 
Status API is supposed to give status information of all the instances of the entity scheduled.
Although it is showing params along with it which is normally given by params api.

{noformat}
dataqa@lda01:~$ falcon instance -type process -name ProcessWfTest-agregator-coord16-88ca0623
-status
Consolidated Status: SUCCEEDED

Instances:
Instance		Cluster		SourceCluster		Status		Start		End		Details					Log
-----------------------------------------------------------------------------------------------
2015-12-24T07:37Z	ProcessWfTest-corp-776ec077	-	SUCCEEDED	2015-12-24T07:37Z	2015-12-24T07:37Z
-	http://lda01:11000/oozie?job=0001333-151208054434271-oozie-oozi-W
Workflow params
fileTime=${formatTime(dateOffset(instanceTime(), 1, 'DAY'), 'yyyy-MMM-dd')}
cluster=ProcessWfTest-corp-776ec077
availabilityFlag=NA
falconDataOperation=GENERATE
falconInputFeeds=NONE
feedNames=NONE
colo.name=ua1
shouldRecord=false
falcon.libpath=/tmp/falcon-regression-working/lib
mapreduce.job.user.name=dataqa
feedInstancePaths=NONE
systemJMSNotificationEnabled=false
brokerImplClass=org.apache.activemq.ActiveMQConnectionFactory
userBrokerImplClass=org.apache.activemq.ActiveMQConnectionFactory
entityName=ProcessWfTest-agregator-coord16-88ca0623
jobTracker=192.168.138.236:8021
userWorkflowVersion=1.0
workflowEngineUrl=http://192.168.138.236:11000/oozie/
jobPriority=NORMAL
ENTITY_NAME=FALCON_PROCESS_DEFAULT_ProcessWfTest-agregator-coord16-88ca0623
nameNode=hdfs://192.168.138.236:8020
nominalTime=2015-12-24-07-37
oozie.libpath=/tmp/falcon-regression-staging/falcon/workflows/process/ProcessWfTest-agregator-coord16-88ca0623/1b20d2020d15f0b71bab66d512bc0afc_1450942647119/lib
oozie.use.system.libpath=true
entityType=PROCESS
srcClusterName=NA
userWorkflowEngine=oozie
timeStamp=2015-12-24-07-37
brokerUrl=tcp://localhost:61616
field1=value1
oozie.wf.application.path=hdfs://192.168.138.236:8020/tmp/falcon-regression-staging/falcon/workflows/process/ProcessWfTest-agregator-coord16-88ca0623/1b20d2020d15f0b71bab66d512bc0afc_1450942647119
queueName=default
brokerTTL=4320
userWorkflowName=ProcessWfTest-agregator-coord16-88ca0623-workflow
datasource=NA
ENTITY_PATH=/tmp/falcon-regression-staging/falcon/workflows/process/ProcessWfTest-agregator-coord16-88ca0623/1b20d2020d15f0b71bab66d512bc0afc_1450942647119
userJMSNotificationEnabled=true
userBrokerUrl=tcp://192.168.138.236:61616?daemon=true
falconInPaths=NONE
user=${user()}
field2=value2
logDir=hdfs://192.168.138.236:8020/tmp/falcon-regression-staging/falcon/workflows/process/ProcessWfTest-agregator-coord16-88ca0623/logs

actions:
 hdfscommands	OK	-
2015-12-24T07:42Z	ProcessWfTest-corp-776ec077	-	SUCCEEDED	2015-12-24T07:42Z	2015-12-24T07:42Z
-	http://lda01:11000/oozie?job=0001335-151208054434271-oozie-oozi-W
Workflow params
fileTime=${formatTime(dateOffset(instanceTime(), 1, 'DAY'), 'yyyy-MMM-dd')}
cluster=ProcessWfTest-corp-776ec077
availabilityFlag=NA
falconDataOperation=GENERATE
falconInputFeeds=NONE
feedNames=NONE
colo.name=ua1
shouldRecord=false
falcon.libpath=/tmp/falcon-regression-working/lib
mapreduce.job.user.name=dataqa
feedInstancePaths=NONE
systemJMSNotificationEnabled=false
brokerImplClass=org.apache.activemq.ActiveMQConnectionFactory
userBrokerImplClass=org.apache.activemq.ActiveMQConnectionFactory
entityName=ProcessWfTest-agregator-coord16-88ca0623
jobTracker=192.168.138.236:8021
userWorkflowVersion=1.0
workflowEngineUrl=http://192.168.138.236:11000/oozie/
jobPriority=NORMAL
ENTITY_NAME=FALCON_PROCESS_DEFAULT_ProcessWfTest-agregator-coord16-88ca0623
nameNode=hdfs://192.168.138.236:8020
nominalTime=2015-12-24-07-42
oozie.libpath=/tmp/falcon-regression-staging/falcon/workflows/process/ProcessWfTest-agregator-coord16-88ca0623/1b20d2020d15f0b71bab66d512bc0afc_1450942647119/lib
oozie.use.system.libpath=true
entityType=PROCESS
srcClusterName=NA
userWorkflowEngine=oozie
timeStamp=2015-12-24-07-42
brokerUrl=tcp://localhost:61616
field1=value1
oozie.wf.application.path=hdfs://192.168.138.236:8020/tmp/falcon-regression-staging/falcon/workflows/process/ProcessWfTest-agregator-coord16-88ca0623/1b20d2020d15f0b71bab66d512bc0afc_1450942647119
queueName=default
brokerTTL=4320
userWorkflowName=ProcessWfTest-agregator-coord16-88ca0623-workflow
datasource=NA
ENTITY_PATH=/tmp/falcon-regression-staging/falcon/workflows/process/ProcessWfTest-agregator-coord16-88ca0623/1b20d2020d15f0b71bab66d512bc0afc_1450942647119
userJMSNotificationEnabled=true
userBrokerUrl=tcp://192.168.138.236:61616?daemon=true
falconInPaths=NONE
user=${user()}
field2=value2
logDir=hdfs://192.168.138.236:8020/tmp/falcon-regression-staging/falcon/workflows/process/ProcessWfTest-agregator-coord16-88ca0623/logs

actions:
 hdfscommands	OK	-

Additional Information:
Response: ua1/STATUS
Request Id: ua1/1780902256@qtp-1816147548-3 - cd4f857e-acfc-42a6-9b13-c98c51dcc41f


{noformat}

> Status API shows params along with instance status
> --------------------------------------------------
>
>                 Key: FALCON-1694
>                 URL: https://issues.apache.org/jira/browse/FALCON-1694
>             Project: Falcon
>          Issue Type: Bug
>          Components: general
>    Affects Versions: 0.9
>            Reporter: Pragya Mittal
>
> Status API is supposed to give status information of all the instances of the entity
scheduled. Although it is showing params along with it which is normally given by params api.
> {noformat}
> dataqa@lda01:~$ falcon instance -type process -name ProcessWfTest-agregator-coord16-88ca0623
-status
> Consolidated Status: SUCCEEDED
> Instances:
> Instance		Cluster		SourceCluster		Status		Start		End		Details					Log
> -----------------------------------------------------------------------------------------------
> 2015-12-24T07:37Z	ProcessWfTest-corp-776ec077	-	SUCCEEDED	2015-12-24T07:37Z	2015-12-24T07:37Z
-	http://lda01:11000/oozie?job=0001333-151208054434271-oozie-oozi-W
> Workflow params
> fileTime=${formatTime(dateOffset(instanceTime(), 1, 'DAY'), 'yyyy-MMM-dd')}
> cluster=ProcessWfTest-corp-776ec077
> availabilityFlag=NA
> falconDataOperation=GENERATE
> falconInputFeeds=NONE
> feedNames=NONE
> colo.name=ua1
> shouldRecord=false
> falcon.libpath=/tmp/falcon-regression-working/lib
> mapreduce.job.user.name=dataqa
> feedInstancePaths=NONE
> systemJMSNotificationEnabled=false
> brokerImplClass=org.apache.activemq.ActiveMQConnectionFactory
> userBrokerImplClass=org.apache.activemq.ActiveMQConnectionFactory
> entityName=ProcessWfTest-agregator-coord16-88ca0623
> jobTracker=192.168.138.236:8021
> userWorkflowVersion=1.0
> workflowEngineUrl=http://192.168.138.236:11000/oozie/
> jobPriority=NORMAL
> ENTITY_NAME=FALCON_PROCESS_DEFAULT_ProcessWfTest-agregator-coord16-88ca0623
> nameNode=hdfs://192.168.138.236:8020
> nominalTime=2015-12-24-07-37
> oozie.libpath=/tmp/falcon-regression-staging/falcon/workflows/process/ProcessWfTest-agregator-coord16-88ca0623/1b20d2020d15f0b71bab66d512bc0afc_1450942647119/lib
> oozie.use.system.libpath=true
> entityType=PROCESS
> srcClusterName=NA
> userWorkflowEngine=oozie
> timeStamp=2015-12-24-07-37
> brokerUrl=tcp://localhost:61616
> field1=value1
> oozie.wf.application.path=hdfs://192.168.138.236:8020/tmp/falcon-regression-staging/falcon/workflows/process/ProcessWfTest-agregator-coord16-88ca0623/1b20d2020d15f0b71bab66d512bc0afc_1450942647119
> queueName=default
> brokerTTL=4320
> userWorkflowName=ProcessWfTest-agregator-coord16-88ca0623-workflow
> datasource=NA
> ENTITY_PATH=/tmp/falcon-regression-staging/falcon/workflows/process/ProcessWfTest-agregator-coord16-88ca0623/1b20d2020d15f0b71bab66d512bc0afc_1450942647119
> userJMSNotificationEnabled=true
> userBrokerUrl=tcp://192.168.138.236:61616?daemon=true
> falconInPaths=NONE
> user=${user()}
> field2=value2
> logDir=hdfs://192.168.138.236:8020/tmp/falcon-regression-staging/falcon/workflows/process/ProcessWfTest-agregator-coord16-88ca0623/logs
> actions:
>  hdfscommands	OK	-
> 2015-12-24T07:42Z	ProcessWfTest-corp-776ec077	-	SUCCEEDED	2015-12-24T07:42Z	2015-12-24T07:42Z
-	http://lda01:11000/oozie?job=0001335-151208054434271-oozie-oozi-W
> Workflow params
> fileTime=${formatTime(dateOffset(instanceTime(), 1, 'DAY'), 'yyyy-MMM-dd')}
> cluster=ProcessWfTest-corp-776ec077
> availabilityFlag=NA
> falconDataOperation=GENERATE
> falconInputFeeds=NONE
> feedNames=NONE
> colo.name=ua1
> shouldRecord=false
> falcon.libpath=/tmp/falcon-regression-working/lib
> mapreduce.job.user.name=dataqa
> feedInstancePaths=NONE
> systemJMSNotificationEnabled=false
> brokerImplClass=org.apache.activemq.ActiveMQConnectionFactory
> userBrokerImplClass=org.apache.activemq.ActiveMQConnectionFactory
> entityName=ProcessWfTest-agregator-coord16-88ca0623
> jobTracker=192.168.138.236:8021
> userWorkflowVersion=1.0
> workflowEngineUrl=http://192.168.138.236:11000/oozie/
> jobPriority=NORMAL
> ENTITY_NAME=FALCON_PROCESS_DEFAULT_ProcessWfTest-agregator-coord16-88ca0623
> nameNode=hdfs://192.168.138.236:8020
> nominalTime=2015-12-24-07-42
> oozie.libpath=/tmp/falcon-regression-staging/falcon/workflows/process/ProcessWfTest-agregator-coord16-88ca0623/1b20d2020d15f0b71bab66d512bc0afc_1450942647119/lib
> oozie.use.system.libpath=true
> entityType=PROCESS
> srcClusterName=NA
> userWorkflowEngine=oozie
> timeStamp=2015-12-24-07-42
> brokerUrl=tcp://localhost:61616
> field1=value1
> oozie.wf.application.path=hdfs://192.168.138.236:8020/tmp/falcon-regression-staging/falcon/workflows/process/ProcessWfTest-agregator-coord16-88ca0623/1b20d2020d15f0b71bab66d512bc0afc_1450942647119
> queueName=default
> brokerTTL=4320
> userWorkflowName=ProcessWfTest-agregator-coord16-88ca0623-workflow
> datasource=NA
> ENTITY_PATH=/tmp/falcon-regression-staging/falcon/workflows/process/ProcessWfTest-agregator-coord16-88ca0623/1b20d2020d15f0b71bab66d512bc0afc_1450942647119
> userJMSNotificationEnabled=true
> userBrokerUrl=tcp://192.168.138.236:61616?daemon=true
> falconInPaths=NONE
> user=${user()}
> field2=value2
> logDir=hdfs://192.168.138.236:8020/tmp/falcon-regression-staging/falcon/workflows/process/ProcessWfTest-agregator-coord16-88ca0623/logs
> actions:
>  hdfscommands	OK	-
> Additional Information:
> Response: ua1/STATUS
> Request Id: ua1/1780902256@qtp-1816147548-3 - cd4f857e-acfc-42a6-9b13-c98c51dcc41f
> {noformat}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message