falcon-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Suhas Vasu (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (FALCON-1070) numResults and offset doesnot work for instance operations
Date Mon, 16 Mar 2015 06:33:38 GMT

    [ https://issues.apache.org/jira/browse/FALCON-1070?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14362808#comment-14362808
] 

Suhas Vasu commented on FALCON-1070:
------------------------------------

Yes completely agree that this approach is not feasible in the long run.
Need to look at why we have this in the first place and probably handle the types in a better
way.
That being said, I prefer the refactoring to be picked up in a seperate ticket.

> numResults and offset doesnot work for instance operations
> ----------------------------------------------------------
>
>                 Key: FALCON-1070
>                 URL: https://issues.apache.org/jira/browse/FALCON-1070
>             Project: Falcon
>          Issue Type: Bug
>          Components: process
>    Affects Versions: 0.7
>         Environment: QA
>            Reporter: Pragya Mittal
>            Assignee: Suhas Vasu
>         Attachments: FALCON-1070.patch
>
>
> I am giving following process definition :
> {code}
> dataqa@ip-192-168-138-200:~$ falcon entity -type process -name ListProcessInstancesTest--agregator-coord16-f697091f
-definition
> <?xml version="1.0" encoding="UTF-8" standalone="yes"?>
> <process name="ListProcessInstancesTest--agregator-coord16-f697091f" xmlns="uri:falcon:process:0.1">
>     <clusters>
>         <cluster name="ListProcessInstancesTest--corp-75d20445">
>             <validity start="2015-03-05T08:06Z" end="2015-03-05T09:06Z"/>
>         </cluster>
>     </clusters>
>     <parallel>3</parallel>
>     <order>FIFO</order>
>     <frequency>minutes(5)</frequency>
>     <timezone>UTC</timezone>
>     <inputs>
>         <input name="inputData" feed="ListProcessInstancesTest--raaw-logs16-584f5f5b"
start="now(0,-20)" end="now(0,0)"/>
>     </inputs>
>     <outputs>
>         <output name="outputData" feed="ListProcessInstancesTest--agregated-logs16-a0fabd8f"
instance="now(0,0)"/>
>     </outputs>
>     <properties>
>         <property name="queueName" value="default"/>
>         <property name="fileTime" value="${formatTime(dateOffset(instanceTime(), 1,
'DAY'), 'yyyy-MMM-dd')}"/>
>         <property name="user" value="${user()}"/>
>     </properties>
>     <workflow path="/tmp/falcon-regression/ListProcessInstancesTest/aggregator"/>
>     <retry policy="periodic" delay="minutes(3)" attempts="3"/>
>     <ACL owner="pragyamittal" group="dataqa" permission="*"/>
> </process>
> {code}
> I am trying to list instances using numResults property :
> {code}
> dataqa@ip-192-168-138-200:~$ falcon instance -type process -name ListProcessInstancesTest--agregator-coord16-f697091f
-list -orderBy startTime -numResults 2
> Consolidated Status: SUCCEEDED
> Instances:
> Instance		Cluster		SourceCluster		Status		Start		End		Details				Log
> -----------------------------------------------------------------------------------------------
> 2015-03-05T09:01Z	ListProcessInstancesTest--corp-75d20445	-	SUCCEEDED	2015-03-05T09:09Z
2015-03-05T09:10Z	-	http://ip-192-168-138-200:11000/oozie?job=0002201-150227103637589-oozie-oozi-W
> actions:
>  aggregator	SUCCEEDED	http://ip-192-168-138-200:8088/proxy/application_1425019932206_1201/
> 2015-03-05T08:56Z	ListProcessInstancesTest--corp-75d20445	-	SUCCEEDED	2015-03-05T09:09Z
2015-03-05T09:10Z	-	http://ip-192-168-138-200:11000/oozie?job=0002199-150227103637589-oozie-oozi-W
> actions:
>  aggregator	SUCCEEDED	http://ip-192-168-138-200:8088/proxy/application_1425019932206_1200/
> 2015-03-05T08:51Z	ListProcessInstancesTest--corp-75d20445	-	SUCCEEDED	2015-03-05T09:09Z
2015-03-05T09:10Z	-	http://ip-192-168-138-200:11000/oozie?job=0002197-150227103637589-oozie-oozi-W
> actions:
>  aggregator	SUCCEEDED	http://ip-192-168-138-200:8088/proxy/application_1425019932206_1199/
> 2015-03-05T08:46Z	ListProcessInstancesTest--corp-75d20445	-	SUCCEEDED	2015-03-05T09:08Z
2015-03-05T09:09Z	-	http://ip-192-168-138-200:11000/oozie?job=0002195-150227103637589-oozie-oozi-W
> actions:
>  aggregator	SUCCEEDED	http://ip-192-168-138-200:8088/proxy/application_1425019932206_1192/
> 2015-03-05T08:41Z	ListProcessInstancesTest--corp-75d20445	-	SUCCEEDED	2015-03-05T09:07Z
2015-03-05T09:09Z	-	http://ip-192-168-138-200:11000/oozie?job=0002193-150227103637589-oozie-oozi-W
> actions:
>  aggregator	SUCCEEDED	http://ip-192-168-138-200:8088/proxy/application_1425019932206_1191/
> 2015-03-05T08:36Z	ListProcessInstancesTest--corp-75d20445	-	SUCCEEDED	2015-03-05T09:07Z
2015-03-05T09:09Z	-	http://ip-192-168-138-200:11000/oozie?job=0002191-150227103637589-oozie-oozi-W
> actions:
>  aggregator	SUCCEEDED	http://ip-192-168-138-200:8088/proxy/application_1425019932206_1190/
> 2015-03-05T08:31Z	ListProcessInstancesTest--corp-75d20445	-	SUCCEEDED	2015-03-05T09:06Z
2015-03-05T09:08Z	-	http://ip-192-168-138-200:11000/oozie?job=0002189-150227103637589-oozie-oozi-W
> actions:
>  aggregator	SUCCEEDED	http://ip-192-168-138-200:8088/proxy/application_1425019932206_1183/
> 2015-03-05T08:26Z	ListProcessInstancesTest--corp-75d20445	-	SUCCEEDED	2015-03-05T09:06Z
2015-03-05T09:07Z	-	http://ip-192-168-138-200:11000/oozie?job=0002187-150227103637589-oozie-oozi-W
> actions:
>  aggregator	SUCCEEDED	http://ip-192-168-138-200:8088/proxy/application_1425019932206_1182/
> 2015-03-05T08:21Z	ListProcessInstancesTest--corp-75d20445	-	SUCCEEDED	2015-03-05T09:06Z
2015-03-05T09:07Z	-	http://ip-192-168-138-200:11000/oozie?job=0002185-150227103637589-oozie-oozi-W
> actions:
>  aggregator	SUCCEEDED	http://ip-192-168-138-200:8088/proxy/application_1425019932206_1181/
> 2015-03-05T08:16Z	ListProcessInstancesTest--corp-75d20445	-	SUCCEEDED	2015-03-05T09:05Z
2015-03-05T09:06Z	-	http://ip-192-168-138-200:11000/oozie?job=0002183-150227103637589-oozie-oozi-W
> actions:
>  aggregator	SUCCEEDED	http://ip-192-168-138-200:8088/proxy/application_1425019932206_1174/
> Additional Information:
> Response: ua1/STATUS
> Request Id: ua1/2026916417@qtp-1975714155-18 - ccd35c54-b208-4f43-9f2c-301bfb08063a
> {code}
> Instead of giving 2 results it is giving me 10 results which is the default value.
> Also offset gives 10 results irrespective of number of instances running :
> {code}
> dataqa@ip-192-168-138-200:~$ falcon instance -type process -name ListProcessInstancesTest--agregator-coord16-f697091f
-list -orderBy startTime -numResults 2 -offset 9
> Consolidated Status: SUCCEEDED
> Instances:
> Instance		Cluster		SourceCluster		Status		Start		End		Details				Log
> -----------------------------------------------------------------------------------------------
> 2015-03-05T09:01Z	ListProcessInstancesTest--corp-75d20445	-	SUCCEEDED	2015-03-05T09:09Z
2015-03-05T09:10Z	-	http://ip-192-168-138-200:11000/oozie?job=0002201-150227103637589-oozie-oozi-W
> actions:
>  aggregator	SUCCEEDED	http://ip-192-168-138-200:8088/proxy/application_1425019932206_1201/
> 2015-03-05T08:56Z	ListProcessInstancesTest--corp-75d20445	-	SUCCEEDED	2015-03-05T09:09Z
2015-03-05T09:10Z	-	http://ip-192-168-138-200:11000/oozie?job=0002199-150227103637589-oozie-oozi-W
> actions:
>  aggregator	SUCCEEDED	http://ip-192-168-138-200:8088/proxy/application_1425019932206_1200/
> 2015-03-05T08:51Z	ListProcessInstancesTest--corp-75d20445	-	SUCCEEDED	2015-03-05T09:09Z
2015-03-05T09:10Z	-	http://ip-192-168-138-200:11000/oozie?job=0002197-150227103637589-oozie-oozi-W
> actions:
>  aggregator	SUCCEEDED	http://ip-192-168-138-200:8088/proxy/application_1425019932206_1199/
> 2015-03-05T08:46Z	ListProcessInstancesTest--corp-75d20445	-	SUCCEEDED	2015-03-05T09:08Z
2015-03-05T09:09Z	-	http://ip-192-168-138-200:11000/oozie?job=0002195-150227103637589-oozie-oozi-W
> actions:
>  aggregator	SUCCEEDED	http://ip-192-168-138-200:8088/proxy/application_1425019932206_1192/
> 2015-03-05T08:41Z	ListProcessInstancesTest--corp-75d20445	-	SUCCEEDED	2015-03-05T09:07Z
2015-03-05T09:09Z	-	http://ip-192-168-138-200:11000/oozie?job=0002193-150227103637589-oozie-oozi-W
> actions:
>  aggregator	SUCCEEDED	http://ip-192-168-138-200:8088/proxy/application_1425019932206_1191/
> 2015-03-05T08:36Z	ListProcessInstancesTest--corp-75d20445	-	SUCCEEDED	2015-03-05T09:07Z
2015-03-05T09:09Z	-	http://ip-192-168-138-200:11000/oozie?job=0002191-150227103637589-oozie-oozi-W
> actions:
>  aggregator	SUCCEEDED	http://ip-192-168-138-200:8088/proxy/application_1425019932206_1190/
> 2015-03-05T08:31Z	ListProcessInstancesTest--corp-75d20445	-	SUCCEEDED	2015-03-05T09:06Z
2015-03-05T09:08Z	-	http://ip-192-168-138-200:11000/oozie?job=0002189-150227103637589-oozie-oozi-W
> actions:
>  aggregator	SUCCEEDED	http://ip-192-168-138-200:8088/proxy/application_1425019932206_1183/
> 2015-03-05T08:26Z	ListProcessInstancesTest--corp-75d20445	-	SUCCEEDED	2015-03-05T09:06Z
2015-03-05T09:07Z	-	http://ip-192-168-138-200:11000/oozie?job=0002187-150227103637589-oozie-oozi-W
> actions:
>  aggregator	SUCCEEDED	http://ip-192-168-138-200:8088/proxy/application_1425019932206_1182/
> 2015-03-05T08:21Z	ListProcessInstancesTest--corp-75d20445	-	SUCCEEDED	2015-03-05T09:06Z
2015-03-05T09:07Z	-	http://ip-192-168-138-200:11000/oozie?job=0002185-150227103637589-oozie-oozi-W
> actions:
>  aggregator	SUCCEEDED	http://ip-192-168-138-200:8088/proxy/application_1425019932206_1181/
> 2015-03-05T08:16Z	ListProcessInstancesTest--corp-75d20445	-	SUCCEEDED	2015-03-05T09:05Z
2015-03-05T09:06Z	-	http://ip-192-168-138-200:11000/oozie?job=0002183-150227103637589-oozie-oozi-W
> actions:
>  aggregator	SUCCEEDED	http://ip-192-168-138-200:8088/proxy/application_1425019932206_1174/
> Additional Information:
> Response: ua1/STATUS
> Request Id: ua1/2026916417@qtp-1975714155-18 - 64a8366b-2b0b-4c9c-bfef-ebcf80de9ac9
> {code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message