falcon-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Pragya Mittal (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (FALCON-1562) Listine API does not honour update feature
Date Wed, 28 Oct 2015 12:05:27 GMT

     [ https://issues.apache.org/jira/browse/FALCON-1562?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Pragya Mittal updated FALCON-1562:
----------------------------------
    Description: 
When entity definition is updated, listing Api shoudl show instances with upadted behaviour
from now(0,0). Instead it reflects the changes to all the instances.

I submitted a feed with frequency minute(1)
{noformat}
<?xml version="1.0" encoding="UTF-8" standalone="yes"?>
<feed name="sla-feed" description="clicks log" xmlns="uri:falcon:feed:0.1">
    <partitions>
        <partition name="country"/>
        <partition name="colo"/>
    </partitions>
    <frequency>minutes(1)</frequency>
    <sla slaLow="minutes(1)" slaHigh="minutes(3)"/>
    <timezone>UTC</timezone>
    <late-arrival cut-off="hours(6)"/>
    <clusters>
        <cluster name="A9e7e0672-e02bcc65">
            <validity start="2015-10-28T11:58Z" end="2015-10-30T11:17Z"/>
            <retention limit="days(1000000)" action="delete"/>
        </cluster>
    </clusters>
    <locations>
        <location type="data" path="/tmp/falcon-regression/FeedSlaMonitoring/input/${YEAR}/${MONTH}/${DAY}/${HOUR}/${MINUTE}"/>
        <location type="stats" path="/projects/falcon/clicksStats"/>
        <location type="meta" path="/projects/falcon/clicksMetaData"/>
    </locations>
    <ACL owner="pragya" group="dataqa" permission="*"/>
    <schema location="/schema/clicks" provider="protobuf"/>
    <properties>
        <property name="field1" value="value1"/>
    </properties>
</feed>

{noformat}

Listing Api response :
{noformat}
dataqa@lda01:/mnt/users/pragya/defn/sla$ falcon instance -type feed -name sla-feed -start
2015-10-28T11:58Z -listing
Consolidated Status: SUCCEEDED

Instances:
Cluster         Instance            Status          Size            CreationTime        Details
        
-----------------------------------------------------------------------------------------------
A9e7e0672-e02bcc652015-10-28T11:58Z   MISSING         -               -                  
/tmp/falcon-regression/FeedSlaMonitoring/input/2015/10/28/11/58
A9e7e0672-e02bcc652015-10-28T11:59Z   MISSING         -               -                  
/tmp/falcon-regression/FeedSlaMonitoring/input/2015/10/28/11/59


{noformat}

After updating frequency of feed to 2 minutes response is :
{noformat}
dataqa@lda01:/mnt/users/pragya/defn/sla$ falcon instance -type feed -name sla-feed -start
2015-10-28T11:58Z -listing
Consolidated Status: SUCCEEDED

Instances:
Cluster         Instance            Status          Size            CreationTime        Details
        
-----------------------------------------------------------------------------------------------
A9e7e0672-e02bcc652015-10-28T11:58Z   MISSING         -               -                  
/tmp/falcon-regression/FeedSlaMonitoring/input/2015/10/28/11/58
A9e7e0672-e02bcc652015-10-28T12:00Z   MISSING         -               -                  
/tmp/falcon-regression/FeedSlaMonitoring/input/2015/10/28/12/00
A9e7e0672-e02bcc652015-10-28T12:02Z   MISSING         -               -                  
/tmp/falcon-regression/FeedSlaMonitoring/input/2015/10/28/12/02
A9e7e0672-e02bcc652015-10-28T12:04Z   MISSING         -               -                  
/tmp/falcon-regression/FeedSlaMonitoring/input/2015/10/28/12/04

{noformat}

All instances are updated with frequency minutes(2) interval




  was:
When entity definition is updated, listing Api shoudl show instances with upadted behaviour
from now(0,0). Instead it reflects the changes to all the instances.

I submitted a feed with frequency minute(1)
{noformat}
<?xml version="1.0" encoding="UTF-8" standalone="yes"?>
<feed name="sla-feed" description="clicks log" xmlns="uri:falcon:feed:0.1">
    <partitions>
        <partition name="country"/>
        <partition name="colo"/>
    </partitions>
    <frequency>minutes(1)</frequency>
    <sla slaLow="minutes(1)" slaHigh="minutes(3)"/>
    <timezone>UTC</timezone>
    <late-arrival cut-off="hours(6)"/>
    <clusters>
        <cluster name="A9e7e0672-e02bcc65">
            <validity start="2015-10-28T11:58Z" end="2015-10-30T11:17Z"/>
            <retention limit="days(1000000)" action="delete"/>
        </cluster>
    </clusters>
    <locations>
        <location type="data" path="/tmp/falcon-regression/FeedSlaMonitoring/input/${YEAR}/${MONTH}/${DAY}/${HOUR}/${MINUTE}"/>
        <location type="stats" path="/projects/falcon/clicksStats"/>
        <location type="meta" path="/projects/falcon/clicksMetaData"/>
    </locations>
    <ACL owner="pragya" group="dataqa" permission="*"/>
    <schema location="/schema/clicks" provider="protobuf"/>
    <properties>
        <property name="field1" value="value1"/>
    </properties>
</feed>

{noformat}

Listing Api response :
{noformat}
dataqa@lda01:/mnt/users/pragya/defn/sla$ falcon instance -type feed -name sla-feed -start
2015-10-28T11:58Z -listing
Consolidated Status: SUCCEEDED

Instances:
Cluster         Instance            Status          Size            CreationTime        Details
        
-----------------------------------------------------------------------------------------------
A9e7e0672-e02bcc652015-10-28T11:58Z   MISSING         -               -                  
/tmp/falcon-regression/FeedSlaMonitoring/input/2015/10/28/11/58
A9e7e0672-e02bcc652015-10-28T11:59Z   MISSING         -               -                  
/tmp/falcon-regression/FeedSlaMonitoring/input/2015/10/28/11/59


{noformat}

After updating frequency of feed to 2 minutes response is :
{noformat}

{noformat}





> Listine API does not honour update feature
> ------------------------------------------
>
>                 Key: FALCON-1562
>                 URL: https://issues.apache.org/jira/browse/FALCON-1562
>             Project: Falcon
>          Issue Type: Bug
>          Components: prism
>    Affects Versions: 0.8
>         Environment: QA
>            Reporter: Pragya Mittal
>             Fix For: 0.8
>
>
> When entity definition is updated, listing Api shoudl show instances with upadted behaviour
from now(0,0). Instead it reflects the changes to all the instances.
> I submitted a feed with frequency minute(1)
> {noformat}
> <?xml version="1.0" encoding="UTF-8" standalone="yes"?>
> <feed name="sla-feed" description="clicks log" xmlns="uri:falcon:feed:0.1">
>     <partitions>
>         <partition name="country"/>
>         <partition name="colo"/>
>     </partitions>
>     <frequency>minutes(1)</frequency>
>     <sla slaLow="minutes(1)" slaHigh="minutes(3)"/>
>     <timezone>UTC</timezone>
>     <late-arrival cut-off="hours(6)"/>
>     <clusters>
>         <cluster name="A9e7e0672-e02bcc65">
>             <validity start="2015-10-28T11:58Z" end="2015-10-30T11:17Z"/>
>             <retention limit="days(1000000)" action="delete"/>
>         </cluster>
>     </clusters>
>     <locations>
>         <location type="data" path="/tmp/falcon-regression/FeedSlaMonitoring/input/${YEAR}/${MONTH}/${DAY}/${HOUR}/${MINUTE}"/>
>         <location type="stats" path="/projects/falcon/clicksStats"/>
>         <location type="meta" path="/projects/falcon/clicksMetaData"/>
>     </locations>
>     <ACL owner="pragya" group="dataqa" permission="*"/>
>     <schema location="/schema/clicks" provider="protobuf"/>
>     <properties>
>         <property name="field1" value="value1"/>
>     </properties>
> </feed>
> {noformat}
> Listing Api response :
> {noformat}
> dataqa@lda01:/mnt/users/pragya/defn/sla$ falcon instance -type feed -name sla-feed -start
2015-10-28T11:58Z -listing
> Consolidated Status: SUCCEEDED
> Instances:
> Cluster         Instance            Status          Size            CreationTime    
   Details         
> -----------------------------------------------------------------------------------------------
> A9e7e0672-e02bcc652015-10-28T11:58Z   MISSING         -               -             
     /tmp/falcon-regression/FeedSlaMonitoring/input/2015/10/28/11/58
> A9e7e0672-e02bcc652015-10-28T11:59Z   MISSING         -               -             
     /tmp/falcon-regression/FeedSlaMonitoring/input/2015/10/28/11/59
> {noformat}
> After updating frequency of feed to 2 minutes response is :
> {noformat}
> dataqa@lda01:/mnt/users/pragya/defn/sla$ falcon instance -type feed -name sla-feed -start
2015-10-28T11:58Z -listing
> Consolidated Status: SUCCEEDED
> Instances:
> Cluster         Instance            Status          Size            CreationTime    
   Details         
> -----------------------------------------------------------------------------------------------
> A9e7e0672-e02bcc652015-10-28T11:58Z   MISSING         -               -             
     /tmp/falcon-regression/FeedSlaMonitoring/input/2015/10/28/11/58
> A9e7e0672-e02bcc652015-10-28T12:00Z   MISSING         -               -             
     /tmp/falcon-regression/FeedSlaMonitoring/input/2015/10/28/12/00
> A9e7e0672-e02bcc652015-10-28T12:02Z   MISSING         -               -             
     /tmp/falcon-regression/FeedSlaMonitoring/input/2015/10/28/12/02
> A9e7e0672-e02bcc652015-10-28T12:04Z   MISSING         -               -             
     /tmp/falcon-regression/FeedSlaMonitoring/input/2015/10/28/12/04
> {noformat}
> All instances are updated with frequency minutes(2) interval



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message