falcon-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Suhas Vasu" <suhas....@gmail.com>
Subject Re: Review Request 23483: FALCON-353 enable dry run feature of oozie for schedule and update
Date Tue, 22 Jul 2014 06:00:58 GMT

-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/23483/#review48206
-----------------------------------------------------------



common/src/main/java/org/apache/falcon/entity/EntityUtil.java
<https://reviews.apache.org/r/23483/#comment84559>

    we should log the error, will help in debugging in case of issues.



common/src/main/java/org/apache/falcon/update/UpdateHelper.java
<https://reviews.apache.org/r/23483/#comment84566>

    it should return false here



common/src/main/java/org/apache/falcon/workflow/engine/AbstractWorkflowEngine.java
<https://reviews.apache.org/r/23483/#comment84560>

    Changing the return type won't cause backward compatibility issues later ?
    my concern is because this is a server call.



oozie/src/main/java/org/apache/falcon/workflow/engine/OozieWorkflowEngine.java
<https://reviews.apache.org/r/23483/#comment84562>

    what if we get back a empty list for delete/kill ?



oozie/src/main/java/org/apache/falcon/workflow/engine/OozieWorkflowEngine.java
<https://reviews.apache.org/r/23483/#comment84567>

    problem if update fails just before updating the config store, it will go through all
the steps again on retry.



oozie/src/main/java/org/apache/falcon/workflow/engine/OozieWorkflowEngine.java
<https://reviews.apache.org/r/23483/#comment84563>

    Shouldn't it be clone rather than entity ?



oozie/src/main/java/org/apache/falcon/workflow/engine/OozieWorkflowEngine.java
<https://reviews.apache.org/r/23483/#comment84564>

    Shouldn't it be clone rather than entity ?
    



oozie/src/test/java/org/apache/falcon/oozie/feed/OozieFeedWorkflowBuilderTest.java
<https://reviews.apache.org/r/23483/#comment84565>

    isn't new Path(wfPath) redundant as wfPath is already new Path()


- Suhas  Vasu


On July 15, 2014, 11:57 a.m., shwethags wrote:
> 
> -----------------------------------------------------------
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/23483/
> -----------------------------------------------------------
> 
> (Updated July 15, 2014, 11:57 a.m.)
> 
> 
> Review request for Falcon.
> 
> 
> Bugs: FALCON-353
>     https://issues.apache.org/jira/browse/FALCON-353
> 
> 
> Repository: falcon-git
> 
> 
> Description
> -------
> 
> Entity schedule creates a bundle in oozie. But bundle submit is asynchronous and coord
create can fail and creates bad user experience. So, this patch uses dryRun feature of oozie
to validate the entity before scheduling in oozie.
> 
> DryRun is used in validate(), schedule() and update()
> 
> 
> Diffs
> -----
> 
>   common/src/main/java/org/apache/falcon/entity/EntityUtil.java a38e553 
>   common/src/main/java/org/apache/falcon/update/UpdateHelper.java 7af77d0 
>   common/src/main/java/org/apache/falcon/workflow/engine/AbstractWorkflowEngine.java
eedd81f 
>   common/src/test/java/org/apache/falcon/update/UpdateHelperTest.java e532b24 
>   oozie/src/main/java/org/apache/falcon/oozie/OozieBundleBuilder.java 2018db2 
>   oozie/src/main/java/org/apache/falcon/oozie/OozieCoordinatorBuilder.java 5a29683 
>   oozie/src/main/java/org/apache/falcon/oozie/OozieEntityBuilder.java bb8dfcc 
>   oozie/src/main/java/org/apache/falcon/oozie/OozieOrchestrationWorkflowBuilder.java
ac78297 
>   oozie/src/main/java/org/apache/falcon/oozie/feed/FeedBundleBuilder.java 6917f4e 
>   oozie/src/main/java/org/apache/falcon/oozie/feed/FeedReplicationCoordinatorBuilder.java
3226cf2 
>   oozie/src/main/java/org/apache/falcon/oozie/feed/FeedReplicationWorkflowBuilder.java
00fab99 
>   oozie/src/main/java/org/apache/falcon/oozie/feed/FeedRetentionCoordinatorBuilder.java
4393c94 
>   oozie/src/main/java/org/apache/falcon/oozie/feed/FeedRetentionWorkflowBuilder.java
4a7f96b 
>   oozie/src/main/java/org/apache/falcon/oozie/process/ProcessBundleBuilder.java 86cea93

>   oozie/src/main/java/org/apache/falcon/oozie/process/ProcessExecutionCoordinatorBuilder.java
c87bc86 
>   oozie/src/main/java/org/apache/falcon/oozie/process/ProcessExecutionWorkflowBuilder.java
0d9abdb 
>   oozie/src/main/java/org/apache/falcon/workflow/engine/OozieWorkflowEngine.java 38be792

>   oozie/src/test/java/org/apache/falcon/oozie/feed/OozieFeedWorkflowBuilderTest.java
542634d 
>   oozie/src/test/java/org/apache/falcon/oozie/process/AbstractTestBase.java 54a2ea7 
>   oozie/src/test/java/org/apache/falcon/oozie/process/OozieProcessWorkflowBuilderTest.java
5ceea75 
>   prism/src/main/java/org/apache/falcon/FalconWebException.java d552c07 
>   prism/src/main/java/org/apache/falcon/resource/AbstractEntityManager.java c135470 
>   webapp/src/test/java/org/apache/falcon/resource/EntityManagerJerseyIT.java e214392

>   webapp/src/test/java/org/apache/falcon/resource/EntityManagerJerseySmokeIT.java dceb2f2

>   webapp/src/test/java/org/apache/falcon/resource/TestContext.java bc79609 
> 
> Diff: https://reviews.apache.org/r/23483/diff/
> 
> 
> Testing
> -------
> 
> UTs + manual end to end test of feed retention and process schedule and update
> 
> 
> Thanks,
> 
> shwethags
> 
>


Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message