falcon-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Paul Isaychuk" <pisayc...@hortonworks.com>
Subject Re: Review Request 26639: [FALCON-801] Increase time to wait instances to got running
Date Thu, 16 Oct 2014 08:31:52 GMT


> On Oct. 15, 2014, 8:52 p.m., Raghav Gautam wrote:
> > falcon-regression/merlin/src/test/java/org/apache/falcon/regression/prism/OptionalInputTest.java,
line 281
> > <https://reviews.apache.org/r/26639/diff/1/?file=719373#file719373line281>
> >
> >     I am not able to understand where start time is being modification in the code.
Can you point me to it ?

I debugged it once more and seems like I found the key. 

Process start/end time doesn't change in the code. After entity was updated, new bundle job
is created on Oozie and its -start time is equal to -end time of last instace which is runnnig
under old bundle job (original job). The case is that after 'update' was performed SUCCEEDED
and RUNNING instances of old process keep belong to old process(bundle) and all non-triggered
instance will belong to new bundle job. Usually we have 2 old process instances SUCCEEDED
and 3d instance is not triggered so new bundle job -start time is equal to -end of 2nd instance
and new bundle job runs immidiately after 'update' was performed. But sometimes (I don't know
the reason, maybe some delays) 3d instance is being triggered earlier and thus it running
under old process. New bundle job -start time is 5 minutes later (it equals to -end time of
3d instance instead of 2nd one). Thus bundle job hangs in PREP state until that later time
will be reached. As we used 3 minutes it intermittently could fail. Mak
 es sense?


- Paul


-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/26639/#review56805
-----------------------------------------------------------


On Oct. 13, 2014, 10:29 a.m., Paul Isaychuk wrote:
> 
> -----------------------------------------------------------
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/26639/
> -----------------------------------------------------------
> 
> (Updated Oct. 13, 2014, 10:29 a.m.)
> 
> 
> Review request for Falcon.
> 
> 
> Bugs: FALCON-801
>     https://issues.apache.org/jira/browse/FALCON-801
> 
> 
> Repository: falcon-git
> 
> 
> Description
> -------
> 
> optionalTest_updateProcessMakeOptionalCompulsory needs more time for new instances to
start. They have got created and are on PREP state until they reach their start time.
> 
> 
> Diffs
> -----
> 
>   falcon-regression/merlin/src/test/java/org/apache/falcon/regression/prism/OptionalInputTest.java
c8a4754 
> 
> Diff: https://reviews.apache.org/r/26639/diff/
> 
> 
> Testing
> -------
> 
> test passed
> 
> 
> Thanks,
> 
> Paul Isaychuk
> 
>


Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message