hadoop-hdfs-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Allen Wittenauer ...@altiscale.com>
Subject Re: Uncertainty of pre-commit builds
Date Wed, 01 Apr 2015 19:17:08 GMT

	BTW, I think HADOOP-11746 is pretty much ready for review.  I’ve done some Jenkins simulations,
but really need someone more familiar with our build systems to do some tests.


On Mar 31, 2015, at 10:14 AM, Karthik Kambatla <kasha@cloudera.com> wrote:

> Ravi just pointed me to HADOOP-11746. Thanks a bunch for working on
> improving our test-patch scripts, Allen.
> 
> On Tue, Mar 31, 2015 at 9:37 AM, Allen Wittenauer <aw@altiscale.com> wrote:
> 
>> 
>>        Very likely.  One of the things I noticed during HADOOP-11746 is
>> that there is a HUGE, catastrophic race if Jenkins doesn’t setup the
>> environment correctly or leaks variables between runs.  shellcheck prints
>> out so many messages on the current code I’m surprised it doesn’t crash.
>> 
>> On Mar 31, 2015, at 9:21 AM, Karthik Kambatla <kasha@cloudera.com> wrote:
>> 
>>> Hi devs,
>>> 
>>> I am sure people must have noticed, but thought I would bring this up.
>>> 
>>> I have noticed that our pre-commit builds could end up running the
>> "wrong"
>>> set of unit tests for patches. For instance, YARN-3412
>>> <https://issues.apache.org/jira/browse/YARN-3412> changes only YARN
>> files,
>>> but the test were run against one of the MR modules.
>>> 
>>> I suspect there is a race condition when there are multiple builds
>>> executing on the same node, or remnants from a previous run are getting
>>> picked up.
>>> 
>>> Filed HADOOP-11779 for this.
>>> 
>>> --
>>> Karthik Kambatla
>>> Software Engineer, Cloudera Inc.
>>> --------------------------------------------
>>> http://five.sentenc.es
>> 
>> 
> 
> 
> -- 
> Karthik Kambatla
> Software Engineer, Cloudera Inc.
> --------------------------------------------
> http://five.sentenc.es


Mime
View raw message