flink-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Ufuk Celebi <...@apache.org>
Subject Re: Extend Travis-CI build matrix
Date Wed, 27 Aug 2014 09:56:40 GMT
In general, I agree that we should add further variants.

To make sure that I understand you correctly:

We keep the current 6 variants (oraclejdk8, oraclejdk7, openjdk6) x (hadoop
1.2.1, hadoop 2.2.0) and add 2 variants (oraclejdk8) x (hadoop 2.0.0-alpha,
hadoop 2.5.0), resulting in 8 instead of the "full" 12?

Assuming that one (jdk) x (hadoop) variant takes ~20 mins, we would save 20
mins before we have a confirmation for good builds. Since bad builds will
probably fail earlier anyways, I vote to go for the full matrix.

In any case we wouldn't loose anything by adding a further JDK to the new
variants as there should be not a big time difference between 10 and 8
variants (assuming that the 5 parallel builds take roughly the same amount
of time).

On Wed, Aug 27, 2014 at 11:40 AM, Robert Metzger <rmetzger@apache.org>

> Hi guys,
> while creating the 0.6-incubating release I noticed that often build issues
> are triggered by changing dependencies.
> In particular we allow users to set the version of the Hadoop dependency.
> Right now, we test the following variants:
> (oraclejdk8, oraclejdk7, openjdk6) x (hadoop 1.2.1, hadoop 2.2.0)
> Accidentially, I found out that the recently merged streaming component
> does not build with hadoop 2.4.0 as a dependency (
> https://issues.apache.org/jira/browse/FLINK-1065).
> I'm suggesting to add the following versions into the pool of Hadoop
> versions we test against:
> 1) "hadoop 2.0.0-alpha"
> 2 "hadoop 2.5.0"
> 1) is going to be the replacement for the "cdh4" package, and I think we
> should test versions we are going to ship with releases. (
> https://issues.apache.org/jira/browse/FLINK-1068)
> 2) is the current stable hadoop version. I think we should test against
> hadoop 2.2.0 and the latest stable hadoop version.
> Adding these two versions would result in 3x4 = 12 builds per push / pull
> request, which is a lot given that we can only run 5 tests in parallel.
> Therefore, I'm suggesting to add just 2 builds with "oraclejdk8" and the
> two new hadoop versions.
> Opinions?
> -- Robert

  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message