Return-Path: X-Original-To: apmail-flink-dev-archive@www.apache.org Delivered-To: apmail-flink-dev-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 87FB317320 for ; Wed, 10 Jun 2015 12:25:33 +0000 (UTC) Received: (qmail 53940 invoked by uid 500); 10 Jun 2015 12:25:33 -0000 Delivered-To: apmail-flink-dev-archive@flink.apache.org Received: (qmail 53885 invoked by uid 500); 10 Jun 2015 12:25:33 -0000 Mailing-List: contact dev-help@flink.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@flink.apache.org Delivered-To: mailing list dev@flink.apache.org Received: (qmail 53869 invoked by uid 99); 10 Jun 2015 12:25:33 -0000 Received: from mail-relay.apache.org (HELO mail-relay.apache.org) (140.211.11.15) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 10 Jun 2015 12:25:33 +0000 Received: from mail-vn0-f54.google.com (mail-vn0-f54.google.com [209.85.216.54]) by mail-relay.apache.org (ASF Mail Server at mail-relay.apache.org) with ESMTPSA id 087BA1A0147 for ; Wed, 10 Jun 2015 12:25:32 +0000 (UTC) Received: by vnbf7 with SMTP id f7so7612621vnb.13 for ; Wed, 10 Jun 2015 05:25:32 -0700 (PDT) MIME-Version: 1.0 X-Received: by 10.52.71.203 with SMTP id x11mr5927044vdu.48.1433939132189; Wed, 10 Jun 2015 05:25:32 -0700 (PDT) Received: by 10.52.166.161 with HTTP; Wed, 10 Jun 2015 05:25:32 -0700 (PDT) In-Reply-To: References: <5B425CB2-544B-481C-8437-8BABB03F4A8B@icloud.com> <863324CF-051C-4DB3-BDF9-4BC4EFCEB759@apache.org> <86B96B16-4CBD-4F5F-A346-B74D5557DA46@icloud.com> <0C2654BE-2198-4D1C-9A24-AE1BE31B650B@apache.org> Date: Wed, 10 Jun 2015 14:25:32 +0200 Message-ID: Subject: Re: Testing Apache Flink 0.9.0-rc1 From: Aljoscha Krettek To: dev@flink.apache.org Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable I added a section at the top of the release testing document to keep track of commits that we might want to cherry-pick to the release. I included the YARNSessionFIFOITCase fix and the optional stream iteration partitioning (both already on release branch). On Wed, Jun 10, 2015 at 12:51 PM, Fabian Hueske wrote: > @Sachin: I reproduced the build error on my Windows machine. > > 2015-06-10 12:22 GMT+02:00 Maximilian Michels : > >> @Sachin: This looks like a file permission issue. We should have someone >> else verify that on a Windows system. >> >> On Wed, Jun 10, 2015 at 11:28 AM, Sachin Goel >> wrote: >> >> > I have run "mvn clean verify" five times now and every time I'm gettin= g >> > these failed tests: >> > >> > BlobUtilsTest.before:45 null >> > BlobUtilsTest.before:45 null >> > BlobServerDeleteTest.testDeleteFails:291 null >> > BlobLibraryCacheManagerTest.testRegisterAndDownload:196 Could not >> > remove write permissions from cache directory >> > BlobServerPutTest.testPutBufferFails:224 null >> > BlobServerPutTest.testPutNamedBufferFails:286 null >> > JobManagerStartupTest.before:55 null >> > JobManagerStartupTest.before:55 null >> > DataSinkTaskTest.testFailingDataSinkTask:317 Temp output file has >> > not been removed >> > DataSinkTaskTest.testFailingSortingDataSinkTask:358 Temp output file >> > has not been removed >> > TaskManagerTest.testSubmitAndExecuteTask**:123 assertion failed: >> > timeout (19998080696 nanoseconds) during expectMsgClass waiting for >> > class >> > >> org.apache.flink.runtime.messages.RegistrationMessages$RegisterTaskManag= er >> > TaskManagerProcessReapingTest.testReapProcessOnFailure:133 >> > TaskManager process did not launch the TaskManager properly. Failed to >> > look up akka.tcp://flink@127.0.0.1:50673/user/taskmanager >> > >> > ** fails randomly. >> > >> > Is someone able to reproduce these while building on a windows machine= ? I >> > would try to debug these myself but I'm not yet familiar with the core >> > architecture and API. >> > >> > -- Sachin >> > >> > On Wed, Jun 10, 2015 at 2:46 PM, Aljoscha Krettek >> > wrote: >> > >> > > The KMeans quickstart example does not work with the current state o= f >> > > the KMeansDataGenerator. I created PR that brings the two in sync. >> > > This should probably go into the release since it affects initial us= er >> > > "satisfaction". >> > > >> > > On Wed, Jun 10, 2015 at 11:14 AM, M=C3=A1rton Balassi >> > > wrote: >> > > > As for the streaming commit cherry-picked to the release branch: >> > > > This is an unfortunate communication issue, let us make sure that = we >> > > > clearly communicate similar issues in the future. >> > > > >> > > > As for FLINK-2192: This is essentially a duplicate issue of the >> > > testability >> > > > of the streaming iteration. Not a blocker, I will comment on the J= IRA >> > > > ticket, Gabor Hermann is already working on the root cause. >> > > > >> > > > On Wed, Jun 10, 2015 at 11:07 AM, Ufuk Celebi >> wrote: >> > > > >> > > >> Hey Gyula, Max, >> > > >> >> > > >> On 10 Jun 2015, at 10:54, Gyula F=C3=B3ra = wrote: >> > > >> >> > > >> > This feature needs to be included in the release, it has been >> tested >> > > and >> > > >> > used extensively. And many applciations depend on it. >> > > >> >> > > >> It would be nice to announce/discuss this before just cherry-pick= ing >> > it >> > > >> into the release branch. The issue is that no one (except you) kn= ows >> > > that >> > > >> this is important. Let's just make sure to do this for future fix= es. >> > > >> >> > > >> Having said that... it seems to be an important fix. Does someone >> have >> > > >> time (looking at Aljoscha ;)) to review the changes? >> > > >> >> > > >> > Maximilian Michels ezt =C3=ADrta (id=C5=91pont= : 2015. j=C3=BAn. >> > > 10., >> > > >> Sze, >> > > >> > 10:47): >> > > >> > >> > > >> >> With all the issues discovered, it looks like we'll have anoth= er >> > > release >> > > >> >> candidate. Right now, we have discovered the following problem= s: >> > > >> >> >> > > >> >> 1 YARN ITCase fails [fixed via 2eb5cfe] >> > > >> >> 2 No Jar for SessionWindowing example [fixed in #809] >> > > >> >> 3 Wrong description of the input format for the graph examples >> (eg. >> > > >> >> ConnectedComponents) [fixed in #809] >> > > >> >> 4 TaskManagerFailsWithSlotSharingITCase fails >> > > >> >> 5 ComplexIntegrationTest.complexIntegrationTest1() (FLINK-2192= ) >> > fails >> > > >> >> > > >> Can we verify that the tests are defect and not the tested >> component? >> > ;) >> > > >> Otherwise, I would not block the release on flakey tests. >> > > >> >> > > >> >> 6 Submitting KMeans example to Web Submission Client does not >> work >> > on >> > > >> >> Firefox. >> > > >> >> 7 Zooming is buggy in Web Submission Client (Firefox) >> > > >> >> Do we have someone familiar with the web interface who could >> take a >> > > >> look at >> > > >> >> the Firefox issues? >> > > >> >> > > >> If not, I would not block the release on this. >> > > >> > >>