Return-Path: X-Original-To: apmail-beam-commits-archive@minotaur.apache.org Delivered-To: apmail-beam-commits-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 406C119B61 for ; Tue, 19 Apr 2016 08:13:30 +0000 (UTC) Received: (qmail 10817 invoked by uid 500); 19 Apr 2016 08:13:30 -0000 Delivered-To: apmail-beam-commits-archive@beam.apache.org Received: (qmail 10764 invoked by uid 500); 19 Apr 2016 08:13:30 -0000 Mailing-List: contact commits-help@beam.incubator.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@beam.incubator.apache.org Delivered-To: mailing list commits@beam.incubator.apache.org Received: (qmail 10755 invoked by uid 99); 19 Apr 2016 08:13:30 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd4-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 19 Apr 2016 08:13:30 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd4-us-west.apache.org (ASF Mail Server at spamd4-us-west.apache.org) with ESMTP id B946DC05EF for ; Tue, 19 Apr 2016 08:13:29 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd4-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: -4.021 X-Spam-Level: X-Spam-Status: No, score=-4.021 tagged_above=-999 required=6.31 tests=[KAM_LAZY_DOMAIN_SECURITY=1, RCVD_IN_DNSWL_HI=-5, RCVD_IN_MSPIKE_H3=-0.01, RCVD_IN_MSPIKE_WL=-0.01, RP_MATCHES_RCVD=-0.001] autolearn=disabled Received: from mx2-lw-eu.apache.org ([10.40.0.8]) by localhost (spamd4-us-west.apache.org [10.40.0.11]) (amavisd-new, port 10024) with ESMTP id KRHxeR5VsISR for ; Tue, 19 Apr 2016 08:13:27 +0000 (UTC) Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by mx2-lw-eu.apache.org (ASF Mail Server at mx2-lw-eu.apache.org) with SMTP id 71F935F486 for ; Tue, 19 Apr 2016 08:13:26 +0000 (UTC) Received: (qmail 10648 invoked by uid 99); 19 Apr 2016 08:13:25 -0000 Received: from arcas.apache.org (HELO arcas) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 19 Apr 2016 08:13:25 +0000 Received: from arcas.apache.org (localhost [127.0.0.1]) by arcas (Postfix) with ESMTP id 7F69A2C1F5C for ; Tue, 19 Apr 2016 08:13:25 +0000 (UTC) Date: Tue, 19 Apr 2016 08:13:25 +0000 (UTC) From: "ASF GitHub Bot (JIRA)" To: commits@beam.incubator.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Commented] (BEAM-207) Flink test flake in ReadSourceStreamingITCase MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/BEAM-207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15247359#comment-15247359 ] ASF GitHub Bot commented on BEAM-207: ------------------------------------- GitHub user mxm opened a pull request: https://github.com/apache/incubator-beam/pull/209 [BEAM-207] Flink test flake in ReadSourceStreamingITCase The `configure(..)` life cycle method is only called on the master but not on the worker nodes. This may lead to an incorrect initialization of the `Reader` because the `PipelineOptions` haven't been initialized. You can merge this pull request into a Git repository by running: $ git pull https://github.com/mxm/incubator-beam BEAM-207 Alternatively you can review and apply these changes as the patch at: https://github.com/apache/incubator-beam/pull/209.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #209 ---- commit a95e67c482d3378cf472e75a47275cedbf70de41 Author: Maximilian Michels Date: 2016-04-19T07:20:30Z [BEAM-207] Flink test flake in ReadSourceStreamingITCase The configure(..) life cycle method is only called on the master but not on the worker nodes. This may lead to an incorrect initialization of the Reader because the PipelineOptions haven't been initialized. ---- > Flink test flake in ReadSourceStreamingITCase > --------------------------------------------- > > Key: BEAM-207 > URL: https://issues.apache.org/jira/browse/BEAM-207 > Project: Beam > Issue Type: Bug > Components: runner-flink, testing > Reporter: Daniel Halperin > Assignee: Maximilian Michels > > Log from Travis: https://s3.amazonaws.com/archive.travis-ci.org/jobs/124066205/log.txt > Snippet: > {noformat} > Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.792 sec - in org.apache.beam.runners.flink.SideInputITCase > Running org.apache.beam.runners.flink.ReadSourceStreamingITCase > Pipeline execution failed > java.lang.RuntimeException: Pipeline execution failed > at org.apache.beam.runners.flink.FlinkPipelineRunner.run(FlinkPipelineRunner.java:119) > at org.apache.beam.runners.flink.FlinkPipelineRunner.run(FlinkPipelineRunner.java:51) > at org.apache.beam.sdk.Pipeline.run(Pipeline.java:182) > at org.apache.beam.runners.flink.ReadSourceStreamingITCase.runProgram(ReadSourceStreamingITCase.java:70) > at org.apache.beam.runners.flink.ReadSourceStreamingITCase.testProgram(ReadSourceStreamingITCase.java:53) > at org.apache.flink.streaming.util.StreamingProgramTestBase.testJob(StreamingProgramTestBase.java:85) > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > at java.lang.reflect.Method.invoke(Method.java:483) > at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:47) > at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) > at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:44) > at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) > at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55) > at org.junit.rules.RunRules.evaluate(RunRules.java:20) > at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:271) > at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:70) > at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:50) > at org.junit.runners.ParentRunner$3.run(ParentRunner.java:238) > at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:63) > at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:236) > at org.junit.runners.ParentRunner.access$000(ParentRunner.java:53) > at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:229) > at org.junit.runners.ParentRunner.run(ParentRunner.java:309) > at org.apache.maven.surefire.junit4.JUnit4Provider.execute(JUnit4Provider.java:264) > at org.apache.maven.surefire.junit4.JUnit4Provider.executeTestSet(JUnit4Provider.java:153) > at org.apache.maven.surefire.junit4.JUnit4Provider.invoke(JUnit4Provider.java:124) > at org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:200) > at org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:153) > at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:103) > Caused by: org.apache.flink.runtime.client.JobExecutionException: Job execution failed. > at org.apache.flink.runtime.jobmanager.JobManager$$anonfun$handleMessage$1$$anonfun$applyOrElse$7.apply$mcV$sp(JobManager.scala:714) > at org.apache.flink.runtime.jobmanager.JobManager$$anonfun$handleMessage$1$$anonfun$applyOrElse$7.apply(JobManager.scala:660) > at org.apache.flink.runtime.jobmanager.JobManager$$anonfun$handleMessage$1$$anonfun$applyOrElse$7.apply(JobManager.scala:660) > at scala.concurrent.impl.Future$PromiseCompletingRunnable.liftedTree1$1(Future.scala:24) > at scala.concurrent.impl.Future$PromiseCompletingRunnable.run(Future.scala:24) > at akka.dispatch.TaskInvocation.run(AbstractDispatcher.scala:41) > at akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinTask.exec(AbstractDispatcher.scala:401) > at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260) > at scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.pollAndExecAll(ForkJoinPool.java:1253) > at scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1346) > at scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979) > at scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107) > Caused by: java.lang.NullPointerException > at org.apache.beam.runners.flink.translation.wrappers.SourceInputFormat.nextRecord(SourceInputFormat.java:143) > at org.apache.flink.streaming.api.functions.source.FileSourceFunction.run(FileSourceFunction.java:124) > at org.apache.flink.streaming.api.operators.StreamSource.run(StreamSource.java:78) > at org.apache.flink.streaming.runtime.tasks.SourceStreamTask.run(SourceStreamTask.java:56) > at org.apache.flink.streaming.runtime.tasks.StreamTask.invoke(StreamTask.java:224) > at org.apache.flink.runtime.taskmanager.Task.run(Task.java:559) > at java.lang.Thread.run(Thread.java:745) > Tests run: 1, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 0.989 sec <<< FAILURE! - in org.apache.beam.runners.flink.ReadSourceStreamingITCase > testJob(org.apache.beam.runners.flink.ReadSourceStreamingITCase) Time elapsed: 0.988 sec <<< FAILURE! > java.lang.AssertionError: Error while calling the test program: Pipeline execution failed > at org.junit.Assert.fail(Assert.java:88) > at org.apache.flink.streaming.util.StreamingProgramTestBase.testJob(StreamingProgramTestBase.java:90) > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > at java.lang.reflect.Method.invoke(Method.java:483) > at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:47) > at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) > at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:44) > at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) > at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55) > at org.junit.rules.RunRules.evaluate(RunRules.java:20) > at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:271) > at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:70) > at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:50) > at org.junit.runners.ParentRunner$3.run(ParentRunner.java:238) > at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:63) > at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:236) > at org.junit.runners.ParentRunner.access$000(ParentRunner.java:53) > at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:229) > at org.junit.runners.ParentRunner.run(ParentRunner.java:309) > at org.apache.maven.surefire.junit4.JUnit4Provider.execute(JUnit4Provider.java:264) > at org.apache.maven.surefire.junit4.JUnit4Provider.executeTestSet(JUnit4Provider.java:153) > at org.apache.maven.surefire.junit4.JUnit4Provider.invoke(JUnit4Provider.java:124) > at org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:200) > at org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:153) > at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:103) > Running org.apache.beam.runners.flink.WriteSinkITCase > Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.994 sec - in org.apache.beam.runners.flink.WriteSinkITCase > Running org.apache.beam.runners.flink.JoinExamplesITCase > Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.957 sec - in org.apache.beam.runners.flink.JoinExamplesITCase > Running org.apache.beam.runners.flink.TfIdfITCase > Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.509 sec - in org.apache.beam.runners.flink.TfIdfITCase > Running org.apache.beam.runners.flink.RemoveDuplicatesITCase > Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.777 sec - in org.apache.beam.runners.flink.RemoveDuplicatesITCase > {noformat} -- This message was sent by Atlassian JIRA (v6.3.4#6332)