Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id ACF90200C55 for ; Thu, 13 Apr 2017 23:41:52 +0200 (CEST) Received: by cust-asf.ponee.io (Postfix) id AB96E160B98; Thu, 13 Apr 2017 21:41:52 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id D4C9F160B89 for ; Thu, 13 Apr 2017 23:41:51 +0200 (CEST) Received: (qmail 76472 invoked by uid 500); 13 Apr 2017 21:41:51 -0000 Mailing-List: contact commits-help@beam.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@beam.apache.org Delivered-To: mailing list commits@beam.apache.org Received: (qmail 76463 invoked by uid 99); 13 Apr 2017 21:41:51 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd3-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 13 Apr 2017 21:41:51 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd3-us-west.apache.org (ASF Mail Server at spamd3-us-west.apache.org) with ESMTP id A9302180B10 for ; Thu, 13 Apr 2017 21:41:50 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd3-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: -99.202 X-Spam-Level: X-Spam-Status: No, score=-99.202 tagged_above=-999 required=6.31 tests=[KAM_ASCII_DIVIDERS=0.8, RP_MATCHES_RCVD=-0.001, SPF_PASS=-0.001, USER_IN_WHITELIST=-100] autolearn=disabled Received: from mx1-lw-eu.apache.org ([10.40.0.8]) by localhost (spamd3-us-west.apache.org [10.40.0.10]) (amavisd-new, port 10024) with ESMTP id ZkHoG8Qr6fp4 for ; Thu, 13 Apr 2017 21:41:49 +0000 (UTC) Received: from mailrelay1-us-west.apache.org (mailrelay1-us-west.apache.org [209.188.14.139]) by mx1-lw-eu.apache.org (ASF Mail Server at mx1-lw-eu.apache.org) with ESMTP id 529035FAD8 for ; Thu, 13 Apr 2017 21:41:48 +0000 (UTC) Received: from jira-lw-us.apache.org (unknown [207.244.88.139]) by mailrelay1-us-west.apache.org (ASF Mail Server at mailrelay1-us-west.apache.org) with ESMTP id 9EEF4E0D59 for ; Thu, 13 Apr 2017 21:41:42 +0000 (UTC) Received: from jira-lw-us.apache.org (localhost [127.0.0.1]) by jira-lw-us.apache.org (ASF Mail Server at jira-lw-us.apache.org) with ESMTP id ED2362406F for ; Thu, 13 Apr 2017 21:41:41 +0000 (UTC) Date: Thu, 13 Apr 2017 21:41:41 +0000 (UTC) From: "Luke Cwik (JIRA)" To: commits@beam.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Commented] (BEAM-1970) Cannot run UserScore on Flink runner MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 archived-at: Thu, 13 Apr 2017 21:41:52 -0000 [ https://issues.apache.org/jira/browse/BEAM-1970?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15968254#comment-15968254 ] Luke Cwik commented on BEAM-1970: --------------------------------- The work around is to use a different coder then Avro like SerializableCoder on GameActionInfo > Cannot run UserScore on Flink runner > ------------------------------------ > > Key: BEAM-1970 > URL: https://issues.apache.org/jira/browse/BEAM-1970 > Project: Beam > Issue Type: Bug > Components: runner-flink > Reporter: Ahmet Altay > Assignee: Aljoscha Krettek > > Fails with error: > ClassCastException: org.apache.beam.examples.complete.game.UserScore$GameActionInfo cannot be cast to org.apache.beam.examples.complete.game.UserScore$GameActionInfo > full stack: > ------------------------------------------------------------ > The program finished with the following exception: > org.apache.flink.client.program.ProgramInvocationException: The main method caused an error. > at org.apache.flink.client.program.PackagedProgram.callMainMethod(PackagedProgram.java:545) > at org.apache.flink.client.program.PackagedProgram.invokeInteractiveModeForExecution(PackagedProgram.java:419) > at org.apache.flink.client.program.ClusterClient.run(ClusterClient.java:339) > at org.apache.flink.client.CliFrontend.executeProgram(CliFrontend.java:831) > at org.apache.flink.client.CliFrontend.run(CliFrontend.java:256) > at org.apache.flink.client.CliFrontend.parseParameters(CliFrontend.java:1073) > at org.apache.flink.client.CliFrontend$2.call(CliFrontend.java:1120) > at org.apache.flink.client.CliFrontend$2.call(CliFrontend.java:1117) > at org.apache.flink.runtime.security.HadoopSecurityContext$1.run(HadoopSecurityContext.java:43) > at java.security.AccessController.doPrivileged(Native Method) > at javax.security.auth.Subject.doAs(Subject.java:422) > at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657) > at org.apache.flink.runtime.security.HadoopSecurityContext.runSecured(HadoopSecurityContext.java:40) > at org.apache.flink.client.CliFrontend.main(CliFrontend.java:1116) > Caused by: java.lang.RuntimeException: Pipeline execution failed > at org.apache.beam.runners.flink.FlinkRunner.run(FlinkRunner.java:119) > at org.apache.beam.sdk.Pipeline.run(Pipeline.java:265) > at org.apache.beam.examples.complete.game.UserScore.main(UserScore.java:238) > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > at java.lang.reflect.Method.invoke(Method.java:498) > at org.apache.flink.client.program.PackagedProgram.callMainMethod(PackagedProgram.java:528) > ... 13 more > Caused by: org.apache.flink.client.program.ProgramInvocationException: The program execution failed: Job execution failed. > at org.apache.flink.client.program.ClusterClient.run(ClusterClient.java:427) > at org.apache.flink.yarn.YarnClusterClient.submitJob(YarnClusterClient.java:210) > at org.apache.flink.client.program.ClusterClient.run(ClusterClient.java:400) > at org.apache.flink.client.program.ClusterClient.run(ClusterClient.java:387) > at org.apache.flink.client.program.ContextEnvironment.execute(ContextEnvironment.java:62) > at org.apache.beam.runners.flink.FlinkPipelineExecutionEnvironment.executePipeline(FlinkPipelineExecutionEnvironment.java:111) > at org.apache.beam.runners.flink.FlinkRunner.run(FlinkRunner.java:116) > ... 20 more > Caused by: org.apache.flink.runtime.client.JobExecutionException: Job execution failed. > at org.apache.flink.runtime.jobmanager.JobManager$$anonfun$handleMessage$1$$anonfun$applyOrElse$6.apply$mcV$sp(JobManager.scala:900) > at org.apache.flink.runtime.jobmanager.JobManager$$anonfun$handleMessage$1$$anonfun$applyOrElse$6.apply(JobManager.scala:843) > at org.apache.flink.runtime.jobmanager.JobManager$$anonfun$handleMessage$1$$anonfun$applyOrElse$6.apply(JobManager.scala:843) > at scala.concurrent.impl.Future$PromiseCompletingRunnable.liftedTree1$1(Future.scala:24) > at scala.concurrent.impl.Future$PromiseCompletingRunnable.run(Future.scala:24) > at akka.dispatch.TaskInvocation.run(AbstractDispatcher.scala:40) > at akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinTask.exec(AbstractDispatcher.scala:397) > at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260) > at scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339) > at scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979) > at scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107) > Caused by: org.apache.beam.sdk.util.UserCodeException: java.lang.ClassCastException: org.apache.beam.examples.complete.game.UserScore$GameActionInfo cannot > be cast to org.apache.beam.examples.complete.game.UserScore$GameActionInfo > at org.apache.beam.sdk.util.UserCodeException.wrap(UserCodeException.java:36) > at org.apache.beam.sdk.transforms.MapElements$1$auxiliary$CfEWT9ws.invokeProcessElement(Unknown Source) > at org.apache.beam.runners.core.SimpleDoFnRunner.invokeProcessElement(SimpleDoFnRunner.java:199) > at org.apache.beam.runners.core.SimpleDoFnRunner.processElement(SimpleDoFnRunner.java:160) > at org.apache.beam.runners.flink.translation.functions.FlinkDoFnFunction.mapPartition(FlinkDoFnFunction.java:109) > at org.apache.flink.runtime.operators.MapPartitionDriver.run(MapPartitionDriver.java:103) > at org.apache.flink.runtime.operators.BatchTask.run(BatchTask.java:490) > at org.apache.flink.runtime.operators.BatchTask.invoke(BatchTask.java:355) > at org.apache.flink.runtime.taskmanager.Task.run(Task.java:655) > at java.lang.Thread.run(Thread.java:745) > Caused by: java.lang.ClassCastException: org.apache.beam.examples.complete.game.UserScore$GameActionInfo cannot be cast to org.apache.beam.examples.complet > e.game.UserScore$GameActionInfo > at org.apache.beam.sdk.transforms.SimpleFunction.apply(SimpleFunction.java:65) > at org.apache.beam.sdk.transforms.MapElements$1.processElement(MapElements.java:122) > 2017-04-13 21:11:11,155 INFO org.apache.flink.yarn.YarnClusterClient - Disconnecting YarnClusterClient from ApplicationMaster -- This message was sent by Atlassian JIRA (v6.3.15#6346)