From commits-return-92521-archive-asf-public=cust-asf.ponee.io@beam.apache.org Fri Sep 14 20:22:06 2018 Return-Path: X-Original-To: archive-asf-public@cust-asf.ponee.io Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by mx-eu-01.ponee.io (Postfix) with SMTP id 5453F180647 for ; Fri, 14 Sep 2018 20:22:05 +0200 (CEST) Received: (qmail 13250 invoked by uid 500); 14 Sep 2018 18:22:04 -0000 Mailing-List: contact commits-help@beam.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@beam.apache.org Delivered-To: mailing list commits@beam.apache.org Received: (qmail 13241 invoked by uid 99); 14 Sep 2018 18:22:04 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd4-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 14 Sep 2018 18:22:04 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd4-us-west.apache.org (ASF Mail Server at spamd4-us-west.apache.org) with ESMTP id 1B5B4C06D5 for ; Fri, 14 Sep 2018 18:22:04 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd4-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: -109.501 X-Spam-Level: X-Spam-Status: No, score=-109.501 tagged_above=-999 required=6.31 tests=[ENV_AND_HDR_SPF_MATCH=-0.5, KAM_ASCII_DIVIDERS=0.8, RCVD_IN_DNSWL_MED=-2.3, SPF_PASS=-0.001, USER_IN_DEF_SPF_WL=-7.5, USER_IN_WHITELIST=-100] autolearn=disabled Received: from mx1-lw-us.apache.org ([10.40.0.8]) by localhost (spamd4-us-west.apache.org [10.40.0.11]) (amavisd-new, port 10024) with ESMTP id X4d_7vpW0WhM for ; Fri, 14 Sep 2018 18:22:01 +0000 (UTC) Received: from mailrelay1-us-west.apache.org (mailrelay1-us-west.apache.org [209.188.14.139]) by mx1-lw-us.apache.org (ASF Mail Server at mx1-lw-us.apache.org) with ESMTP id 2694C5F3BA for ; Fri, 14 Sep 2018 18:22:01 +0000 (UTC) Received: from jira-lw-us.apache.org (unknown [207.244.88.139]) by mailrelay1-us-west.apache.org (ASF Mail Server at mailrelay1-us-west.apache.org) with ESMTP id BA1A3E0E5D for ; Fri, 14 Sep 2018 18:22:00 +0000 (UTC) Received: from jira-lw-us.apache.org (localhost [127.0.0.1]) by jira-lw-us.apache.org (ASF Mail Server at jira-lw-us.apache.org) with ESMTP id 3422B23FA0 for ; Fri, 14 Sep 2018 18:22:00 +0000 (UTC) Date: Fri, 14 Sep 2018 18:22:00 +0000 (UTC) From: "ASF GitHub Bot (JIRA)" To: commits@beam.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Work logged] (BEAM-5378) Ensure all Go SDK examples run successfully MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/BEAM-5378?focusedWorklogId=3D1= 44387&page=3Dcom.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpan= el#worklog-144387 ] ASF GitHub Bot logged work on BEAM-5378: ---------------------------------------- Author: ASF GitHub Bot Created on: 14/Sep/18 18:21 Start Date: 14/Sep/18 18:21 Worklog Time Spent: 10m=20 Work Description: aaltay commented on a change in pull request #6395:= [BEAM-5378] Update go wordcap example to work on Dataflow runner URL: https://github.com/apache/beam/pull/6395#discussion_r217801313 =20 =20 ########## File path: sdks/go/examples/wordcap/wordcap.go ########## @@ -31,7 +30,7 @@ import ( ) =20 var ( -=09input =3D flag.String("input", os.ExpandEnv("$GOPATH/src/github.com/apa= che/beam/sdks/go/data/haiku/old_pond.txt"), "Files to read.") +=09input =3D flag.String("input", "gs://apache-beam-samples/shakespeare/ki= nglear.txt", "File(s) to read.") =20 Review comment: Yes, I tried that it does. (This is similar to the wordcount example.) I= believe this is a public file in GCS and does not require any auth to read= it. ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on GitHub and use the URL above to go to the specific comment. =20 For queries about this service, please contact Infrastructure at: users@infra.apache.org Issue Time Tracking ------------------- Worklog Id: (was: 144387) Time Spent: 40m (was: 0.5h) > Ensure all Go SDK examples run successfully > ------------------------------------------- > > Key: BEAM-5378 > URL: https://issues.apache.org/jira/browse/BEAM-5378 > Project: Beam > Issue Type: Bug > Components: sdk-go > Affects Versions: Not applicable > Reporter: Tomas Roos > Priority: Major > Time Spent: 40m > Remaining Estimate: 0h > > I've been spending a day or so running through the example available for = the Go SDK in order to see what works and on what runner (direct, dataflow)= , and what doesn't and here's the results. > All available examples for the go sdk. For me as a new developer on apach= e beam and dataflow it would be a tremendous value to have all examples run= ning because many of them have legitimate use-cases behind them.=20 > {code:java} > =E2=94=9C=E2=94=80=E2=94=80 complete > =E2=94=82=C2=A0=C2=A0 =E2=94=94=E2=94=80=E2=94=80 autocomplete > =E2=94=82=C2=A0=C2=A0 =E2=94=94=E2=94=80=E2=94=80 autocomplete.go > =E2=94=9C=E2=94=80=E2=94=80 contains > =E2=94=82=C2=A0=C2=A0 =E2=94=94=E2=94=80=E2=94=80 contains.go > =E2=94=9C=E2=94=80=E2=94=80 cookbook > =E2=94=82=C2=A0=C2=A0 =E2=94=9C=E2=94=80=E2=94=80 combine > =E2=94=82=C2=A0=C2=A0 =E2=94=82=C2=A0=C2=A0 =E2=94=94=E2=94=80=E2=94=80 c= ombine.go > =E2=94=82=C2=A0=C2=A0 =E2=94=9C=E2=94=80=E2=94=80 filter > =E2=94=82=C2=A0=C2=A0 =E2=94=82=C2=A0=C2=A0 =E2=94=94=E2=94=80=E2=94=80 f= ilter.go > =E2=94=82=C2=A0=C2=A0 =E2=94=9C=E2=94=80=E2=94=80 join > =E2=94=82=C2=A0=C2=A0 =E2=94=82=C2=A0=C2=A0 =E2=94=94=E2=94=80=E2=94=80 j= oin.go > =E2=94=82=C2=A0=C2=A0 =E2=94=9C=E2=94=80=E2=94=80 max > =E2=94=82=C2=A0=C2=A0 =E2=94=82=C2=A0=C2=A0 =E2=94=94=E2=94=80=E2=94=80 m= ax.go > =E2=94=82=C2=A0=C2=A0 =E2=94=94=E2=94=80=E2=94=80 tornadoes > =E2=94=82=C2=A0=C2=A0 =E2=94=94=E2=94=80=E2=94=80 tornadoes.go > =E2=94=9C=E2=94=80=E2=94=80 debugging_wordcount > =E2=94=82=C2=A0=C2=A0 =E2=94=94=E2=94=80=E2=94=80 debugging_wordcount.go > =E2=94=9C=E2=94=80=E2=94=80 forest > =E2=94=82=C2=A0=C2=A0 =E2=94=94=E2=94=80=E2=94=80 forest.go > =E2=94=9C=E2=94=80=E2=94=80 grades > =E2=94=82=C2=A0=C2=A0 =E2=94=94=E2=94=80=E2=94=80 grades.go > =E2=94=9C=E2=94=80=E2=94=80 minimal_wordcount > =E2=94=82=C2=A0=C2=A0 =E2=94=94=E2=94=80=E2=94=80 minimal_wordcount.go > =E2=94=9C=E2=94=80=E2=94=80 multiout > =E2=94=82=C2=A0=C2=A0 =E2=94=94=E2=94=80=E2=94=80 multiout.go > =E2=94=9C=E2=94=80=E2=94=80 pingpong > =E2=94=82=C2=A0=C2=A0 =E2=94=94=E2=94=80=E2=94=80 pingpong.go > =E2=94=9C=E2=94=80=E2=94=80 streaming_wordcap > =E2=94=82=C2=A0=C2=A0 =E2=94=94=E2=94=80=E2=94=80 wordcap.go > =E2=94=9C=E2=94=80=E2=94=80 windowed_wordcount > =E2=94=82=C2=A0=C2=A0 =E2=94=94=E2=94=80=E2=94=80 windowed_wordcount.go > =E2=94=9C=E2=94=80=E2=94=80 wordcap > =E2=94=82=C2=A0=C2=A0 =E2=94=94=E2=94=80=E2=94=80 wordcap.go > =E2=94=9C=E2=94=80=E2=94=80 wordcount > =E2=94=82=C2=A0=C2=A0 =E2=94=94=E2=94=80=E2=94=80 wordcount.go > =E2=94=94=E2=94=80=E2=94=80 yatzy > =E2=94=94=E2=94=80=E2=94=80 yatzy.go > {code} > All examples that are supposed to be runnable by the direct driver (not d= epending on gcp platform services) are runnable. > On the otherhand these are the tests that needs to be updated because its= not runnable on the dataflow platform for various reasons. > I tried to figure them out and all I can do is to pin point at least wher= e it fails since my knowledge so far in the beam / dataflow internals is li= mited. > . > =E2=94=9C=E2=94=80=E2=94=80 complete > =E2=94=82=C2=A0=C2=A0 =E2=94=94=E2=94=80=E2=94=80 autocomplete > =E2=94=82=C2=A0=C2=A0 =E2=94=94=E2=94=80=E2=94=80 autocomplete.go > Runs successfully if swapping the input to one of the shakespear data fil= es from gs:// > But when running this it yields a error from the top.Largest func (discus= sed in another issue that top.Largest needs to have a serializeable combina= tor / accumulator) > =E2=9E=9C autocomplete git:(master) =E2=9C=97 ./autocomplete --project f= air-app-213019 --runner dataflow --staging_location=3Dgs://fair-app-213019/= staging-test2 --worker_harness_container_image=3Dapache-docker-beam-snapsho= ts-docker.bintray.io/beam/go:20180515=20 > 2018/09/11 15:35:26 Running autocomplete > Unable to encode combiner for lifting: failed to encode custom coder: bad= underlying type: bad field type: bad element: unencodable type: interface = {}2018/09/11 15:35:26 Using running binary as worker binary: './autocomplet= e' > 2018/09/11 15:35:26 Staging worker binary: ./autocomplete > =E2=94=9C=E2=94=80=E2=94=80 contains > =E2=94=82=C2=A0=C2=A0 =E2=94=94=E2=94=80=E2=94=80 contains.go > Fails when running debug.Head for some mysterious reason, might have to d= o with the param passing into the x,y iterator. Frankly I dont know and cou= ld not figure. > But removing the debug.Head call everything works as expected and succeed= s. > =E2=94=9C=E2=94=80=E2=94=80 cookbook > =E2=94=82=C2=A0=C2=A0 =E2=94=9C=E2=94=80=E2=94=80 combine > =E2=94=82=C2=A0=C2=A0 =E2=94=82=C2=A0=C2=A0 =E2=94=94=E2=94=80=E2=94=80 c= ombine.go > Fails because of extractFn which is a struct is not registered through th= e beam.RegisterType (is this a must or not?) > It works as a work around at least > =E2=9E=9C combine git:(master) =E2=9C=97 ./combine --output=3Dfair-app-2= 13019:combineoutput.test --project=3Dfair-app-213019 --runner=3Ddataflow --= staging_location=3Dgs://203019-staging/ --worker_harness_container_image=3D= apache-docker-beam-snapshots-docker.bintray.io/beam/go:20180515=20 > 2018/09/11 15:40:50 Running combine > panic: Failed to serialize 3: ParDo [In(Main): main.WordRow <- {2: main.W= ordRow/main.WordRow[json] GLO}] -> [Out: KV -> {3: KV/KV GLO}]: encode: bad userfn: recv type must be regis= tered: *main.extractFn > =E2=94=82=C2=A0=C2=A0 =E2=94=9C=E2=94=80=E2=94=80 filter > =E2=94=82=C2=A0=C2=A0 =E2=94=82=C2=A0=C2=A0 =E2=94=94=E2=94=80=E2=94=80 f= ilter.go > Fails go-job-1-1536673624017210012 > 2018-09-11 (15:47:13) Output i0 for step was not found.=20 > =E2=94=82=C2=A0=C2=A0 =E2=94=9C=E2=94=80=E2=94=80 join > =E2=94=82=C2=A0=C2=A0 =E2=94=82=C2=A0=C2=A0 =E2=94=94=E2=94=80=E2=94=80 j= oin.go > Working as expected! Whey! > =E2=94=82=C2=A0=C2=A0 =E2=94=9C=E2=94=80=E2=94=80 max > =E2=94=82=C2=A0=C2=A0 =E2=94=82=C2=A0=C2=A0 =E2=94=94=E2=94=80=E2=94=80 m= ax.go > Working! > =E2=94=82=C2=A0=C2=A0 =E2=94=94=E2=94=80=E2=94=80 tornadoes > =E2=94=82=C2=A0=C2=A0 =E2=94=94=E2=94=80=E2=94=80 tornadoes.go > Working! > =E2=94=9C=E2=94=80=E2=94=80 debugging_wordcount > =E2=94=82=C2=A0=C2=A0 =E2=94=94=E2=94=80=E2=94=80 debugging_wordcount.go > Runs on direct runner but at dataflow this fails with go-job-1-153684075= 4314770217 > Workflow failed. Causes: S12:AsViewe14_i2/GroupByKeyHashAndSortByKeyAndWi= ndow/Read+AsViewe14_i2/ToIsmRecordForMultimap failed., Unable to rename out= put files from gs://fair-app-213019/staging-test2/tmp/dax-tmp-2018-09-13_05= _12_44-15927590761710593971-S12-0-e83a2d3d2da24ef/tmp-e83a2d3d2da29b2@DAX.i= sm to gs://fair-app-213019/staging-test2/tmp/tmp-e83a2d3d2da29b2@*.ism., Un= able to rename "gs://fair-app-213019/staging-test2/tmp/dax-tmp-2018-09-13_0= 5_12_44-15927590761710593971-S12-0-e83a2d3d2da24ef/tmp-e83a2d3d2da29b2-shar= d--try-2a30b4c674ca50f3-endshard.ism" to "gs://fair-app-213019/staging-test= 2/tmp/tmp-e83a2d3d2da29b2-00002-of-00003.ism". > RESP: instruction_id: "-189" process_bundle: < metrics: < ptransforms: < = key: "-159" value: < processed_elements: < measured: < output_element_count= s: < key: "-157" value: 1657 > > > > > ptransforms: < key: "main.filterFn" = value: < > > ptransforms: < key: "main.formatFn" value: < > > > > > RESP: instruction_id: "-191" error: "execution plan for -189 not found" r= egister: < > > most likely this error belongs to the stats.Count call > =E2=94=9C=E2=94=80=E2=94=80 forest > =E2=94=82=C2=A0=C2=A0 =E2=94=94=E2=94=80=E2=94=80 forest.go > Bazinga, all good! > =E2=94=9C=E2=94=80=E2=94=80 grades > =E2=94=82=C2=A0=C2=A0 =E2=94=94=E2=94=80=E2=94=80 grades.go > Fails and is yield a error when invoking this on dataflow in combiner lif= ting encoding go-job-1-1536841991979521665 > 2018/09/13 14:33:11 Running grades > Unable to encode combiner for lifting: failed to encode custom coder: bad= underlying type: bad field type: bad element: unencodable type: interface = {}Unable to encode combiner for lifting: failed to encode custom coder: bad= underlying type: bad field type: bad element: unencodable type: interface = {}Unable to encode combiner for lifting: failed to encode custom coder: bad= underlying type: bad field type: bad element: unencodable type: interface = {}Unable to encode combiner for lifting: failed to encode custom coder: bad= underlying type: bad field type: bad element: unencodable type: interface = {}2018/09/13 14:33:11 Cross-compiling /home/tomas/dev/go/src/github.com/apa= che/beam/sdks/go/examples/grades/grades.go as /tmp/worker-1-153684199198291= 0418 > java.util.concurrent.ExecutionException: java.lang.RuntimeException: Err= or received from SDK harness for instruction -303: execute failed: panic: i= ncompatible func type goroutine 47 [running]: > runtime/debug.Stack(0xc420244a38, 0xc3b160, 0xe96e80) > =09/usr/local/go/src/runtime/debug/stack.go:24 +0xa7 > github.com/apache/beam/sdks/go/pkg/beam/core/runtime/exec.callNoPanic.fun= c1(0xc420244c00) > =09/home/tomas/dev/go/src/github.com/apache/beam/sdks/go/pkg/beam/core/ru= ntime/exec/util.go:39 +0x6e > panic(0xc3b160, 0xe96e80) > =09/usr/local/go/src/runtime/panic.go:502 +0x229 > github.com/apache/beam/sdks/go/pkg/beam/core/util/reflectx.ToFunc2x1(0xea= 2420, 0xc42100f380, 0xdd37ed, 0x11) > =09/home/tomas/dev/go/src/github.com/apache/beam/sdks/go/pkg/beam/core/ut= il/reflectx/calls.go:429 +0x15d > github.com/apache/beam/sdks/go/pkg/beam/core/runtime/exec.(*MergeAccumula= tors).Up(0xc420b1a770, 0xea6120, 0xc420f4c240, 0x0, 0xc420244bc0) > =09/home/tomas/dev/go/src/github.com/apache/beam/sdks/go/pkg/beam/core/ru= ntime/exec/combine.go:368 +0xb2 > github.com/apache/beam/sdks/go/pkg/beam/core/runtime/exec.(Unit).Up-fm(0x= ea6120, 0xc420f4c240, 0xc420244c00, 0x0) > =09/home/tomas/dev/go/src/github.com/apache/beam/sdks/go/pkg/beam/core/ru= ntime/exec/plan.go:90 +0x43 > github.com/apache/beam/sdks/go/pkg/beam/core/runtime/exec.callNoPanic(0xe= a6120, 0xc420f4c240, 0xc420244ca0, 0x0, 0x0) > =09/home/tomas/dev/go/src/github.com/apache/beam/sdks/go/pkg/beam/core/ru= ntime/exec/util.go:42 +0x6c > github.com/apache/beam/sdks/go/pkg/beam/core/runtime/exec.(*Plan).Execute= (0xc420031030, 0xea5f60, 0xc420f4c240, 0xc4210f7648, 0x4, 0xe9c680, 0xc420f= 4c210, 0xe994c0, 0xc4201e4e00, 0xdfc7c0, ...) > =09/home/tomas/dev/go/src/github.com/apache/beam/sdks/go/pkg/beam/core/ru= ntime/exec/plan.go:90 +0x202 > github.com/apache/beam/sdks/go/pkg/beam/core/runtime/harness.(*control).h= andleInstruction(0xc4201f2bd0, 0xea5f60, 0xc420f4c1b0, 0xc4201e4d80, 0xc420= 149920) > =09/home/tomas/dev/go/src/github.com/apache/beam/sdks/go/pkg/beam/core/ru= ntime/harness/harness.go:197 +0x823 > github.com/apache/beam/sdks/go/pkg/beam/core/runtime/harness.Main.func2(0= xea5f60, 0xc420149920, 0xc4201e4d80) > =09/home/tomas/dev/go/src/github.com/apache/beam/sdks/go/pkg/beam/core/ru= ntime/harness/harness.go:114 +0x167 > created by github.com/apache/beam/sdks/go/pkg/beam/core/runtime/harness.M= ain > =09/home/tomas/dev/go/src/github.com/apache/beam/sdks/go/pkg/beam/core/ru= ntime/harness/harness.go:127 +0x608 > =09at java.util.concurrent.CompletableFuture.reportGet(CompletableFuture.= java:357) > =09at java.util.concurrent.CompletableFuture.get(CompletableFuture.java:1= 895) > =09at org.apache.beam.sdk.util.MoreFutures.get(MoreFutures.java:57) > =09at com.google.cloud.dataflow.worker.fn.control.RegisterAndProcessBundl= eOperation.finish(RegisterAndProcessBundleOperation.java:274) > =09at com.google.cloud.dataflow.worker.util.common.worker.MapTaskExecutor= .execute(MapTaskExecutor.java:83) > =09at com.google.cloud.dataflow.worker.fn.control.BeamFnMapTaskExecutor.e= xecute(BeamFnMapTaskExecutor.java:101) > =09at com.google.cloud.dataflow.worker.BatchDataflowWorker.executeWork(Ba= tchDataflowWorker.java:393) > =09at com.google.cloud.dataflow.worker.BatchDataflowWorker.doWork(BatchDa= taflowWorker.java:362) > =09at com.google.cloud.dataflow.worker.BatchDataflowWorker.getAndPerformW= ork(BatchDataflowWorker.java:290) > =09at com.google.cloud.dataflow.worker.DataflowRunnerHarness.start(Datafl= owRunnerHarness.java:179) > =09at com.google.cloud.dataflow.worker.DataflowRunnerHarness.main(Dataflo= wRunnerHarness.java:107) > =09Suppressed: java.lang.IllegalStateException: Already closed. > =09=09at org.apache.beam.sdk.fn.data.BeamFnDataBufferingOutboundObserver.= close(BeamFnDataBufferingOutboundObserver.java:95) > =09=09at com.google.cloud.dataflow.worker.fn.data.RemoteGrpcPortWriteOper= ation.abort(RemoteGrpcPortWriteOperation.java:93) > =09=09at com.google.cloud.dataflow.worker.util.common.worker.MapTaskExecu= tor.execute(MapTaskExecutor.java:89) > =09=09... 6 more > Caused by: java.lang.RuntimeException: Error received from SDK harness fo= r instruction -303: execute failed: panic: incompatible func type goroutine= 47 [running]: > runtime/debug.Stack(0xc420244a38, 0xc3b160, 0xe96e80) > =09/usr/local/go/src/runtime/debug/stack.go:24 +0xa7 > github.com/apache/beam/sdks/go/pkg/beam/core/runtime/exec.callNoPanic.fun= c1(0xc420244c00) > =09/home/tomas/dev/go/src/github.com/apache/beam/sdks/go/pkg/beam/core/ru= ntime/exec/util.go:39 +0x6e > panic(0xc3b160, 0xe96e80) > =09/usr/local/go/src/runtime/panic.go:502 +0x229 > github.com/apache/beam/sdks/go/pkg/beam/core/util/reflectx.ToFunc2x1(0xea= 2420, 0xc42100f380, 0xdd37ed, 0x11) > =09/home/tomas/dev/go/src/github.com/apache/beam/sdks/go/pkg/beam/core/ut= il/reflectx/calls.go:429 +0x15d > github.com/apache/beam/sdks/go/pkg/beam/core/runtime/exec.(*MergeAccumula= tors).Up(0xc420b1a770, 0xea6120, 0xc420f4c240, 0x0, 0xc420244bc0) > =09/home/tomas/dev/go/src/github.com/apache/beam/sdks/go/pkg/beam/core/ru= ntime/exec/combine.go:368 +0xb2 > github.com/apache/beam/sdks/go/pkg/beam/core/runtime/exec.(Unit).Up-fm(0x= ea6120, 0xc420f4c240, 0xc420244c00, 0x0) > =09/home/tomas/dev/go/src/github.com/apache/beam/sdks/go/pkg/beam/core/ru= ntime/exec/plan.go:90 +0x43 > github.com/apache/beam/sdks/go/pkg/beam/core/runtime/exec.callNoPanic(0xe= a6120, 0xc420f4c240, 0xc420244ca0, 0x0, 0x0) > =09/home/tomas/dev/go/src/github.com/apache/beam/sdks/go/pkg/beam/core/ru= ntime/exec/util.go:42 +0x6c > github.com/apache/beam/sdks/go/pkg/beam/core/runtime/exec.(*Plan).Execute= (0xc420031030, 0xea5f60, 0xc420f4c240, 0xc4210f7648, 0x4, 0xe9c680, 0xc420f= 4c210, 0xe994c0, 0xc4201e4e00, 0xdfc7c0, ...) > =09/home/tomas/dev/go/src/github.com/apache/beam/sdks/go/pkg/beam/core/ru= ntime/exec/plan.go:90 +0x202 > github.com/apache/beam/sdks/go/pkg/beam/core/runtime/harness.(*control).h= andleInstruction(0xc4201f2bd0, 0xea5f60, 0xc420f4c1b0, 0xc4201e4d80, 0xc420= 149920) > =09/home/tomas/dev/go/src/github.com/apache/beam/sdks/go/pkg/beam/core/ru= ntime/harness/harness.go:197 +0x823 > github.com/apache/beam/sdks/go/pkg/beam/core/runtime/harness.Main.func2(0= xea5f60, 0xc420149920, 0xc4201e4d80) > =09/home/tomas/dev/go/src/github.com/apache/beam/sdks/go/pkg/beam/core/ru= ntime/harness/harness.go:114 +0x167 > created by github.com/apache/beam/sdks/go/pkg/beam/core/runtime/harness.M= ain > =09/home/tomas/dev/go/src/github.com/apache/beam/sdks/go/pkg/beam/core/ru= ntime/harness/harness.go:127 +0x608 > =09at org.apache.beam.runners.fnexecution.control.FnApiControlClient$Resp= onseStreamObserver.onNext(FnApiControlClient.java:157) > =09at org.apache.beam.runners.fnexecution.control.FnApiControlClient$Resp= onseStreamObserver.onNext(FnApiControlClient.java:140) > =09at org.apache.beam.vendor.grpc.v1.io.grpc.stub.ServerCalls$StreamingSe= rverCallHandler$StreamingServerCallListener.onMessage(ServerCalls.java:248) > =09at org.apache.beam.vendor.grpc.v1.io.grpc.ForwardingServerCallListener= .onMessage(ForwardingServerCallListener.java:33) > =09at org.apache.beam.vendor.grpc.v1.io.grpc.Contexts$ContextualizedServe= rCallListener.onMessage(Contexts.java:76) > =09at org.apache.beam.vendor.grpc.v1.io.grpc.internal.ServerCallImpl$Serv= erStreamListenerImpl.messagesAvailable(ServerCallImpl.java:263) > =09at org.apache.beam.vendor.grpc.v1.io.grpc.internal.ServerImpl$JumpToAp= plicationThreadServerStreamListener$1MessagesAvailable.runInContext(ServerI= mpl.java:683) > =09at org.apache.beam.vendor.grpc.v1.io.grpc.internal.ContextRunnable.run= (ContextRunnable.java:37) > =09at org.apache.beam.vendor.grpc.v1.io.grpc.internal.SerializingExecutor= .run(SerializingExecutor.java:123) > =09at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecuto= r.java:1142) > =09at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecut= or.java:617) > =09at java.lang.Thread.run(Thread.java:745) > =20 > =E2=94=9C=E2=94=80=E2=94=80 minimal_wordcount > =E2=94=82=C2=A0=C2=A0 =E2=94=94=E2=94=80=E2=94=80 minimal_wordcount.go > Runs only on direct, implemented PR https://github.com/apache/beam/pull/6= 386 > =E2=94=9C=E2=94=80=E2=94=80 multiout > =E2=94=82=C2=A0=C2=A0 =E2=94=94=E2=94=80=E2=94=80 multiout.go > Runs like a boss! > =E2=94=9C=E2=94=80=E2=94=80 pingpong > =E2=94=82=C2=A0=C2=A0 =E2=94=94=E2=94=80=E2=94=80 pingpong.go > Stating it can't run on dataflow > // NOTE(herohde) 2/23/2017: Dataflow does not allow cyclic composite stru= ctures. > =E2=94=9C=E2=94=80=E2=94=80 streaming_wordcap > =E2=94=82=C2=A0=C2=A0 =E2=94=94=E2=94=80=E2=94=80 wordcap.go > Brilliant! > =E2=94=9C=E2=94=80=E2=94=80 windowed_wordcount > =E2=94=82=C2=A0=C2=A0 =E2=94=94=E2=94=80=E2=94=80 windowed_wordcount.go > All good! > =E2=94=9C=E2=94=80=E2=94=80 wordcap > =E2=94=82=C2=A0=C2=A0 =E2=94=94=E2=94=80=E2=94=80 wordcap.go > Runs fine on direct runner but not on dataflow because of input is local = and is Using > textio.Immediate, hence not able to pass in a gs:// path=20 > =E2=94=9C=E2=94=80=E2=94=80 wordcount > =E2=94=82=C2=A0=C2=A0 =E2=94=94=E2=94=80=E2=94=80 wordcount.go > All good! > =E2=94=94=E2=94=80=E2=94=80 yatzy > =E2=94=94=E2=94=80=E2=94=80 yatzy.go > Fails on dataflow > go-job-1-1536847665315762634 > error: "execution plan for -50 not found" register: < > -- This message was sent by Atlassian JIRA (v7.6.3#76005)