beam-builds mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Apache Jenkins Server <jenk...@builds.apache.org>
Subject Build failed in Jenkins: beam_PerformanceTests_TFRecordIOIT #2082
Date Mon, 17 Jun 2019 19:25:11 GMT
See <https://builds.apache.org/job/beam_PerformanceTests_TFRecordIOIT/2082/display/redirect?page=changes>

Changes:

[github] Use code.jquery.com for jQuery CDN

[github] use https

[alireza4263] [BEAM-7513] Implements row estimation for BigQuery.

[aaltay] [BEAM-6777] Let HealthzServlet respond actual health information of SDK

------------------------------------------
[...truncated 437.35 KB...]
    Dataflow SDK version: 2.14.0-SNAPSHOT

org.apache.beam.sdk.io.tfrecord.TFRecordIOIT > writeThenReadAll STANDARD_ERROR
    Jun 17, 2019 7:20:41 PM org.apache.beam.runners.dataflow.DataflowRunner run
    INFO: To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-06-17_12_20_39-16640468506312754190?project=apache-beam-testing

org.apache.beam.sdk.io.tfrecord.TFRecordIOIT > writeThenReadAll STANDARD_OUT
    Submitted job: 2019-06-17_12_20_39-16640468506312754190

org.apache.beam.sdk.io.tfrecord.TFRecordIOIT > writeThenReadAll STANDARD_ERROR
    Jun 17, 2019 7:20:41 PM org.apache.beam.runners.dataflow.DataflowRunner run
    INFO: To cancel the job using the 'gcloud' tool, run:
    > gcloud dataflow jobs --project=apache-beam-testing cancel --region=us-central1 2019-06-17_12_20_39-16640468506312754190
    Jun 17, 2019 7:20:41 PM org.apache.beam.runners.dataflow.TestDataflowRunner run
    INFO: Running Dataflow job 2019-06-17_12_20_39-16640468506312754190 with 1 expected assertions.
    Jun 17, 2019 7:20:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
    INFO: 2019-06-17T19:20:39.947Z: Autoscaling is enabled for job 2019-06-17_12_20_39-16640468506312754190.
The number of workers will be between 1 and 1000.
    Jun 17, 2019 7:20:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
    INFO: 2019-06-17T19:20:39.989Z: Autoscaling was automatically enabled for job 2019-06-17_12_20_39-16640468506312754190.
    Jun 17, 2019 7:20:44 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
    INFO: 2019-06-17T19:20:43.211Z: Checking permissions granted to controller Service Account.
    Jun 17, 2019 7:20:50 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
    INFO: 2019-06-17T19:20:50.060Z: Worker configuration: n1-standard-1 in us-central1-f.
    Jun 17, 2019 7:20:51 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
    INFO: 2019-06-17T19:20:50.674Z: Expanding CoGroupByKey operations into optimizable parts.
    Jun 17, 2019 7:20:51 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
    INFO: 2019-06-17T19:20:50.864Z: Expanding GroupByKey operations into optimizable parts.
    Jun 17, 2019 7:20:51 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
    INFO: 2019-06-17T19:20:50.909Z: Lifting ValueCombiningMappingFns into MergeBucketsMappingFns
    Jun 17, 2019 7:20:51 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
    INFO: 2019-06-17T19:20:51.257Z: Fusing adjacent ParDo, Read, Write, and Flatten operations
    Jun 17, 2019 7:20:51 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
    INFO: 2019-06-17T19:20:51.291Z: Elided trivial flatten 
    Jun 17, 2019 7:20:51 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
    INFO: 2019-06-17T19:20:51.330Z: Elided trivial flatten 
    Jun 17, 2019 7:20:51 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
    INFO: 2019-06-17T19:20:51.380Z: Elided trivial flatten 
    Jun 17, 2019 7:20:51 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
    INFO: 2019-06-17T19:20:51.428Z: Fusing consumer PAssert$0/GroupGlobally/Window.Into()/Window.Assign
into Reshuffle.ViaRandomKey/Values/Values/Map
    Jun 17, 2019 7:20:51 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
    INFO: 2019-06-17T19:20:51.469Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map
into Reshuffle.ViaRandomKey/Values/Values/Map
    Jun 17, 2019 7:20:51 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
    INFO: 2019-06-17T19:20:51.519Z: Fusing consumer PAssert$0/GroupGlobally/GroupDummyAndContents/Write
into PAssert$0/GroupGlobally/GroupDummyAndContents/Reify
    Jun 17, 2019 7:20:51 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
    INFO: 2019-06-17T19:20:51.566Z: Fusing consumer PAssert$0/GroupGlobally/ParDo(Concat)
into PAssert$0/GroupGlobally/Values/Values/Map
    Jun 17, 2019 7:20:51 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
    INFO: 2019-06-17T19:20:51.605Z: Fusing consumer PAssert$0/GetPane/Map into PAssert$0/GroupGlobally/ParDo(Concat)
    Jun 17, 2019 7:20:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
    INFO: 2019-06-17T19:20:51.653Z: Fusing consumer PAssert$0/RunChecks into PAssert$0/GetPane/Map
    Jun 17, 2019 7:20:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
    INFO: 2019-06-17T19:20:51.695Z: Fusing consumer PAssert$0/VerifyAssertions/ParDo(DefaultConclude)
into PAssert$0/RunChecks
    Jun 17, 2019 7:20:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
    INFO: 2019-06-17T19:20:51.733Z: Fusing consumer PAssert$0/GroupGlobally/GroupDummyAndContents/GroupByWindow
into PAssert$0/GroupGlobally/GroupDummyAndContents/Read
    Jun 17, 2019 7:20:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
    INFO: 2019-06-17T19:20:51.778Z: Fusing consumer PAssert$0/GroupGlobally/Values/Values/Map
into PAssert$0/GroupGlobally/GroupDummyAndContents/GroupByWindow
    Jun 17, 2019 7:20:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
    INFO: 2019-06-17T19:20:51.821Z: Unzipping flatten s30 for input s25.org.apache.beam.sdk.values.PCollection.<init>:402#710158705210b615
    Jun 17, 2019 7:20:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
    INFO: 2019-06-17T19:20:51.846Z: Fusing unzipped copy of PAssert$0/GroupGlobally/GroupDummyAndContents/Reify,
through flatten PAssert$0/GroupGlobally/FlattenDummyAndContents, into producer PAssert$0/GroupGlobally/KeyForDummy/AddKeys/Map
    Jun 17, 2019 7:20:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
    INFO: 2019-06-17T19:20:51.894Z: Fusing consumer Reshuffle.ViaRandomKey/Reshuffle/Window.Into()/Window.Assign
into Reshuffle.ViaRandomKey/Pair with random key
    Jun 17, 2019 7:20:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
    INFO: 2019-06-17T19:20:51.932Z: Fusing consumer PAssert$0/GroupGlobally/GatherAllOutputs/GroupByKey/Write
into PAssert$0/GroupGlobally/GatherAllOutputs/GroupByKey/Reify
    Jun 17, 2019 7:20:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
    INFO: 2019-06-17T19:20:51.976Z: Fusing consumer PAssert$0/GroupGlobally/GatherAllOutputs/Values/Values/Map
into PAssert$0/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow
    Jun 17, 2019 7:20:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
    INFO: 2019-06-17T19:20:52.023Z: Fusing consumer PAssert$0/GroupGlobally/RewindowActuals/Window.Assign
into PAssert$0/GroupGlobally/GatherAllOutputs/Values/Values/Map
    Jun 17, 2019 7:20:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
    INFO: 2019-06-17T19:20:52.070Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write
into View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)
    Jun 17, 2019 7:20:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
    INFO: 2019-06-17T19:20:52.104Z: Fusing consumer PAssert$0/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow
into PAssert$0/GroupGlobally/GatherAllOutputs/GroupByKey/Read
    Jun 17, 2019 7:20:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
    INFO: 2019-06-17T19:20:52.148Z: Fusing consumer PAssert$0/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)
into PAssert$0/GroupGlobally/Window.Into()/Window.Assign
    Jun 17, 2019 7:20:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
    INFO: 2019-06-17T19:20:52.196Z: Fusing consumer PAssert$0/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign
into PAssert$0/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map
    Jun 17, 2019 7:20:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
    INFO: 2019-06-17T19:20:52.236Z: Fusing consumer PAssert$0/GroupGlobally/GatherAllOutputs/GroupByKey/Reify
into PAssert$0/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign
    Jun 17, 2019 7:20:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
    INFO: 2019-06-17T19:20:52.286Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow)
into View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read
    Jun 17, 2019 7:20:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
    INFO: 2019-06-17T19:20:52.332Z: Fusing consumer Reshuffle.ViaRandomKey/Values/Values/Map
into Reshuffle.ViaRandomKey/Reshuffle/ExpandIterable
    Jun 17, 2019 7:20:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
    INFO: 2019-06-17T19:20:52.379Z: Fusing consumer PAssert$0/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map
into PAssert$0/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)
    Jun 17, 2019 7:20:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
    INFO: 2019-06-17T19:20:52.427Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)
into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map
    Jun 17, 2019 7:20:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
    INFO: 2019-06-17T19:20:52.509Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract
into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues
    Jun 17, 2019 7:20:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
    INFO: 2019-06-17T19:20:52.562Z: Fusing consumer Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/GroupByWindow
into Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Read
    Jun 17, 2019 7:20:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
    INFO: 2019-06-17T19:20:52.611Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial
into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map
    Jun 17, 2019 7:20:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
    INFO: 2019-06-17T19:20:52.655Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify
into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial
    Jun 17, 2019 7:20:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
    INFO: 2019-06-17T19:20:52.699Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues
into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read
    Jun 17, 2019 7:20:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
    INFO: 2019-06-17T19:20:52.754Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write
into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify
    Jun 17, 2019 7:20:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
    INFO: 2019-06-17T19:20:52.799Z: Fusing consumer Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Reify
into Reshuffle.ViaRandomKey/Reshuffle/Window.Into()/Window.Assign
    Jun 17, 2019 7:20:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
    INFO: 2019-06-17T19:20:52.847Z: Unzipping flatten s12 for input s11.org.apache.beam.sdk.values.PCollection.<init>:402#dabfabce15317cd8
    Jun 17, 2019 7:20:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
    INFO: 2019-06-17T19:20:52.910Z: Fusing unzipped copy of Reshuffle.ViaRandomKey/Pair with
random key, through flatten Calculate hashcode/Flatten.PCollections, into producer Calculate
hashcode/ProduceDefault
    Jun 17, 2019 7:20:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
    INFO: 2019-06-17T19:20:52.966Z: Fusing consumer Reshuffle.ViaRandomKey/Reshuffle/ExpandIterable
into Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/GroupByWindow
    Jun 17, 2019 7:20:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
    INFO: 2019-06-17T19:20:53.016Z: Unzipping flatten s12-u80 for input s15-reify-value18-c78
    Jun 17, 2019 7:20:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
    INFO: 2019-06-17T19:20:53.057Z: Fusing unzipped copy of Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Write,
through flatten Calculate hashcode/Flatten.PCollections/Unzipped-1, into producer Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Reify
    Jun 17, 2019 7:20:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
    INFO: 2019-06-17T19:20:53.106Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map
into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract
    Jun 17, 2019 7:20:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
    INFO: 2019-06-17T19:20:53.144Z: Fusing consumer PAssert$0/GroupGlobally/KeyForDummy/AddKeys/Map
into PAssert$0/GroupGlobally/RewindowActuals/Window.Assign
    Jun 17, 2019 7:20:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
    INFO: 2019-06-17T19:20:53.192Z: Fusing consumer Reshuffle.ViaRandomKey/Pair with random
key into Calculate hashcode/Values/Values/Map
    Jun 17, 2019 7:20:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
    INFO: 2019-06-17T19:20:53.239Z: Fusing consumer Calculate hashcode/View.AsIterable/ParDo(ToIsmRecordForGlobalWindow)
into Calculate hashcode/Values/Values/Map
    Jun 17, 2019 7:20:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
    INFO: 2019-06-17T19:20:53.290Z: Fusing consumer Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Write
into Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Reify
    Jun 17, 2019 7:20:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
    INFO: 2019-06-17T19:20:53.337Z: Fusing consumer Calculate hashcode/ProduceDefault into
Calculate hashcode/CreateVoid/Read(CreateSource)
    Jun 17, 2019 7:20:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
    INFO: 2019-06-17T19:20:53.385Z: Fusing consumer Calculate hashcode/Combine.perKey(Hashing)/GroupByKey+Calculate
hashcode/Combine.perKey(Hashing)/Combine.GroupedValues/Partial into Calculate hashcode/WithKeys/AddKeys/Map
    Jun 17, 2019 7:20:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
    INFO: 2019-06-17T19:20:53.439Z: Fusing consumer Calculate hashcode/Combine.perKey(Hashing)/Combine.GroupedValues/Extract
into Calculate hashcode/Combine.perKey(Hashing)/Combine.GroupedValues
    Jun 17, 2019 7:20:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
    INFO: 2019-06-17T19:20:53.480Z: Fusing consumer Transform bytes to strings/Map into Record
time after reading
    Jun 17, 2019 7:20:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
    INFO: 2019-06-17T19:20:53.521Z: Fusing consumer Calculate hashcode/Combine.perKey(Hashing)/GroupByKey/Reify
into Calculate hashcode/Combine.perKey(Hashing)/GroupByKey+Calculate hashcode/Combine.perKey(Hashing)/Combine.GroupedValues/Partial
    Jun 17, 2019 7:20:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
    INFO: 2019-06-17T19:20:53.567Z: Fusing consumer Calculate hashcode/Combine.perKey(Hashing)/Combine.GroupedValues
into Calculate hashcode/Combine.perKey(Hashing)/GroupByKey/Read
    Jun 17, 2019 7:20:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
    INFO: 2019-06-17T19:20:53.618Z: Fusing consumer Calculate hashcode/Combine.perKey(Hashing)/GroupByKey/Write
into Calculate hashcode/Combine.perKey(Hashing)/GroupByKey/Reify
    Jun 17, 2019 7:20:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
    INFO: 2019-06-17T19:20:53.656Z: Fusing consumer Record time after reading into TFRecordIO.Read/Read
    Jun 17, 2019 7:20:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
    INFO: 2019-06-17T19:20:53.690Z: Fusing consumer Calculate hashcode/Values/Values/Map into
Calculate hashcode/Combine.perKey(Hashing)/Combine.GroupedValues/Extract
    Jun 17, 2019 7:20:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
    INFO: 2019-06-17T19:20:53.731Z: Fusing consumer Calculate hashcode/WithKeys/AddKeys/Map
into Transform bytes to strings/Map
    Jun 17, 2019 7:20:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
    INFO: 2019-06-17T19:20:53.779Z: Fusing consumer Delete test files into Create.Values/Read(CreateSource)
    Jun 17, 2019 7:20:56 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
    INFO: 2019-06-17T19:20:53.821Z: Fusing consumer PAssert$0/GroupGlobally/GroupDummyAndContents/Reify
into PAssert$0/GroupGlobally/WindowIntoDummy/Window.Assign
    Jun 17, 2019 7:20:56 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
    INFO: 2019-06-17T19:20:53.861Z: Fusing consumer PAssert$0/GroupGlobally/WindowIntoDummy/Window.Assign
into PAssert$0/GroupGlobally/Create.Values/Read(CreateSource)
    Jun 17, 2019 7:20:56 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
    INFO: 2019-06-17T19:20:54.370Z: Executing operation Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Create
    Jun 17, 2019 7:20:56 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
    INFO: 2019-06-17T19:20:54.421Z: Executing operation PAssert$0/GroupGlobally/GatherAllOutputs/GroupByKey/Create
    Jun 17, 2019 7:20:56 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
    INFO: 2019-06-17T19:20:54.460Z: Starting 1 workers in us-central1-f...
    Jun 17, 2019 7:20:56 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
    INFO: 2019-06-17T19:20:54.470Z: Executing operation PAssert$0/GroupGlobally/GroupDummyAndContents/Create
    Jun 17, 2019 7:20:56 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
    INFO: 2019-06-17T19:20:54.517Z: Finished operation Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Create
    Jun 17, 2019 7:20:56 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
    INFO: 2019-06-17T19:20:54.520Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Create
    Jun 17, 2019 7:20:56 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
    INFO: 2019-06-17T19:20:54.540Z: Finished operation PAssert$0/GroupGlobally/GroupDummyAndContents/Create
    Jun 17, 2019 7:20:56 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
    INFO: 2019-06-17T19:20:54.541Z: Finished operation PAssert$0/GroupGlobally/GatherAllOutputs/GroupByKey/Create
    Jun 17, 2019 7:20:56 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
    INFO: 2019-06-17T19:20:54.574Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Create
    Jun 17, 2019 7:20:56 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
    INFO: 2019-06-17T19:20:54.594Z: Finished operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Create
    Jun 17, 2019 7:20:56 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
    INFO: 2019-06-17T19:20:54.694Z: Executing operation Calculate hashcode/Combine.perKey(Hashing)/GroupByKey/Create
    Jun 17, 2019 7:20:56 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
    INFO: 2019-06-17T19:20:54.712Z: Finished operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Create
    Jun 17, 2019 7:20:56 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
    INFO: 2019-06-17T19:20:54.782Z: Finished operation Calculate hashcode/Combine.perKey(Hashing)/GroupByKey/Create
    Jun 17, 2019 7:20:56 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
    INFO: 2019-06-17T19:20:55.104Z: Executing operation PAssert$0/GroupGlobally/Create.Values/Read(CreateSource)+PAssert$0/GroupGlobally/WindowIntoDummy/Window.Assign+PAssert$0/GroupGlobally/GroupDummyAndContents/Reify+PAssert$0/GroupGlobally/GroupDummyAndContents/Write
    Jun 17, 2019 7:20:56 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
    INFO: 2019-06-17T19:20:55.154Z: Executing operation TFRecordIO.Read/Read+Record time after
reading+Transform bytes to strings/Map+Calculate hashcode/WithKeys/AddKeys/Map+Calculate hashcode/Combine.perKey(Hashing)/GroupByKey+Calculate
hashcode/Combine.perKey(Hashing)/Combine.GroupedValues/Partial+Calculate hashcode/Combine.perKey(Hashing)/GroupByKey/Reify+Calculate
hashcode/Combine.perKey(Hashing)/GroupByKey/Write
    Jun 17, 2019 7:24:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
    INFO: 2019-06-17T19:24:20.435Z: Workers have started successfully.
    Jun 17, 2019 7:24:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
    INFO: 2019-06-17T19:24:20.904Z: Autoscaling: Raised the number of workers to 1 based on
the rate of progress in the currently running step(s).
    Jun 17, 2019 7:24:50 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
    INFO: 2019-06-17T19:24:50.272Z: Finished operation TFRecordIO.Read/Read+Record time after
reading+Transform bytes to strings/Map+Calculate hashcode/WithKeys/AddKeys/Map+Calculate hashcode/Combine.perKey(Hashing)/GroupByKey+Calculate
hashcode/Combine.perKey(Hashing)/Combine.GroupedValues/Partial+Calculate hashcode/Combine.perKey(Hashing)/GroupByKey/Reify+Calculate
hashcode/Combine.perKey(Hashing)/GroupByKey/Write
    Jun 17, 2019 7:24:50 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
    INFO: 2019-06-17T19:24:50.377Z: Executing operation Calculate hashcode/Combine.perKey(Hashing)/GroupByKey/Close
    Jun 17, 2019 7:24:52 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
    INFO: 2019-06-17T19:24:50.431Z: Finished operation Calculate hashcode/Combine.perKey(Hashing)/GroupByKey/Close
    Jun 17, 2019 7:24:52 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
    INFO: 2019-06-17T19:24:50.535Z: Executing operation Calculate hashcode/Combine.perKey(Hashing)/GroupByKey/Read+Calculate
hashcode/Combine.perKey(Hashing)/Combine.GroupedValues+Calculate hashcode/Combine.perKey(Hashing)/Combine.GroupedValues/Extract+Calculate
hashcode/Values/Values/Map+Reshuffle.ViaRandomKey/Pair with random key+Reshuffle.ViaRandomKey/Reshuffle/Window.Into()/Window.Assign+Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Reify+Calculate
hashcode/View.AsIterable/ParDo(ToIsmRecordForGlobalWindow)+Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Write
    Jun 17, 2019 7:24:52 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
    INFO: 2019-06-17T19:24:51.572Z: Workers have started successfully.
    Jun 17, 2019 7:24:55 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
    INFO: 2019-06-17T19:24:52.541Z: Finished operation PAssert$0/GroupGlobally/Create.Values/Read(CreateSource)+PAssert$0/GroupGlobally/WindowIntoDummy/Window.Assign+PAssert$0/GroupGlobally/GroupDummyAndContents/Reify+PAssert$0/GroupGlobally/GroupDummyAndContents/Write
    Jun 17, 2019 7:25:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
    INFO: 2019-06-17T19:25:00.509Z: Finished operation Calculate hashcode/Combine.perKey(Hashing)/GroupByKey/Read+Calculate
hashcode/Combine.perKey(Hashing)/Combine.GroupedValues+Calculate hashcode/Combine.perKey(Hashing)/Combine.GroupedValues/Extract+Calculate
hashcode/Values/Values/Map+Reshuffle.ViaRandomKey/Pair with random key+Reshuffle.ViaRandomKey/Reshuffle/Window.Into()/Window.Assign+Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Reify+Calculate
hashcode/View.AsIterable/ParDo(ToIsmRecordForGlobalWindow)+Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Write
    Jun 17, 2019 7:25:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
    INFO: 2019-06-17T19:25:00.711Z: Executing operation Calculate hashcode/View.AsIterable/CreateDataflowView
    Jun 17, 2019 7:25:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
    INFO: 2019-06-17T19:25:00.783Z: Finished operation Calculate hashcode/View.AsIterable/CreateDataflowView
    Jun 17, 2019 7:25:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
    INFO: 2019-06-17T19:25:00.976Z: Executing operation Calculate hashcode/CreateVoid/Read(CreateSource)+Calculate
hashcode/ProduceDefault+Reshuffle.ViaRandomKey/Pair with random key+Reshuffle.ViaRandomKey/Reshuffle/Window.Into()/Window.Assign+Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Reify+Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Write
    Jun 17, 2019 7:25:04 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
    INFO: 2019-06-17T19:25:02.596Z: Finished operation Calculate hashcode/CreateVoid/Read(CreateSource)+Calculate
hashcode/ProduceDefault+Reshuffle.ViaRandomKey/Pair with random key+Reshuffle.ViaRandomKey/Reshuffle/Window.Into()/Window.Assign+Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Reify+Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Write
    Jun 17, 2019 7:25:04 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
    INFO: 2019-06-17T19:25:02.707Z: Executing operation Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Close
    Jun 17, 2019 7:25:04 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
    INFO: 2019-06-17T19:25:02.744Z: Finished operation Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Close
    Jun 17, 2019 7:25:04 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
    INFO: 2019-06-17T19:25:02.836Z: Executing operation Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Read+Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/GroupByWindow+Reshuffle.ViaRandomKey/Reshuffle/ExpandIterable+Reshuffle.ViaRandomKey/Values/Values/Map+PAssert$0/GroupGlobally/Window.Into()/Window.Assign+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map+PAssert$0/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)+PAssert$0/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map+PAssert$0/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign+PAssert$0/GroupGlobally/GatherAllOutputs/GroupByKey/Reify+PAssert$0/GroupGlobally/GatherAllOutputs/GroupByKey/Write+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write

STDERR: Note: Some input files use or override a deprecated API.
Note: Recompile with -Xlint:deprecation for details.
Note: Some input files use unchecked or unsafe operations.
Note: Recompile with -Xlint:unchecked for details.

2019-06-17 19:25:07,443 6950ae0a MainThread beam_integration_benchmark(1/1) ERROR    Error
during benchmark beam_integration_benchmark
Traceback (most recent call last):
  File "<https://builds.apache.org/job/beam_PerformanceTests_TFRecordIOIT/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",>
line 760, in RunBenchmark
    DoRunPhase(spec, collector, detailed_timer)
  File "<https://builds.apache.org/job/beam_PerformanceTests_TFRecordIOIT/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",>
line 609, in DoRunPhase
    samples = spec.BenchmarkRun(spec)
  File "<https://builds.apache.org/job/beam_PerformanceTests_TFRecordIOIT/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/beam_integration_benchmark.py",>
line 160, in Run
    job_type=job_type)
  File "<https://builds.apache.org/job/beam_PerformanceTests_TFRecordIOIT/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",>
line 90, in SubmitJob
    assert retcode == 0, "Integration Test Failed."
AssertionError: Integration Test Failed.
2019-06-17 19:25:07,446 6950ae0a MainThread beam_integration_benchmark(1/1) INFO     Cleaning
up benchmark beam_integration_benchmark
2019-06-17 19:25:07,451 6950ae0a MainThread beam_integration_benchmark(1/1) ERROR    Exception
running benchmark
Traceback (most recent call last):
  File "<https://builds.apache.org/job/beam_PerformanceTests_TFRecordIOIT/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",>
line 903, in RunBenchmarkTask
    RunBenchmark(spec, collector)
  File "<https://builds.apache.org/job/beam_PerformanceTests_TFRecordIOIT/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",>
line 760, in RunBenchmark
    DoRunPhase(spec, collector, detailed_timer)
  File "<https://builds.apache.org/job/beam_PerformanceTests_TFRecordIOIT/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",>
line 609, in DoRunPhase
    samples = spec.BenchmarkRun(spec)
  File "<https://builds.apache.org/job/beam_PerformanceTests_TFRecordIOIT/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/beam_integration_benchmark.py",>
line 160, in Run
    job_type=job_type)
  File "<https://builds.apache.org/job/beam_PerformanceTests_TFRecordIOIT/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",>
line 90, in SubmitJob
    assert retcode == 0, "Integration Test Failed."
AssertionError: Integration Test Failed.
2019-06-17 19:25:07,451 6950ae0a MainThread beam_integration_benchmark(1/1) ERROR    Benchmark
1/1 beam_integration_benchmark (UID: beam_integration_benchmark0) failed. Execution will continue.
2019-06-17 19:25:07,452 6950ae0a MainThread beam_integration_benchmark(1/1) INFO     Benchmark
run statuses:
---------------------------------------------------------------------------------
Name                        UID                          Status  Failed Substatus
---------------------------------------------------------------------------------
beam_integration_benchmark  beam_integration_benchmark0  FAILED                  
---------------------------------------------------------------------------------
Success rate: 0.00% (0/1)
2019-06-17 19:25:07,453 6950ae0a MainThread beam_integration_benchmark(1/1) INFO     Complete
logs can be found at: <https://builds.apache.org/job/beam_PerformanceTests_TFRecordIOIT/ws/runs/6950ae0a/pkb.log>
2019-06-17 19:25:07,453 6950ae0a MainThread beam_integration_benchmark(1/1) INFO     Completion
statuses can be found at: <https://builds.apache.org/job/beam_PerformanceTests_TFRecordIOIT/ws/runs/6950ae0a/completion_statuses.json>
Build step 'Execute shell' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Mime
View raw message