beam-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Apache Jenkins Server <jenk...@builds.apache.org>
Subject Build failed in Jenkins: beam_PostCommit_Java_GradleBuild #21
Date Tue, 10 Apr 2018 13:13:03 GMT
See <https://builds.apache.org/job/beam_PostCommit_Java_GradleBuild/21/display/redirect?page=changes>

Changes:

[iemejia] [BEAM-3848] Add retry configuration to SolrIO write

------------------------------------------
[...truncated 17.95 MB...]
    INFO: Adding SpannerIO.Write/Write mutations to Cloud Spanner/Keys sample as view/ParMultiDo(ToIsmRecordForMapLike)
as step s20
    Apr 10, 2018 1:08:29 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator
addStep
    INFO: Adding SpannerIO.Write/Write mutations to Cloud Spanner/Keys sample as view/GBKaSVForSize
as step s21
    Apr 10, 2018 1:08:29 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator
addStep
    INFO: Adding SpannerIO.Write/Write mutations to Cloud Spanner/Keys sample as view/ParDo(ToIsmMetadataRecordForSize)
as step s22
    Apr 10, 2018 1:08:29 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator
addStep
    INFO: Adding SpannerIO.Write/Write mutations to Cloud Spanner/Keys sample as view/GBKaSVForKeys
as step s23
    Apr 10, 2018 1:08:29 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator
addStep
    INFO: Adding SpannerIO.Write/Write mutations to Cloud Spanner/Keys sample as view/ParDo(ToIsmMetadataRecordForKey)
as step s24
    Apr 10, 2018 1:08:29 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator
addStep
    INFO: Adding SpannerIO.Write/Write mutations to Cloud Spanner/Keys sample as view/Flatten.PCollections
as step s25
    Apr 10, 2018 1:08:29 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator
addStep
    INFO: Adding SpannerIO.Write/Write mutations to Cloud Spanner/Keys sample as view/CreateDataflowView
as step s26
    Apr 10, 2018 1:08:29 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator
addStep
    INFO: Adding SpannerIO.Write/Write mutations to Cloud Spanner/Partition input as step
s27
    Apr 10, 2018 1:08:29 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator
addStep
    INFO: Adding SpannerIO.Write/Write mutations to Cloud Spanner/Group by partition as step
s28
    Apr 10, 2018 1:08:29 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator
addStep
    INFO: Adding SpannerIO.Write/Write mutations to Cloud Spanner/Batch mutations together
as step s29
    Apr 10, 2018 1:08:29 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator
addStep
    INFO: Adding SpannerIO.Write/Write mutations to Cloud Spanner/Write mutations to Spanner
as step s30
    Apr 10, 2018 1:08:29 PM org.apache.beam.runners.dataflow.DataflowRunner run
    INFO: Staging pipeline description to gs://temp-storage-for-end-to-end-tests/spannerwriteit0testwrite-jenkins-0410130825-3fe5abe6/output/results/staging/
    Apr 10, 2018 1:08:29 PM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
    INFO: Uploading <80749 bytes, hash QrcE1fXryvpl6bcWotFF9g> to gs://temp-storage-for-end-to-end-tests/spannerwriteit0testwrite-jenkins-0410130825-3fe5abe6/output/results/staging/pipeline-QrcE1fXryvpl6bcWotFF9g.pb

org.apache.beam.sdk.io.gcp.spanner.SpannerWriteIT > testWrite STANDARD_OUT
    Dataflow SDK version: 2.5.0-SNAPSHOT

org.apache.beam.sdk.io.gcp.spanner.SpannerWriteIT > testWrite STANDARD_ERROR
    Apr 10, 2018 1:08:30 PM org.apache.beam.runners.dataflow.DataflowRunner run
    INFO: To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-04-10_06_08_29-16415010153995140415?project=apache-beam-testing

org.apache.beam.sdk.io.gcp.spanner.SpannerWriteIT > testWrite STANDARD_OUT
    Submitted job: 2018-04-10_06_08_29-16415010153995140415

org.apache.beam.sdk.io.gcp.spanner.SpannerWriteIT > testWrite STANDARD_ERROR
    Apr 10, 2018 1:08:30 PM org.apache.beam.runners.dataflow.DataflowRunner run
    INFO: To cancel the job using the 'gcloud' tool, run:
    > gcloud dataflow jobs --project=apache-beam-testing cancel --region=us-central1 2018-04-10_06_08_29-16415010153995140415
    Apr 10, 2018 1:08:30 PM org.apache.beam.runners.dataflow.TestDataflowRunner run
    INFO: Running Dataflow job 2018-04-10_06_08_29-16415010153995140415 with 0 expected assertions.
    Apr 10, 2018 1:08:43 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
    INFO: 2018-04-10T13:08:29.859Z: Autoscaling is enabled for job 2018-04-10_06_08_29-16415010153995140415.
The number of workers will be between 1 and 1000.
    Apr 10, 2018 1:08:43 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
    INFO: 2018-04-10T13:08:29.886Z: Autoscaling was automatically enabled for job 2018-04-10_06_08_29-16415010153995140415.
    Apr 10, 2018 1:08:43 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
    INFO: 2018-04-10T13:08:32.539Z: Checking required Cloud APIs are enabled.
    Apr 10, 2018 1:08:43 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
    INFO: 2018-04-10T13:08:32.643Z: Checking permissions granted to controller Service Account.
    Apr 10, 2018 1:08:43 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
    INFO: 2018-04-10T13:08:36.583Z: Expanding CoGroupByKey operations into optimizable parts.
    Apr 10, 2018 1:08:43 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
    INFO: 2018-04-10T13:08:36.776Z: Expanding GroupByKey operations into optimizable parts.
    Apr 10, 2018 1:08:43 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
    INFO: 2018-04-10T13:08:36.799Z: Lifting ValueCombiningMappingFns into MergeBucketsMappingFns
    Apr 10, 2018 1:08:43 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
    INFO: 2018-04-10T13:08:36.978Z: Fusing adjacent ParDo, Read, Write, and Flatten operations
    Apr 10, 2018 1:08:43 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
    INFO: 2018-04-10T13:08:37.149Z: Fusing consumer SpannerIO.Write/Write mutations to Cloud
Spanner/Read information schema into SpannerIO.Write/Write mutations to Cloud Spanner/Create.Values/Read(CreateSource)
    Apr 10, 2018 1:08:43 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
    INFO: 2018-04-10T13:08:37.175Z: Fusing consumer SpannerIO.Write/Write mutations to Cloud
Spanner/Schema View/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+SpannerIO.Write/Write
mutations to Cloud Spanner/Schema View/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial
into SpannerIO.Write/Write mutations to Cloud Spanner/Schema View/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map
    Apr 10, 2018 1:08:43 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
    INFO: 2018-04-10T13:08:37.208Z: Fusing consumer SpannerIO.Write/Write mutations to Cloud
Spanner/Schema View/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract
into SpannerIO.Write/Write mutations to Cloud Spanner/Schema View/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues
    Apr 10, 2018 1:08:43 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
    INFO: 2018-04-10T13:08:37.242Z: Fusing consumer SpannerIO.Write/Write mutations to Cloud
Spanner/Schema View/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues
into SpannerIO.Write/Write mutations to Cloud Spanner/Schema View/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read
    Apr 10, 2018 1:08:43 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
    INFO: 2018-04-10T13:08:37.277Z: Fusing consumer SpannerIO.Write/Write mutations to Cloud
Spanner/Schema View/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map
into SpannerIO.Write/Write mutations to Cloud Spanner/Read information schema
    Apr 10, 2018 1:08:43 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
    INFO: 2018-04-10T13:08:37.312Z: Fusing consumer SpannerIO.Write/Write mutations to Cloud
Spanner/Schema View/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write
into SpannerIO.Write/Write mutations to Cloud Spanner/Schema View/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify
    Apr 10, 2018 1:08:43 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
    INFO: 2018-04-10T13:08:37.339Z: Fusing consumer SpannerIO.Write/Write mutations to Cloud
Spanner/Schema View/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow)
into SpannerIO.Write/Write mutations to Cloud Spanner/Schema View/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read
    Apr 10, 2018 1:08:43 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
    INFO: 2018-04-10T13:08:37.374Z: Fusing consumer SpannerIO.Write/Write mutations to Cloud
Spanner/Schema View/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write
into SpannerIO.Write/Write mutations to Cloud Spanner/Schema View/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)
    Apr 10, 2018 1:08:43 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
    INFO: 2018-04-10T13:08:37.406Z: Fusing consumer SpannerIO.Write/Write mutations to Cloud
Spanner/Schema View/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify
into SpannerIO.Write/Write mutations to Cloud Spanner/Schema View/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+SpannerIO.Write/Write
mutations to Cloud Spanner/Schema View/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial
    Apr 10, 2018 1:08:43 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
    INFO: 2018-04-10T13:08:37.428Z: Fusing consumer SpannerIO.Write/Write mutations to Cloud
Spanner/Schema View/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)
into SpannerIO.Write/Write mutations to Cloud Spanner/Schema View/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map
    Apr 10, 2018 1:08:43 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
    INFO: 2018-04-10T13:08:37.456Z: Fusing consumer SpannerIO.Write/Write mutations to Cloud
Spanner/Schema View/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map
into SpannerIO.Write/Write mutations to Cloud Spanner/Schema View/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract
    Apr 10, 2018 1:08:43 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
    INFO: 2018-04-10T13:08:37.486Z: Fusing consumer SpannerIO.Write/Write mutations to Cloud
Spanner/Extract keys into SpannerIO.Write/Write mutations to Cloud Spanner/Serialize mutations
    Apr 10, 2018 1:08:43 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
    INFO: 2018-04-10T13:08:37.517Z: Fusing consumer SpannerIO.Write/Write mutations to Cloud
Spanner/Serialize mutations into SpannerIO.Write/To mutation group
    Apr 10, 2018 1:08:43 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
    INFO: 2018-04-10T13:08:37.545Z: Fusing consumer SpannerIO.Write/Write mutations to Cloud
Spanner/Keys sample as view/ParDo(ToIsmMetadataRecordForKey) into SpannerIO.Write/Write mutations
to Cloud Spanner/Keys sample as view/GBKaSVForKeys/Read
    Apr 10, 2018 1:08:43 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
    INFO: 2018-04-10T13:08:37.576Z: Fusing consumer SpannerIO.Write/Write mutations to Cloud
Spanner/Write mutations to Spanner into SpannerIO.Write/Write mutations to Cloud Spanner/Batch
mutations together
    Apr 10, 2018 1:08:43 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
    INFO: 2018-04-10T13:08:37.608Z: Fusing consumer SpannerIO.Write/Write mutations to Cloud
Spanner/Keys sample as view/ParMultiDo(ToIsmRecordForMapLike) into SpannerIO.Write/Write mutations
to Cloud Spanner/Keys sample as view/GBKaSVForData/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read
    Apr 10, 2018 1:08:43 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
    INFO: 2018-04-10T13:08:37.631Z: Fusing consumer SpannerIO.Write/Write mutations to Cloud
Spanner/Keys sample as view/GBKaSVForSize/Write into SpannerIO.Write/Write mutations to Cloud
Spanner/Keys sample as view/ParMultiDo(ToIsmRecordForMapLike)
    Apr 10, 2018 1:08:43 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
    INFO: 2018-04-10T13:08:37.650Z: Fusing consumer SpannerIO.Write/Write mutations to Cloud
Spanner/Keys sample as view/GBKaSVForData/ParDo(GroupByKeyHashAndSortByKeyAndWindow) into
SpannerIO.Write/Write mutations to Cloud Spanner/Sample keys/Combine.GroupedValues/Extract
    Apr 10, 2018 1:08:43 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
    INFO: 2018-04-10T13:08:37.673Z: Fusing consumer SpannerIO.Write/Write mutations to Cloud
Spanner/Group by partition/Reify into SpannerIO.Write/Write mutations to Cloud Spanner/Partition
input
    Apr 10, 2018 1:08:43 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
    INFO: 2018-04-10T13:08:37.705Z: Fusing consumer SpannerIO.Write/Write mutations to Cloud
Spanner/Sample keys/Combine.GroupedValues into SpannerIO.Write/Write mutations to Cloud Spanner/Sample
keys/GroupByKey/Read
    Apr 10, 2018 1:08:43 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
    INFO: 2018-04-10T13:08:37.737Z: Fusing consumer SpannerIO.Write/To mutation group into
ParDo(GenerateMutations)
    Apr 10, 2018 1:08:43 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
    INFO: 2018-04-10T13:08:37.771Z: Fusing consumer SpannerIO.Write/Write mutations to Cloud
Spanner/Keys sample as view/ParDo(ToIsmMetadataRecordForSize) into SpannerIO.Write/Write mutations
to Cloud Spanner/Keys sample as view/GBKaSVForSize/Read
    Apr 10, 2018 1:08:43 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
    INFO: 2018-04-10T13:08:37.793Z: Fusing consumer SpannerIO.Write/Write mutations to Cloud
Spanner/Group by partition/GroupByWindow into SpannerIO.Write/Write mutations to Cloud Spanner/Group
by partition/Read
    Apr 10, 2018 1:08:43 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
    INFO: 2018-04-10T13:08:37.818Z: Fusing consumer ParDo(GenerateMutations) into GenerateSequence/Read(BoundedCountingSource)
    Apr 10, 2018 1:08:43 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
    INFO: 2018-04-10T13:08:37.850Z: Fusing consumer SpannerIO.Write/Write mutations to Cloud
Spanner/Keys sample as view/GBKaSVForKeys/Write into SpannerIO.Write/Write mutations to Cloud
Spanner/Keys sample as view/ParMultiDo(ToIsmRecordForMapLike)
    Apr 10, 2018 1:08:43 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
    INFO: 2018-04-10T13:08:37.881Z: Fusing consumer SpannerIO.Write/Write mutations to Cloud
Spanner/Batch mutations together into SpannerIO.Write/Write mutations to Cloud Spanner/Group
by partition/GroupByWindow
    Apr 10, 2018 1:08:43 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
    INFO: 2018-04-10T13:08:37.911Z: Fusing consumer SpannerIO.Write/Write mutations to Cloud
Spanner/Sample keys/Combine.GroupedValues/Extract into SpannerIO.Write/Write mutations to
Cloud Spanner/Sample keys/Combine.GroupedValues
    Apr 10, 2018 1:08:43 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
    INFO: 2018-04-10T13:08:37.935Z: Fusing consumer SpannerIO.Write/Write mutations to Cloud
Spanner/Sample keys/GroupByKey/Reify into SpannerIO.Write/Write mutations to Cloud Spanner/Sample
keys/GroupByKey+SpannerIO.Write/Write mutations to Cloud Spanner/Sample keys/Combine.GroupedValues/Partial
    Apr 10, 2018 1:08:43 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
    INFO: 2018-04-10T13:08:37.968Z: Fusing consumer SpannerIO.Write/Write mutations to Cloud
Spanner/Sample keys/GroupByKey+SpannerIO.Write/Write mutations to Cloud Spanner/Sample keys/Combine.GroupedValues/Partial
into SpannerIO.Write/Write mutations to Cloud Spanner/Extract keys
    Apr 10, 2018 1:08:43 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
    INFO: 2018-04-10T13:08:37.997Z: Fusing consumer SpannerIO.Write/Write mutations to Cloud
Spanner/Keys sample as view/GBKaSVForData/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write
into SpannerIO.Write/Write mutations to Cloud Spanner/Keys sample as view/GBKaSVForData/ParDo(GroupByKeyHashAndSortByKeyAndWindow)
    Apr 10, 2018 1:08:43 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
    INFO: 2018-04-10T13:08:38.024Z: Fusing consumer SpannerIO.Write/Write mutations to Cloud
Spanner/Sample keys/GroupByKey/Write into SpannerIO.Write/Write mutations to Cloud Spanner/Sample
keys/GroupByKey/Reify
    Apr 10, 2018 1:08:43 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
    INFO: 2018-04-10T13:08:38.050Z: Fusing consumer SpannerIO.Write/Write mutations to Cloud
Spanner/Group by partition/Write into SpannerIO.Write/Write mutations to Cloud Spanner/Group
by partition/Reify
    Apr 10, 2018 1:08:43 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
    INFO: 2018-04-10T13:08:38.416Z: Executing operation SpannerIO.Write/Write mutations to
Cloud Spanner/Schema View/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Create
    Apr 10, 2018 1:08:43 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
    INFO: 2018-04-10T13:08:38.439Z: Executing operation SpannerIO.Write/Write mutations to
Cloud Spanner/Sample keys/GroupByKey/Create
    Apr 10, 2018 1:08:43 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
    INFO: 2018-04-10T13:08:38.470Z: Executing operation SpannerIO.Write/Write mutations to
Cloud Spanner/Keys sample as view/GBKaSVForData/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Create
    Apr 10, 2018 1:08:43 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
    INFO: 2018-04-10T13:08:38.470Z: Starting 1 workers in us-central1-f...
    Apr 10, 2018 1:08:43 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
    INFO: 2018-04-10T13:08:38.502Z: Executing operation SpannerIO.Write/Write mutations to
Cloud Spanner/Keys sample as view/GBKaSVForSize/Create
    Apr 10, 2018 1:08:43 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
    INFO: 2018-04-10T13:08:38.534Z: Executing operation SpannerIO.Write/Write mutations to
Cloud Spanner/Keys sample as view/GBKaSVForKeys/Create
    Apr 10, 2018 1:08:43 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
    INFO: 2018-04-10T13:08:38.565Z: Executing operation SpannerIO.Write/Write mutations to
Cloud Spanner/Group by partition/Create
    Apr 10, 2018 1:08:43 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
    INFO: 2018-04-10T13:08:38.587Z: Executing operation SpannerIO.Write/Write mutations to
Cloud Spanner/Schema View/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Create
    Apr 10, 2018 1:08:47 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
    INFO: 2018-04-10T13:08:46.645Z: Autoscaling: Raised the number of workers to 0 based on
the rate of progress in the currently running step(s).
    Apr 10, 2018 1:08:47 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
    INFO: 2018-04-10T13:08:47.167Z: Executing operation SpannerIO.Write/Write mutations to
Cloud Spanner/Create.Values/Read(CreateSource)+SpannerIO.Write/Write mutations to Cloud Spanner/Read
information schema+SpannerIO.Write/Write mutations to Cloud Spanner/Schema View/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map+SpannerIO.Write/Write
mutations to Cloud Spanner/Schema View/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+SpannerIO.Write/Write
mutations to Cloud Spanner/Schema View/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial+SpannerIO.Write/Write
mutations to Cloud Spanner/Schema View/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify+SpannerIO.Write/Write
mutations to Cloud Spanner/Schema View/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write
    Apr 10, 2018 1:08:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
    INFO: 2018-04-10T13:08:52.305Z: Autoscaling: Resizing worker pool from 1 to 7.
    Apr 10, 2018 1:09:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
    INFO: 2018-04-10T13:08:59.332Z: Autoscaling: Raised the number of workers to 1 based on
the rate of progress in the currently running step(s).
    Apr 10, 2018 1:09:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
    INFO: 2018-04-10T13:08:59.361Z: Resized worker pool to 1, though goal was 7.  This could
be a quota issue.
    Apr 10, 2018 1:09:31 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
    INFO: 2018-04-10T13:09:29.987Z: Workers have started successfully.
    Apr 10, 2018 1:09:57 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
    INFO: 2018-04-10T13:09:57.778Z: Autoscaling: Raised the number of workers to 7 based on
the rate of progress in the currently running step(s).
    Apr 10, 2018 1:10:07 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
    INFO: 2018-04-10T13:10:07.478Z: Executing operation SpannerIO.Write/Write mutations to
Cloud Spanner/Schema View/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Close
    Apr 10, 2018 1:10:07 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
    INFO: 2018-04-10T13:10:07.548Z: Executing operation SpannerIO.Write/Write mutations to
Cloud Spanner/Schema View/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read+SpannerIO.Write/Write
mutations to Cloud Spanner/Schema View/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues+SpannerIO.Write/Write
mutations to Cloud Spanner/Schema View/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract+SpannerIO.Write/Write
mutations to Cloud Spanner/Schema View/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map+SpannerIO.Write/Write
mutations to Cloud Spanner/Schema View/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)+SpannerIO.Write/Write
mutations to Cloud Spanner/Schema View/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write
    Apr 10, 2018 1:10:15 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
    INFO: 2018-04-10T13:10:13.377Z: Executing operation SpannerIO.Write/Write mutations to
Cloud Spanner/Schema View/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Close
    Apr 10, 2018 1:10:15 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
    INFO: 2018-04-10T13:10:13.464Z: Executing operation SpannerIO.Write/Write mutations to
Cloud Spanner/Schema View/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read+SpannerIO.Write/Write
mutations to Cloud Spanner/Schema View/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow)
    Apr 10, 2018 1:10:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
    INFO: 2018-04-10T13:10:25.431Z: Executing operation SpannerIO.Write/Write mutations to
Cloud Spanner/Schema View/Combine.GloballyAsSingletonView/CreateDataflowView
    Apr 10, 2018 1:10:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
    INFO: 2018-04-10T13:10:25.619Z: Executing operation GenerateSequence/Read(BoundedCountingSource)+ParDo(GenerateMutations)+SpannerIO.Write/To
mutation group+SpannerIO.Write/Write mutations to Cloud Spanner/Serialize mutations+SpannerIO.Write/Write
mutations to Cloud Spanner/Extract keys+SpannerIO.Write/Write mutations to Cloud Spanner/Sample
keys/GroupByKey+SpannerIO.Write/Write mutations to Cloud Spanner/Sample keys/Combine.GroupedValues/Partial+SpannerIO.Write/Write
mutations to Cloud Spanner/Sample keys/GroupByKey/Reify+SpannerIO.Write/Write mutations to
Cloud Spanner/Sample keys/GroupByKey/Write
    Apr 10, 2018 1:10:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
    INFO: 2018-04-10T13:10:39.444Z: Executing operation SpannerIO.Write/Write mutations to
Cloud Spanner/Sample keys/GroupByKey/Close
    Apr 10, 2018 1:10:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
    INFO: 2018-04-10T13:10:39.523Z: Executing operation SpannerIO.Write/Write mutations to
Cloud Spanner/Sample keys/GroupByKey/Read+SpannerIO.Write/Write mutations to Cloud Spanner/Sample
keys/Combine.GroupedValues+SpannerIO.Write/Write mutations to Cloud Spanner/Sample keys/Combine.GroupedValues/Extract+SpannerIO.Write/Write
mutations to Cloud Spanner/Keys sample as view/GBKaSVForData/ParDo(GroupByKeyHashAndSortByKeyAndWindow)+SpannerIO.Write/Write
mutations to Cloud Spanner/Keys sample as view/GBKaSVForData/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write
    Apr 10, 2018 1:10:48 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
    INFO: 2018-04-10T13:10:46.021Z: Executing operation SpannerIO.Write/Write mutations to
Cloud Spanner/Keys sample as view/GBKaSVForData/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Close
    Apr 10, 2018 1:10:48 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
    INFO: 2018-04-10T13:10:46.121Z: Executing operation SpannerIO.Write/Write mutations to
Cloud Spanner/Keys sample as view/GBKaSVForData/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read+SpannerIO.Write/Write
mutations to Cloud Spanner/Keys sample as view/ParMultiDo(ToIsmRecordForMapLike)+SpannerIO.Write/Write
mutations to Cloud Spanner/Keys sample as view/GBKaSVForSize/Write+SpannerIO.Write/Write mutations
to Cloud Spanner/Keys sample as view/GBKaSVForKeys/Write
    Apr 10, 2018 1:10:56 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
    INFO: 2018-04-10T13:10:56.467Z: Executing operation SpannerIO.Write/Write mutations to
Cloud Spanner/Keys sample as view/GBKaSVForSize/Close
    Apr 10, 2018 1:10:56 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
    INFO: 2018-04-10T13:10:56.497Z: Executing operation SpannerIO.Write/Write mutations to
Cloud Spanner/Keys sample as view/GBKaSVForKeys/Close
    Apr 10, 2018 1:10:56 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
    INFO: 2018-04-10T13:10:56.553Z: Executing operation SpannerIO.Write/Write mutations to
Cloud Spanner/Keys sample as view/GBKaSVForSize/Read+SpannerIO.Write/Write mutations to Cloud
Spanner/Keys sample as view/ParDo(ToIsmMetadataRecordForSize)
    Apr 10, 2018 1:10:56 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
    INFO: 2018-04-10T13:10:56.587Z: Executing operation SpannerIO.Write/Write mutations to
Cloud Spanner/Keys sample as view/GBKaSVForKeys/Read+SpannerIO.Write/Write mutations to Cloud
Spanner/Keys sample as view/ParDo(ToIsmMetadataRecordForKey)
    Apr 10, 2018 1:11:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
    INFO: 2018-04-10T13:11:00.713Z: Executing operation SpannerIO.Write/Write mutations to
Cloud Spanner/Keys sample as view/Flatten.PCollections
    Apr 10, 2018 1:11:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
    INFO: 2018-04-10T13:11:00.982Z: Executing operation SpannerIO.Write/Write mutations to
Cloud Spanner/Keys sample as view/CreateDataflowView
    Apr 10, 2018 1:11:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
    INFO: 2018-04-10T13:11:01.190Z: Executing operation SpannerIO.Write/Write mutations to
Cloud Spanner/Partition input+SpannerIO.Write/Write mutations to Cloud Spanner/Group by partition/Reify+SpannerIO.Write/Write
mutations to Cloud Spanner/Group by partition/Write
    Apr 10, 2018 1:11:05 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
    INFO: 2018-04-10T13:11:04.071Z: Executing operation SpannerIO.Write/Write mutations to
Cloud Spanner/Group by partition/Close
    Apr 10, 2018 1:11:05 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
    INFO: 2018-04-10T13:11:04.163Z: Executing operation SpannerIO.Write/Write mutations to
Cloud Spanner/Group by partition/Read+SpannerIO.Write/Write mutations to Cloud Spanner/Group
by partition/GroupByWindow+SpannerIO.Write/Write mutations to Cloud Spanner/Batch mutations
together+SpannerIO.Write/Write mutations to Cloud Spanner/Write mutations to Spanner
    Apr 10, 2018 1:11:14 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
    INFO: 2018-04-10T13:11:13.971Z: Cleaning up.
    Apr 10, 2018 1:11:16 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
    INFO: 2018-04-10T13:11:14.368Z: Stopping worker pool...
    Apr 10, 2018 1:12:43 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
    INFO: 2018-04-10T13:12:43.328Z: Autoscaling: Resized worker pool from 7 to 0.
    Apr 10, 2018 1:12:43 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
    INFO: 2018-04-10T13:12:43.438Z: Autoscaling: Would further reduce the number of workers
but reached the minimum number allowed for the job.
    Apr 10, 2018 1:12:43 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
    INFO: 2018-04-10T13:12:43.479Z: Worker pool stopped.
    Apr 10, 2018 1:12:51 PM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
    INFO: Job 2018-04-10_06_08_29-16415010153995140415 finished with status DONE.
    Apr 10, 2018 1:12:52 PM org.apache.beam.runners.dataflow.TestDataflowRunner checkForPAssertSuccess
    INFO: Success result for Dataflow job 2018-04-10_06_08_29-16415010153995140415. Found
0 success, 0 failures out of 0 expected assertions.
Gradle Test Executor 129 finished executing tests.

12 tests completed, 1 failed
Finished generating test XML results (0.007 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_GradleBuild/ws/src/runners/google-cloud-dataflow-java/build/test-results/googleCloudPlatformIntegrationTest>
Generating HTML test report...
Finished generating test html results (0.009 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_GradleBuild/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/googleCloudPlatformIntegrationTest>
:beam-runners-google-cloud-dataflow-java:googleCloudPlatformIntegrationTest FAILED
:beam-runners-google-cloud-dataflow-java:googleCloudPlatformIntegrationTest (Thread[Task worker
for ':' Thread 3,5,main]) completed. Took 17 mins 14.875 secs.

FAILURE: Build completed with 2 failures.

1: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':beam-runners-apex:test'.
> There were failing tests. See the report at: file://<https://builds.apache.org/job/beam_PostCommit_Java_GradleBuild/ws/src/runners/apex/build/reports/tests/test/index.html>

* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to get more log
output. Run with --scan to get full insights.
==============================================================================

2: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':beam-runners-google-cloud-dataflow-java:googleCloudPlatformIntegrationTest'.
> There were failing tests. See the report at: file://<https://builds.apache.org/job/beam_PostCommit_Java_GradleBuild/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/googleCloudPlatformIntegrationTest/index.html>

* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to get more log
output. Run with --scan to get full insights.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 5.0.
See https://docs.gradle.org/4.5.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 1h 6m 22s
756 actionable tasks: 756 executed
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
Recording test results
Not sending mail to unregistered user ehudm@google.com
Not sending mail to unregistered user ccy@google.com
Not sending mail to unregistered user daniel.o.programmer@gmail.com
Not sending mail to unregistered user herohde@google.com

Mime
View raw message