beam-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Lakstsap <>
Subject GO SDK - help on trigger
Date Sat, 16 Nov 2019 07:01:34 GMT
I am reading large files and emit to a windowing function ( window duration for a minute )
Then using grouping ParDo transform I am grouping by key and collection.

Because of the file size is large it is stuck at the group by key pipeline step. As per the
documentation looks like I need to set a trigger to emit the results from the group by key
step because of windowing.
Looks like go sdk does not support trigger. 
Could you please tell me alternate way for this or when do you plan to release a code for
trigger concept like in java 

View raw message