flink-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Michele Bertoni <michele1.bert...@mail.polimi.it>
Subject cogroup
Date Mon, 29 Jun 2015 15:40:37 GMT
Hi I have a question on cogroup

when I cogroup two dataset is there a way to compare each element on the left with each element
on the right (inside a group) without collecting one side?

right now I am doing

left.cogroup(right).where(0,1,2).equalTo(0,1,2){
	(leftIterator, rightIterator, out) => {
		val lSet = leftIterator.toSet		// <———— toSet
		for(r <- rightIterator)
			for(l <- lSet)
				//do something
	}
}

I would like to avoid the toSet


thanks for help
Mime
View raw message