flink-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Averell <lvhu...@gmail.com>
Subject Re: Small-files source - partitioning based on prefix of file
Date Mon, 30 Jul 2018 12:32:38 GMT
Thanks Vino.

Yes, I can do that after the source function. But that means data would be
shuffled - sending from every source to the right partition.
I think that by doing the partition from within the file source would help
to save that shuffling.


Sent from: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/

View raw message