flink-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Flavio Pompermaier <pomperma...@okkam.it>
Subject Parallel file read in LocalEnvironment
Date Wed, 07 Oct 2015 12:47:14 GMT
Hi to all,

is there a way to split a single local file by line count (e.g. a split
every 100 lines) in a LocalEnvironment to speed up a simple map function?
For me it is not very clear how the local files (files into directory if
recursive=true) are managed by Flink..is there any ref to this internals?

Best,
Flavio

Mime
View raw message