flink-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Samim Ahmed <samim1...@gmail.com>
Subject Performance Improvement on Flink 1.2.0
Date Thu, 22 Jun 2017 10:08:06 GMT
Hi All,

This query regarding the flink performance improvement .

*Flink Configuration:*
using flink in clustor mode with 3 salves and a master configuration
slots used 30 (as the system has 30 core)
task manager memory 30GB
parallelism used : 30
jobmanager.heap.mb: 20480
taskmanager.heap.mb: 20480
taskmanager.numberOfTaskSlots: 30
taskmanager.network.numberOfBuffers: 20000

*Input info:*
Input file : 1ROP(5min) data with 3333 Nodes and 665K eps
Total number of events :: 199498294

*Observation :*
Total time taken to complete the task = 6m24s

Can you please suggest what else I need to modify to get the high
performance in terms of lese execution time. Thanks in advance


-- 
Regards,
Samim Ahmed
Mumbai
09004259232

Mime
View raw message