ignite-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Andrew <j...@bistel.co.kr>
Subject Need your advice for using DataStreamer
Date Tue, 16 Feb 2016 03:21:44 GMT
Hi igniters,

My situation is like below.
There are 3000+ message senders outside.
They will send message per 0.1 sec and the sequence of message have to be
kept per each sender.
So I made a cache to buffer all messages then put all message into the cache
using DataStreamer.
But when I getting message from the cache with continuous query, I found the
sequence of message are broken.

I found the DataStreamer cannot keep the sequence of data when it flush at
your document.

This is my question.
1. Is there any simple way to make the sequence be right though using
DataStreamer?
    - I tried to use putAll() but as the size of message is growing it
performs so poor.

2. What problems would be happen if I use DataStreamer like below?
    - Limit DataStreamer's perNodeParallelOperations() as 1 to keep
sequence(Affinity key is applied for message sender)
    - Create multiple threads to make DataStreamer described above
    - Run threads concurrently

Sincerely,
Andrew




--
View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Need-your-advice-for-using-DataStreamer-tp3015.html
Sent from the Apache Ignite Users mailing list archive at Nabble.com.

Mime
View raw message