ignite-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Raul <ronly2...@gmail.com>
Subject What is the best approach for large number of concurrent mappings?
Date Sun, 26 Mar 2017 13:13:40 GMT
>
> Hi,
>
> I am trying to work out what the best approach would be for the following
> problem?
>
> Conditions:
>
>    1. You have a river of data flowing at a varying rate into a cache,
>    the cache holds the last N minuets of data.
>    2. The river of data has to be analyzed as fast as possible
>    3. You have over 10,000 different map reduce functions that has to
>    aggregate into at least 1,000,000 buckets
>
> Question:
> Is it a good idea to spin up 10k continuous mappers or is there a better
> way
>
> Thank you for assistance
>
>
>

Mime
View raw message