ignite-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Nikolay Izhikov (JIRA)" <j...@apache.org>
Subject [jira] [Comment Edited] (IGNITE-425) Introduce transformers for continuous queries
Date Mon, 05 Feb 2018 14:48:00 GMT

    [ https://issues.apache.org/jira/browse/IGNITE-425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16352475#comment-16352475
] 

Nikolay Izhikov edited comment on IGNITE-425 at 2/5/18 2:47 PM:
----------------------------------------------------------------

Benchmark updated.

Sources - https://github.com/nizhikov/ignite-425-benchmark

||Measure||Value||
|Warmup count|5|
|Warmup time|30 sec|
|Bench iteration|5|
|Bench time|180 sec|
|Write threads|8|
|Batch size|20*1024|

Full run results - https://gist.github.com/nizhikov/5209029958d5129c285e0b2d65f350ab

Final results -

{noformat}
Benchmark                                        Mode  Cnt         Score   Error  Units
CQBenchmark.putBatch                            thrpt    5         0,403 ± 0,012  ops/s
CQBenchmark.putBatch:listenerReceiveEvt         thrpt    5  58963856,000              #
CQBenchmark.putBatch:putCnt                     thrpt    5  58982542,000              #
CQWTIdBenchmark.putBatch                        thrpt    5         0,408 ± 0,011  ops/s
CQWTIdBenchmark.putBatch:listenerReceiveEvt     thrpt    5  59621093,000              #
CQWTIdBenchmark.putBatch:putCnt                 thrpt    5  59637912,000              #
CQWTNullBenchmark.putBatch                      thrpt    5         0,426 ± 0,008  ops/s
CQWTNullBenchmark.putBatch:listenerReceiveEvt   thrpt    5  62406433,000              #
CQWTNullBenchmark.putBatch:putCnt               thrpt    5  62423174,000              #
CQWTValueBenchmark.putBatch                     thrpt    5         0,372 ± 0,011  ops/s
CQWTValueBenchmark.putBatch:listenerReceiveEvt  thrpt    5  54531988,000              #
CQWTValueBenchmark.putBatch:putCnt              thrpt    5  54558825,000              #
{noformat}


was (Author: nizhikov):
Benchmark updated.

Sources - https://github.com/nizhikov/ignite-425-benchmark

||Measure||Value||
|Warmup count|5|
|Warmup time|30 sec|
|Bench iteration|5|
|Bench time|180 sec|
|Write threads|8|

Full run results - https://gist.github.com/nizhikov/5209029958d5129c285e0b2d65f350ab

Final results -

{noformat}
Benchmark                                        Mode  Cnt         Score   Error  Units
CQBenchmark.putBatch                            thrpt    5         0,403 ± 0,012  ops/s
CQBenchmark.putBatch:listenerReceiveEvt         thrpt    5  58963856,000              #
CQBenchmark.putBatch:putCnt                     thrpt    5  58982542,000              #
CQWTIdBenchmark.putBatch                        thrpt    5         0,408 ± 0,011  ops/s
CQWTIdBenchmark.putBatch:listenerReceiveEvt     thrpt    5  59621093,000              #
CQWTIdBenchmark.putBatch:putCnt                 thrpt    5  59637912,000              #
CQWTNullBenchmark.putBatch                      thrpt    5         0,426 ± 0,008  ops/s
CQWTNullBenchmark.putBatch:listenerReceiveEvt   thrpt    5  62406433,000              #
CQWTNullBenchmark.putBatch:putCnt               thrpt    5  62423174,000              #
CQWTValueBenchmark.putBatch                     thrpt    5         0,372 ± 0,011  ops/s
CQWTValueBenchmark.putBatch:listenerReceiveEvt  thrpt    5  54531988,000              #
CQWTValueBenchmark.putBatch:putCnt              thrpt    5  54558825,000              #
{noformat}

> Introduce transformers for continuous queries
> ---------------------------------------------
>
>                 Key: IGNITE-425
>                 URL: https://issues.apache.org/jira/browse/IGNITE-425
>             Project: Ignite
>          Issue Type: Sub-task
>          Components: cache
>    Affects Versions: 2.2
>            Reporter: Yakov Zhdanov
>            Assignee: Nikolay Izhikov
>            Priority: Major
>             Fix For: 2.5
>
>
> Currently if updated entry passes the filter, it is sent to node initiated the query
entirely. It would be good to provide user with the ability to transform entry and, for example,
select only fields that are important. This may bring huge economy to traffic and lower GC
pressure as well.
> Possible signatures will be:
> {noformat}
> public final class ContinuousQuery<K, V, T> {..} // T is a type transformer transforms
to
> public ContinuousQuery<K, V, T> setLocalListener(Listener<T> locLsnr) {..}
// Probably, we will have to introduce new listener type, since user may want to wipe out
key as well.
> /* new method to add */
> public ContinuousQuery<K, V, T> setRemoteTransformerFactory(Factory<? extends
ContinuousQueryTransformer<K, V, T>> factory) { ..}
> {noformat}



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Mime
View raw message