ignite-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Scott Feldstein <scott...@gmail.com>
Subject Re: tuning near cache performance
Date Wed, 21 Feb 2018 23:56:58 GMT
Hi Roman,
1. Cache Configuration

        NearCacheConfiguration<K, V> nearCfg = new
NearCacheConfiguration<>();
        LruEvictionPolicy<K, V> lruEvictionPolicy = new
LruEvictionPolicy<>(50000);
        nearCfg.setNearEvictionPolicy(lruEvictionPolicy);
        nearCfg.setNearStartSize(50000);
        CacheConfiguration<K, V> cacheConfiguration = new
CacheConfiguration<>(name);
        cacheConfiguration.setGroupName(“mygroup”);
        cacheConfiguration.setStatisticsEnabled(true);
        cacheConfiguration.setCacheMode(CacheMode.PARTITIONED);
        cacheConfiguration.setAtomicityMode(CacheAtomicityMode.ATOMIC);
        cacheConfiguration.setCopyOnRead(false);
        cacheConfiguration.setEagerTtl(false);
        return ignite.getOrCreateCache(cacheConfiguration, nearCfg);

2. How many entries in the cache - 50000
3. Cache value example
Here is the class:
    public class Entry<Long> {
        private final long guid;
        // size of 10-20 per cache
        private Long[] features;
    }
4. How large is a cache (GB) - very small, but i'm not sure how i pull that
information from ignite (still a newbie).  Pre-ignite the cache size was ~
200MB
5. What is the speed of uploading and downloading (entities per second)
Below are the raw stats for one minute of runtime.  It is a very read
intensive operation.

Cluster Cache Metrics CacheMetricsSnapshot [reads=2534, puts=1365,
hits=1710, misses=824, txCommits=0, txRollbacks=0, evicts=0, removes=483,
putAvgTimeNanos=0.0, getAvgTimeNanos=0.0, rmvAvgTimeNanos=0.0,
commitAvgTimeNanos=0.0, rollbackAvgTimeNanos=0.0,
cacheName=treeLeaderIndex-default, offHeapGets=0, offHeapPuts=0,
offHeapRemoves=0, offHeapEvicts=0, offHeapHits=0, offHeapMisses=0,
offHeapEntriesCnt=819, heapEntriesCnt=819, offHeapPrimaryEntriesCnt=819,
offHeapBackupEntriesCnt=0, offHeapAllocatedSize=0, size=0, keySize=0,
isEmpty=true, dhtEvictQueueCurrSize=-1, txThreadMapSize=0, txXidMapSize=0,
txCommitQueueSize=0, txPrepareQueueSize=0, txStartVerCountsSize=0,
txCommittedVersionsSize=0, txRolledbackVersionsSize=0,
txDhtThreadMapSize=0, txDhtXidMapSize=-1, txDhtCommitQueueSize=0,
txDhtPrepareQueueSize=0, txDhtStartVerCountsSize=0,
txDhtCommittedVersionsSize=-1, txDhtRolledbackVersionsSize=-1,
isWriteBehindEnabled=false, writeBehindFlushSize=-1,
writeBehindFlushThreadCnt=-1, writeBehindFlushFreq=-1,
writeBehindStoreBatchSize=-1, writeBehindTotalCriticalOverflowCnt=-1,
writeBehindCriticalOverflowCnt=-1, writeBehindErrorRetryCnt=-1,
writeBehindBufSize=-1, totalPartitionsCnt=1024, rebalancingPartitionsCnt=0,
keysToRebalanceLeft=0, rebalancingKeysRate=0, rebalancingBytesRate=0,
rebalanceStartTime=0, rebalanceFinishTime=0, keyType=java.lang.Object,
valType=java.lang.Object, isStoreByVal=true, isStatisticsEnabled=true,
isManagementEnabled=false, isReadThrough=false, isWriteThrough=false]

cache Local Metrics CacheMetricsSnapshot [reads=1747890, puts=0,
hits=1746145, misses=1745, txCommits=0, txRollbacks=0, evicts=0, removes=0,
putAvgTimeNanos=0.0, getAvgTimeNanos=12.70161, rmvAvgTimeNanos=0.0,
commitAvgTimeNanos=0.0, rollbackAvgTimeNanos=0.0,
cacheName=treeLeaderIndex-default, offHeapGets=0, offHeapPuts=0,
offHeapRemoves=0, offHeapEvicts=0, offHeapHits=0, offHeapMisses=0,
offHeapEntriesCnt=0, heapEntriesCnt=819, offHeapPrimaryEntriesCnt=0,
offHeapBackupEntriesCnt=0, offHeapAllocatedSize=0, size=0, keySize=0,
isEmpty=true, dhtEvictQueueCurrSize=-1, txThreadMapSize=0, txXidMapSize=0,
txCommitQueueSize=0, txPrepareQueueSize=0, txStartVerCountsSize=0,
txCommittedVersionsSize=0, txRolledbackVersionsSize=0,
txDhtThreadMapSize=0, txDhtXidMapSize=-1, txDhtCommitQueueSize=0,
txDhtPrepareQueueSize=0, txDhtStartVerCountsSize=0,
txDhtCommittedVersionsSize=-1, txDhtRolledbackVersionsSize=-1,
isWriteBehindEnabled=false, writeBehindFlushSize=-1,
writeBehindFlushThreadCnt=-1, writeBehindFlushFreq=-1,
writeBehindStoreBatchSize=-1, writeBehindTotalCriticalOverflowCnt=-1,
writeBehindCriticalOverflowCnt=-1, writeBehindErrorRetryCnt=-1,
writeBehindBufSize=-1, totalPartitionsCnt=0, rebalancingPartitionsCnt=0,
keysToRebalanceLeft=0, rebalancingKeysRate=0, rebalancingBytesRate=0,
rebalanceStartTime=-1, rebalanceFinishTime=-1, keyType=java.lang.Object,
valType=java.lang.Object, isStoreByVal=true, isStatisticsEnabled=true,
isManagementEnabled=false, isReadThrough=false, isWriteThrough=false]

thanks!

Scott



On Wed, Feb 21, 2018 at 1:02 AM Roman Guseinov <roman@gromtech.ru> wrote:

> Hi Scott,
>
> Performance won't be better than using a local HashMap because there is a
> lot of additional procedures for replicating, marshaling and so on.
>
> In some cases, performance can be improved. Could you provide a more
> detailed information?
>
> 1. Cache configuration
> 2. How many entries in the cache
> 3. Cache value example
> 4. How large is a cache (GB)
> 5. What is the speed of uploading and downloading (entities per second)
>
> Best Regards,
> Roman
>
>
>
> --
> Sent from: http://apache-ignite-users.70518.x6.nabble.com/
>

Mime
View raw message