Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id AE35F200C16 for ; Thu, 9 Feb 2017 12:50:50 +0100 (CET) Received: by cust-asf.ponee.io (Postfix) id ACB02160B50; Thu, 9 Feb 2017 11:50:50 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id 3CDD0160B4C for ; Thu, 9 Feb 2017 12:50:49 +0100 (CET) Received: (qmail 52832 invoked by uid 500); 9 Feb 2017 11:50:43 -0000 Mailing-List: contact user-help@ignite.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@ignite.apache.org Delivered-To: mailing list user@ignite.apache.org Received: (qmail 52822 invoked by uid 99); 9 Feb 2017 11:50:43 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd1-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 09 Feb 2017 11:50:43 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd1-us-west.apache.org (ASF Mail Server at spamd1-us-west.apache.org) with ESMTP id E8632C0DEB for ; Thu, 9 Feb 2017 11:50:42 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd1-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 1.679 X-Spam-Level: * X-Spam-Status: No, score=1.679 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, HTML_MESSAGE=2, RCVD_IN_DNSWL_LOW=-0.7, RCVD_IN_MSPIKE_H3=-0.01, RCVD_IN_MSPIKE_WL=-0.01, RCVD_IN_SORBS_SPAM=0.5, SPF_PASS=-0.001] autolearn=disabled Authentication-Results: spamd1-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com Received: from mx1-lw-us.apache.org ([10.40.0.8]) by localhost (spamd1-us-west.apache.org [10.40.0.7]) (amavisd-new, port 10024) with ESMTP id 38Id1u5a0Cao for ; Thu, 9 Feb 2017 11:50:41 +0000 (UTC) Received: from mail-lf0-f41.google.com (mail-lf0-f41.google.com [209.85.215.41]) by mx1-lw-us.apache.org (ASF Mail Server at mx1-lw-us.apache.org) with ESMTPS id E0E535F4ED for ; Thu, 9 Feb 2017 11:50:35 +0000 (UTC) Received: by mail-lf0-f41.google.com with SMTP id x1so785150lff.0 for ; Thu, 09 Feb 2017 03:50:35 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:from:date:message-id:subject:to; bh=wK9CieyHNuujnjzjYDv8ga126vux3tpDeFzWaAl/tXw=; b=Qm6yXxBMB+yTgFAEc44uomIn7Swts3LfAiAsqtH0nbO70COuC6hFoh8XrxVVn3qGtR J3ymwjM4QahZEVfhQ4WQzac91gWtdR5KcrRkDFVEDRAvC9Wnb0JG+912htR7u/zAjldW rZ2EaF31vRLuGPFRsjjkXEv46ds/R8S4u1fWtUC0VJw8HsdvFJXsNfaJgqHQi0pYLtdk EOBH5oi+Dx81olYd/yav/yJhAeq//1Su+nZFsILXleHK7PnTkgpOcZiFGHZKNTTQOIhk lqmdn8e/E8zVF35RzW4uuiaxUphiN4OhVTXz+Xi9JroIHfDl1HJB76ZInVV0iK4w+mnw 4SNA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:from:date:message-id:subject:to; bh=wK9CieyHNuujnjzjYDv8ga126vux3tpDeFzWaAl/tXw=; b=D5osOgYJShL86JPm2TaDXAFGcxH+HysYDN82Tb5a7qrJaNeASPHJvkTHNYkUCeGy8N s/ntFNEV9TlPCfuZG023VQ3G5DrdU/3bCSa73pI4wQYqs5beGuYvt46P+BURcESNIMQZ KgnWvK1NHEjnl5fGfocc2myyTvUN1pg47jfffAdVLjQdtdceODmwR0FQFiAB386g2BdZ e8xfCF0k4ncGcuIwaS4VtBpoXqtaRW8cemyeMHcc94b7Rk+1Weluy/Dz2ViIqixHpEag mvYeUI8nDNodrUlKhJPJ4O35GxIoOTVwd5JdIS4SzW/cjOEY5OqKcjVNEXBKb4uF8TZl qEfg== X-Gm-Message-State: AMke39nsIEeDPjW1cRY/UlapQbyCo7lBewrDpVocDHUDPQImKUgCGzAfAq2JQxX2dHiyET02OB8IVHkPZiApWQ== X-Received: by 10.25.21.96 with SMTP id l93mr972217lfi.136.1486641028736; Thu, 09 Feb 2017 03:50:28 -0800 (PST) MIME-Version: 1.0 Received: by 10.25.234.147 with HTTP; Thu, 9 Feb 2017 03:50:28 -0800 (PST) From: Tolga Kavukcu Date: Thu, 9 Feb 2017 13:50:28 +0200 Message-ID: Subject: Cache write behind optimization To: user@ignite.apache.org Content-Type: multipart/alternative; boundary=001a11406c846d2eec05481796a1 archived-at: Thu, 09 Feb 2017 11:50:50 -0000 --001a11406c846d2eec05481796a1 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable Hi everyone, I discovered that my write behind updates are executed within same thread which i perform put operation. I can see that i happens under load, but could anyone tell me which parameters should i optimize. I dont want to run writebehind operation in my threads. java.lang.Thread.State: RUNNABLE at java.net.SocketInputStream.socketRead0(Native Method) at java.net.SocketInputStream.socketRead(SocketInputStream.java:116) at java.net.SocketInputStream.read(SocketInputStream.java:170) at java.net.SocketInputStream.read(SocketInputStream.java:141) at org.postgresql.core.VisibleBufferedInputStream.readMore( VisibleBufferedInputStream.java:143) at org.postgresql.core.VisibleBufferedInputStream.ensureBytes( VisibleBufferedInputStream.java:112) at org.postgresql.core.VisibleBufferedInputStream.read( VisibleBufferedInputStream.java:70) at org.postgresql.core.PGStream.ReceiveChar(PGStream.java:283) at org.postgresql.core.v3.QueryExecutorImpl.processResults( QueryExecutorImpl.java:1818) at org.postgresql.core.v3.QueryExecutorImpl.execute( QueryExecutorImpl.java:377) - locked <0x0000000795dc0038> (a org.postgresql.core.v3.QueryExecutorImpl) at org.postgresql.jdbc.PgStatement.executeBatch(PgStatement.java:1026) at org.postgresql.jdbc.PgPreparedStatement.executeBatch( PgPreparedStatement.java:1661) at com.mchange.v2.c3p0.impl.NewProxyPreparedStatement.executeBatch( NewProxyPreparedStatement.java:2544) at com.intellica.evam.engine.db.store.ScenarioRecordStore.writeAll( ScenarioRecordStore.java:114) at org.apache.ignite.internal.processors.cache.store.GridCacheWriteBehindStore= .updateStore( GridCacheWriteBehindStore.java:685) at org.apache.ignite.internal.processors.cache.store.GridCacheWriteBehindStore= .applyBatch( GridCacheWriteBehindStore.java:618) at org.apache.ignite.internal.processors.cache.store.GridCacheWriteBehindStore= .flushSingleValue( GridCacheWriteBehindStore.java:580) at org.apache.ignite.internal.processors.cache.store.GridCacheWriteBehindStore= .updateCache( GridCacheWriteBehindStore.java:538) at org.apache.ignite.internal.processors.cache.store.GridCacheWriteBehindStore= .write( GridCacheWriteBehindStore.java:454) at org.apache.ignite.internal.processors.cache.store.GridCacheStoreManagerAdap= ter.put( GridCacheStoreManagerAdapter.java:575) at org.apache.ignite.internal.processors.cache.GridCacheMapEntry.innerUpdate( GridCacheMapEntry.java:2436) - locked <0x000000078f8c1460> (a org.apache.ignite.internal.processors.cache.distributed.dht.atomic.GridDhtA= tomicOffHeapCacheEntry) at org.apache.ignite.internal.processors.cache.distributed.dht.atomic.GridDhtA= tomicCache.updateSingle( GridDhtAtomicCache.java:2478) at org.apache.ignite.internal.processors.cache.distributed.dht.atomic.GridDhtA= tomicCache.updateAllAsyncInternal0( GridDhtAtomicCache.java:1880) at org.apache.ignite.internal.processors.cache.distributed.dht.atomic.GridDhtA= tomicCache.updateAllAsyncInternal( GridDhtAtomicCache.java:1720) at org.apache.ignite.internal.processors.cache.distributed.dht.atomic.GridNear= AtomicAbstractUpdateFuture.mapSingle( GridNearAtomicAbstractUpdateFuture.java:259) at org.apache.ignite.internal.processors.cache.distributed.dht.atomic.GridNear= AtomicSingleUpdateFuture.map( GridNearAtomicSingleUpdateFuture.java:508) at org.apache.ignite.internal.processors.cache.distributed.dht.atomic.GridNear= AtomicSingleUpdateFuture.mapOnTopology( GridNearAtomicSingleUpdateFuture.java:438) at org.apache.ignite.internal.processors.cache.distributed.dht.atomic.GridNear= AtomicAbstractUpdateFuture.map( GridNearAtomicAbstractUpdateFuture.java:208) at org.apache.ignite.internal.processors.cache.distributed.dht.atomic.GridDhtA= tomicCache.update0( GridDhtAtomicCache.java:1238) at org.apache.ignite.internal.processors.cache.distributed.dht.atomic.GridDhtA= tomicCache.put0( GridDhtAtomicCache.java:674) at org.apache.ignite.internal.processors.cache.GridCacheAdapter.put( GridCacheAdapter.java:2243) at org.apache.ignite.internal.processors.cache.GridCacheAdapter.put( GridCacheAdapter.java:2220) at org.apache.ignite.internal.processors.cache.IgniteCacheProxy.put( IgniteCacheProxy.java:1376) at com.intellica.project.helper.ee.ConfigManagerHelperEE.setState( ConfigManagerHelperEE.java:92) Thanks. --=20 *Tolga KAVUK=C3=87U* --001a11406c846d2eec05481796a1 Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: quoted-printable
Hi everyone,

I discovered that my write= behind updates are executed within same thread which i perform put operati= on. I can see that i happens under load, but could anyone tell me =C2=A0whi= ch parameters should i optimize. I dont want to run writebehind operation i= n my threads.

<bean class=3D"org.apac= he.ignite.configuration.CacheConfiguration" name=3D"DEFAULT"= >
=C2=A0 =C2=A0 =C2=A0 =C2=A0 <property name=3D"rebala= nceThrottle" value=3D"100"/>
=C2=A0 =C2=A0 =C2= =A0 =C2=A0 <property name=3D"rebalanceBatchSize" value=3D"= ;#{2 * 1024 * 1024}"/>
=C2=A0 =C2=A0 =C2=A0 =C2=A0 <pr= operty name=3D"rebalanceMode" value=3D"SYNC"/>
=
=C2=A0 =C2=A0 =C2=A0 =C2=A0 <property name=3D"atomicityMode&qu= ot; value=3D"ATOMIC" />
=C2=A0 =C2=A0 =C2=A0 =C2=A0 = <property name=3D"cacheMode" value=3D"PARTITIONED" /= >
=C2=A0 =C2=A0 =C2=A0 =C2=A0 <property name=3D"memory= Mode" value=3D"OFFHEAP_TIERED" />
=C2=A0 =C2=A0= =C2=A0 =C2=A0 <property name=3D"backups" value=3D"1"= ; />
=C2=A0 =C2=A0 =C2=A0 =C2=A0 <property name=3D"aff= inity">
=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 <bea= n class=3D"org.apache.ignite.cache.affinity.fair.FairAffinityFunction&= quot;>
=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0= <constructor-arg index=3D"0" type=3D"int" value=3D&= quot;128"/>
=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 <= ;/bean>
=C2=A0 =C2=A0 =C2=A0 =C2=A0 </property>
=C2=A0 =C2=A0 =C2=A0 =C2=A0 <property name=3D"offHeapMaxMemory&qu= ot; value=3D"0" />
=C2=A0 =C2=A0 =C2=A0 =C2=A0 <p= roperty name=3D"writeThrough" value=3D"true" />
=C2=A0 =C2=A0 =C2=A0 =C2=A0 <property name=3D"writeBehindEnab= led" value=3D"true" />
=C2=A0 =C2=A0 =C2=A0 =C2= =A0 <property name=3D"eagerTtl" value=3D"false"/>=
=C2=A0 =C2=A0 =C2=A0 =C2=A0 <property name=3D"writeBehin= dFlushFrequency" value=3D"#{10 * 1000}" />
=C2= =A0 =C2=A0 =C2=A0 =C2=A0 <property name=3D"writeBehindBatchSize&quo= t; value=3D"100000" />
=C2=A0 =C2=A0 =C2=A0 =C2=A0 &= lt;property name=3D"writeBehindFlushThreadCount" value=3D"2&= quot; />
=C2=A0 =C2=A0 =C2=A0 =C2=A0 <property name=3D"= ;writeBehindFlushSize" value=3D"100000" />
=C2= =A0 =C2=A0 =C2=A0 =C2=A0 <property name=3D"startSize" value=3D= "250000" />
=C2=A0 =C2=A0 =C2=A0 =C2=A0 <property= name=3D"statisticsEnabled" value=3D"true" />
<= div>=C2=A0 =C2=A0 </bean>

java.lang.Thread.State: RUNNABLE=
at java.net.SocketInputStream.socket= Read0(Native Method= )
= at java.net.SocketInputStrea= m.socketRead(SocketInputStream.java:116)
at java.= net.SocketInputStream.read(SocketInputStream.java:170)
at java.net.SocketInputStream.read(SocketInputStream.java:141)
at org.postgresql.core.VisibleBufferedInputStream.rea= dMore(VisibleBufferedInputStream.java:143)
at org= .postgresql.core.VisibleBufferedInputStream.ensureBytes(VisibleBufferedI= nputStream.java:112)<= /span>
at org.postgresql.core.Visible= BufferedInputStream.read(VisibleBufferedInputStream.java:70)
at org.postgresql.core.PGStream.ReceiveChar(PGStream.java:28= 3)
at org.postgresql.core.v3.QueryExecutorImpl.proc= essResults(QueryExecutorImpl.java:1818)
at org.po= stgresql.core.v3.QueryExecutorImpl.execute(QueryExecutorImpl.java:377)
- locked=C2=A0<0x0000000795dc0038= >=C2=A0(a org.post= gresql.core.v3.QueryExecutorImpl)
at org.postgresql.jdbc.PgStatement.executeBatch(PgStatement.java:1026= )
at org.postgresql.jdbc.PgPreparedStatement.execut= eBatch(PgPreparedStatement.java:1661)
at com.mcha= nge.v2.c3p0.impl.NewProxyPreparedStatement.executeBatch(NewProxyPrepared= Statement.java:2544)<= /span>
at com.intellica.evam.engine.d= b.store.ScenarioRecordStore.writeAll(ScenarioRecordStore.java:114)
at org.apache.ignite.internal.processors.cache.store.Gr= idCacheWriteBehindStore.updateStore(GridCacheWriteBehindStore.java:685)
at org.apache.ignite.internal.processors.cache.store= .GridCacheWriteBehindStore.applyBatch(GridCacheWriteBehindStore.java:618= )
at org.apache.ignite.internal.processors.cache.st= ore.GridCacheWriteBehindStore.flushSingleValue(GridCacheWriteBehindStore.= java:580)
at org.apache.ignite.internal.processor= s.cache.store.GridCacheWriteBehindStore.updateCache(GridCacheWriteBehindS= tore.java:538)=
at org.apache.ignite.internal.proces= sors.cache.store.GridCacheWriteBehindStore.write(GridCacheWriteBehindStor= e.java:454)at org.apache.ignite.internal.processor= s.cache.store.GridCacheStoreManagerAdapter.put(GridCacheStoreManagerAdapt= er.java:575)at org.apache.ignite.internal.processo= rs.cache.GridCacheMapEntry.innerUpdate(GridCacheMapEntry.java:2436= )
- locked=C2=A0<0x000000078f8c1460>= ;=C2=A0(a org.apache.= ignite.internal.processors.cache.distributed.dht.atomic.GridDhtAtomicOffHea= pCacheEntry)
at org.apache.ign= ite.internal.processors.cache.distributed.dht.atomic.GridDhtAtomicCache.upd= ateSingle(GridDhtAtomicCache.java:2478)
at org.ap= ache.ignite.internal.processors.cache.distributed.dht.atomic.GridDhtAtomicC= ache.updateAllAsyncInternal0(GridDhtAtomicCache.java:1880)
at org.apache.ignite.internal.processors.cache.distributed.dht.at= omic.GridDhtAtomicCache.updateAllAsyncInternal(GridDhtAtomicCache.java:17= 20)
at org.apache.ignite.internal.processors.cach= e.distributed.dht.atomic.GridNearAtomicAbstractUpdateFuture.mapSingle(Gri= dNearAtomicAbstractUpdateFuture.java:259)
at org.ap= ache.ignite.internal.processors.cache.distributed.dht.atomic.GridNearAtomic= SingleUpdateFuture.map(GridNearAtomicSingleUpdateFuture.java:508)
at org.apache.ignite.internal.processors.cache.distributed= .dht.atomic.GridNearAtomicSingleUpdateFuture.mapOnTopology(GridNearAtomic= SingleUpdateFuture.java:438)
at org.apache.ignite.i= nternal.processors.cache.distributed.dht.atomic.GridNearAtomicAbstractUpdat= eFuture.map(GridNearAtomicAbstractUpdateFuture.java:208)
at org.apache.ignite.internal.processors.cache.distributed.dht.atom= ic.GridDhtAtomicCache.update0(GridDhtAtomicCache.java:1238)
at org.apache.ignite.internal.processors.cache.distributed.dht.a= tomic.GridDhtAtomicCache.put0(GridDhtAtomicCache.java:674)
at org.apache.ignite.internal.processors.cache.GridCacheAdapter.p= ut(GridCacheAdapter.java:2243)
at org.apache.igni= te.internal.processors.cache.GridCacheAdapter.put(GridCacheAdapter.java:2= 220)
at org.apache.ignite.internal.processors.cach= e.IgniteCacheProxy.put(IgniteCacheProxy.java:1376)
Confi= gManagerHelperEE.java:92)


Thanks.--
Tolga KAVUK=C3=87U
--001a11406c846d2eec05481796a1--