Return-Path: X-Original-To: apmail-storm-user-archive@minotaur.apache.org Delivered-To: apmail-storm-user-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 7D14D119D7 for ; Thu, 31 Jul 2014 14:00:27 +0000 (UTC) Received: (qmail 35972 invoked by uid 500); 31 Jul 2014 14:00:26 -0000 Delivered-To: apmail-storm-user-archive@storm.apache.org Received: (qmail 35935 invoked by uid 500); 31 Jul 2014 14:00:26 -0000 Mailing-List: contact user-help@storm.incubator.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@storm.incubator.apache.org Delivered-To: mailing list user@storm.incubator.apache.org Received: (qmail 35922 invoked by uid 99); 31 Jul 2014 14:00:26 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 31 Jul 2014 14:00:26 +0000 X-ASF-Spam-Status: No, hits=3.2 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_NONE,SPF_SOFTFAIL X-Spam-Check-By: apache.org Received-SPF: softfail (athena.apache.org: transitioning domain of jadetangcn@qq.com does not designate 54.206.34.216 as permitted sender) Received: from [54.206.34.216] (HELO smtpbgau2.qq.com) (54.206.34.216) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 31 Jul 2014 14:00:22 +0000 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=qq.com; s=s201307; t=1406815185; bh=ikNsT9yELBipu72Xd4JPkpPlvNH/jQeax5an47QSHGA=; h=X-QQ-mid:Received:X-QQ-SSF:X-QQ-FEAT:X-QQ-GoodBg:Content-Type:Mime-Version:Subject:From: X-Priority:In-Reply-To:Date:Message-Id:References:To:X-Mailer: X-QQ-SENDSIZE; b=XJoV2KSBVJllP6AvS2KBxMnRZfMFqyaaR5j3vuQPdRnpBgOtMJCIo0S0j3d+t2PI4 uQctlqkxekd2kt6w0NfzLKjw1AZ5aRaij4EKZ3YTmwMJdufIdWxQxC7GCcasN4rE/y bp12HKF05rdiBzY+ApPbkj616VHOKRUVO+K0wBQc= X-QQ-mid: esmtp20t1406815183t624t11747 Received: from [192.168.1.6] (unknown [27.42.110.118]) by esmtp4.qq.com (ESMTP) with id ; Thu, 31 Jul 2014 21:59:43 +0800 (CST) X-QQ-SSF: 0000000000000020FF100F00000000Z X-QQ-FEAT: 2IMJFP3VNWIF9jkoMRnJfIZIjzq4tOIQtWJgGj34Czo6GAK1hi52lSZiJc9bI OlvnN8ZOWWEQXicdmJDvHR1rflIIsxrvEwxj/8mrakokfmAQBEa4hezJwjgi+9eHrwSQ56F Z91mcxr6RhjiP96S341clwyh7qzpmhK5pjOGEWrCK44NzKmFNg6187GBHZY2FwUT4I4f5Wo = X-QQ-GoodBg: 0 Content-Type: multipart/alternative; boundary="Apple-Mail=_1DD2AE86-4BEA-4993-ABB2-513AF93D7C3B" Mime-Version: 1.0 (Mac OS X Mail 7.3 \(1878.6\)) Subject: Re: storm with redis, java.lang.IllegalStateException: Returned object not currently part of this pool From: =?GB2312?B?zMYgy7yzyQ==?= X-Priority: 3 (Normal) In-Reply-To: Date: Thu, 31 Jul 2014 21:59:41 +0800 Message-Id: References: To: user@storm.incubator.apache.org, =?utf-8?B?7J207Iq57KeE?= X-Mailer: Apple Mail (2.1878.6) X-QQ-SENDSIZE: 520 X-QQ-Bgrelay: 1 X-Virus-Checked: Checked by ClamAV on apache.org --Apple-Mail=_1DD2AE86-4BEA-4993-ABB2-513AF93D7C3B Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset=utf-8 what is you configure of Jedis pool? my guess is maybe there are more than one Jedis pool in your topology =E5=9C=A8 2014=E5=B9=B47=E6=9C=8822=E6=97=A5=EF=BC=8C=E4=B8=8B=E5=8D=881:2= 2=EF=BC=8C=EC=9D=B4=EC=8A=B9=EC=A7=84 = =E5=86=99=E9=81=93=EF=BC=9A >=20 > java.lang.RuntimeException: = redis.clients.jedis.exceptions.JedisException: Could not return the = resource to the pool > at = backtype.storm.utils.DisruptorQueue.consumeBatchToCursor(DisruptorQueue.ja= va:128) > at = backtype.storm.utils.DisruptorQueue.consumeBatchWhenAvailable(DisruptorQue= ue.java:99) > at = backtype.storm.disruptor$consume_batch_when_available.invoke(disruptor.clj= :80) > at = backtype.storm.daemon.executor$fn__5641$fn__5653$fn__5700.invoke(executor.= clj:746) > at backtype.storm.util$async_loop$fn__457.invoke(util.clj:431) > at clojure.lang.AFn.run(AFn.java:24) > at java.lang.Thread.run(Thread.java:745) > Caused by: redis.clients.jedis.exceptions.JedisException: Could not = return the resource to the pool > at redis.clients.util.Pool.returnResourceObject(Pool.java:54) > at = redis.clients.jedis.JedisPool.returnResource(JedisPool.java:98) > at = com.naver.labs.nelo2.notifier.bolt.ThresholdCheckBolt.execute(ThresholdChe= ckBolt.java:143) > at = backtype.storm.topology.BasicBoltExecutor.execute(BasicBoltExecutor.java:5= 0) > at = backtype.storm.daemon.executor$fn__5641$tuple_action_fn__5643.invoke(execu= tor.clj:631) > at = backtype.storm.daemon.executor$mk_task_receiver$fn__5564.invoke(executor.c= lj:399) > at = backtype.storm.disruptor$clojure_handler$reify__745.onEvent(disruptor.clj:= 58) > at = backtype.storm.utils.DisruptorQueue.consumeBatchToCursor(DisruptorQueue.ja= va:120) > ... 6 more > Caused by: java.lang.IllegalStateException: Returned object not = currently part of this pool > at = org.apache.commons.pool2.impl.GenericObjectPool.returnObject(GenericObject= Pool.java:534) > at redis.clients.util.Pool.returnResourceObject(Pool.java:52) > ... 13 more >=20 > Hi all, >=20 > =20 > I'm seeing very weird error message like above. >=20 > =20 > In certain bolt, it communicate with redis. >=20 > =20 > When I set parallelism hint to 32, it works fine. >=20 > =20 > but when I set parallelism hint to some number bigger than 32, that = error occurs. >=20 > =20 > currently I have 2 supervisor nodes of storm, each has 1 worker. >=20 > =20 > Is it Storm's problem or Jedis's, any clue will be appreciated. >=20 --Apple-Mail=_1DD2AE86-4BEA-4993-ABB2-513AF93D7C3B Content-Transfer-Encoding: quoted-printable Content-Type: text/html; charset=utf-8 what = is you configure of Jedis pool?
my guess is maybe there are more = than one Jedis pool in your topology
=E5=9C=A8 = 2014=E5=B9=B47=E6=9C=8822=E6=97=A5=EF=BC=8C=E4=B8=8B=E5=8D=881:22=EF=BC=8C= =EC=9D=B4=EC=8A=B9=EC=A7=84 <sweetest.sj@navercorp.com>= ; =E5=86=99=E9=81=93=EF=BC=9A


java.lang.RuntimeException: =
redis.clients.jedis.exceptions.JedisException: Could not return the =
resource to the pool
	at =
backtype.storm.utils.DisruptorQueue.consumeBatchToCursor(DisruptorQueue.ja=
va:128)
	at =
backtype.storm.utils.DisruptorQueue.consumeBatchWhenAvailable(DisruptorQue=
ue.java:99)
	at =
backtype.storm.disruptor$consume_batch_when_available.invoke(disruptor.clj=
:80)
	at =
backtype.storm.daemon.executor$fn__5641$fn__5653$fn__5700.invoke(executor.=
clj:746)
	at backtype.storm.util$async_loop$fn__457.invoke(util.clj:431)
	at clojure.lang.AFn.run(AFn.java:24)
	at java.lang.Thread.run(Thread.java:745)
Caused by: redis.clients.jedis.exceptions.JedisException: Could not =
return the resource to the pool
	at redis.clients.util.Pool.returnResourceObject(Pool.java:54)
	at =
redis.clients.jedis.JedisPool.returnResource(JedisPool.java:98)
	at =
com.naver.labs.nelo2.notifier.bolt.ThresholdCheckBolt.execute(ThresholdChe=
ckBolt.java:143)
	at =
backtype.storm.topology.BasicBoltExecutor.execute(BasicBoltExecutor.java:5=
0)
	at =
backtype.storm.daemon.executor$fn__5641$tuple_action_fn__5643.invoke(execu=
tor.clj:631)
	at =
backtype.storm.daemon.executor$mk_task_receiver$fn__5564.invoke(executor.c=
lj:399)
	at =
backtype.storm.disruptor$clojure_handler$reify__745.onEvent(disruptor.clj:=
58)
	at =
backtype.storm.utils.DisruptorQueue.consumeBatchToCursor(DisruptorQueue.ja=
va:120)
	... 6 more
Caused by: java.lang.IllegalStateException: Returned object not =
currently part of this pool
	at =
org.apache.commons.pool2.impl.GenericObjectPool.returnObject(GenericObject=
Pool.java:534)
	at redis.clients.util.Pool.returnResourceObject(Pool.java:52)
	... 13 more

Hi all,

 

I'm seeing very weird error = message like above.

 

In certain bolt, it = communicate with redis.

 

When I set parallelism hint = to 32, it works fine.

 

but when I set parallelism = hint to some number bigger than 32, that error occurs.

 

currently I have 2 = supervisor nodes of storm, each has 1 worker.

 

Is it Storm's problem or = Jedis's, any clue will be appreciated.


= --Apple-Mail=_1DD2AE86-4BEA-4993-ABB2-513AF93D7C3B--