Return-Path: X-Original-To: apmail-storm-user-archive@minotaur.apache.org Delivered-To: apmail-storm-user-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 21B0118181 for ; Wed, 17 Feb 2016 18:11:38 +0000 (UTC) Received: (qmail 5593 invoked by uid 500); 17 Feb 2016 18:11:21 -0000 Delivered-To: apmail-storm-user-archive@storm.apache.org Received: (qmail 5539 invoked by uid 500); 17 Feb 2016 18:11:21 -0000 Mailing-List: contact user-help@storm.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@storm.apache.org Delivered-To: mailing list user@storm.apache.org Received: (qmail 5523 invoked by uid 99); 17 Feb 2016 18:11:21 -0000 Received: from Unknown (HELO spamd1-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 17 Feb 2016 18:11:21 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd1-us-west.apache.org (ASF Mail Server at spamd1-us-west.apache.org) with ESMTP id DB8B3C09CF for ; Wed, 17 Feb 2016 18:11:20 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd1-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 1.297 X-Spam-Level: * X-Spam-Status: No, score=1.297 tagged_above=-999 required=6.31 tests=[HTML_MESSAGE=2, RCVD_IN_DNSWL_LOW=-0.7, RCVD_IN_MSPIKE_H2=-0.001, SPF_HELO_PASS=-0.001, SPF_PASS=-0.001] autolearn=disabled Received: from mx2-lw-us.apache.org ([10.40.0.8]) by localhost (spamd1-us-west.apache.org [10.40.0.7]) (amavisd-new, port 10024) with ESMTP id hh8l7ywk6PXM for ; Wed, 17 Feb 2016 18:11:19 +0000 (UTC) Received: from mail1.bemta3.messagelabs.com (mail1.bemta3.messagelabs.com [195.245.230.176]) by mx2-lw-us.apache.org (ASF Mail Server at mx2-lw-us.apache.org) with ESMTPS id 10F87615EC for ; Wed, 17 Feb 2016 07:32:16 +0000 (UTC) Received: from [85.158.137.3] by server-16.bemta-3.messagelabs.com id 7D/30-07451-AF124C65; Wed, 17 Feb 2016 07:32:10 +0000 X-Env-Sender: alattab@qf.org.qa X-Msg-Ref: server-6.tower-38.messagelabs.com!1455694328!22538571!1 X-Originating-IP: [86.36.49.93] X-StarScan-Received: X-StarScan-Version: 7.35.1; banners=qf.org.qa,-,- X-VirusChecked: Checked Received: (qmail 10297 invoked from network); 17 Feb 2016 07:32:09 -0000 Received: from qfm00011.qf.org.qa (HELO QFM00011.QF.ORG.QA) (86.36.49.93) by server-6.tower-38.messagelabs.com with AES128-SHA encrypted SMTP; 17 Feb 2016 07:32:09 -0000 Received: from QFM00008.qf.org.qa (192.168.108.171) by QFM00011 (192.168.105.171) with Microsoft SMTP Server (TLS) id 14.3.279.2; Wed, 17 Feb 2016 10:32:07 +0300 Received: from QFM00013.qf.org.qa ([fe80::5db7:1067:50f1:9a42]) by QFM00008.qf.org.qa ([fe80::94b5:7c35:713b:a670%17]) with mapi id 14.03.0279.002; Wed, 17 Feb 2016 10:32:07 +0300 From: Abdelkader Lattab To: "user@storm.apache.org" Subject: FW: Running on Remote Storm Cluster Thread-Topic: Running on Remote Storm Cluster Thread-Index: AdFpVEEKv5lC8xuFR5K1FOsUc5xVtwAAMBsf Date: Wed, 17 Feb 2016 07:32:04 +0000 Message-ID: <942DA627837EB840A01D6AB27B08E3A84467762F@QFM00013.qf.org.qa> References: <942DA627837EB840A01D6AB27B08E3A84467761F@QFM00013.qf.org.qa> In-Reply-To: <942DA627837EB840A01D6AB27B08E3A84467761F@QFM00013.qf.org.qa> Accept-Language: en-US, en-GB Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: x-originating-ip: [192.168.203.11] x-exclaimer-md-config: e0a2311f-e0f5-4869-b31f-bc9c10717d8a Content-Type: multipart/alternative; boundary="_000_942DA627837EB840A01D6AB27B08E3A84467762FQFM00013qforgqa_" MIME-Version: 1.0 --_000_942DA627837EB840A01D6AB27B08E3A84467762FQFM00013qforgqa_ Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: quoted-printable ________________________________ From: Abdelkader Lattab Sent: Wednesday, February 17, 2016 10:24 AM To: user@storm.apache.org Subject: Running on Remote Storm Cluster Dear all I have a topology which consists of one Spout connecting to Redis (web sit= es visits) , and about 20 Bolts. One of those Bolts is crawling data from = Twitter and an onother one is crawling data from Facebook. On local Mode my topology runs happily. But on the Remote Storm Cluster, it runs for quite sometimes and then cra= shes. The message is shown below. I really need some help here to overcome this problem. Thank you "-url-visitCountId" is the Id of Bolt instances which counts visits. 34382575 [Thread-17-url-visitCountId] ERROR b.s.util - Halting process: ("= Worker died") java.lang.RuntimeException: ("Worker died") at backtype.storm.util$exit_process_BANG_.doInvoke(util.clj:336) [= storm-core-0.10.0.jar:0.10.0] at clojure.lang.RestFn.invoke(RestFn.java:423) [clojure-1.6.0.jar:= ?] at backtype.storm.daemon.worker$fn__7184$fn__7185.invoke(worker.cl= j:532) [storm-core-0.10.0.jar:0.10.0] at backtype.storm.daemon.executor$mk_executor_data$fn__5523$fn__55= 24.invoke(executor.clj:261) [storm-core-0.10.0.jar:0.10.0] at backtype.storm.util$async_loop$fn__545.invoke(util.clj:489) [st= orm-core-0.10.0.jar:0.10.0] at clojure.lang.AFn.run(AFn.java:22) [clojure-1.6.0.jar:?] at java.lang.Thread.run(Thread.java:745) [?:1.7.0_80] CONFIDENTIALITY NOTICE: This email and any attachments transmitted with it are confidential and in= tended for the use of individual or entity to which it is addressed. If yo= u have received this email in error, please delete it immediately and info= rm the sender. Unless you are the intended recipient, you may not use, dis= close, copy or distribute this email or any attachments included. The cont= ents of the emails including any attachments may be subjected to copyright= s law, In such case the contents may not be copied, adapted, distributed o= r transmitted without the consent of the copyright owner. --_000_942DA627837EB840A01D6AB27B08E3A84467762FQFM00013qforgqa_ Content-Type: text/html; charset="iso-8859-1" Content-Transfer-Encoding: quoted-printable

From: Abdelkader Lattab
Sent: Wednesday, February 17, 2016 10:24 AM
To: user@storm.apache.org
Subject: Running on Remote Storm Cluster

Dear all

I have a topology which consists of one Spout connecting to Redis (web sit= es visits) , and about 20 Bolts. One of those Bolts is crawling data from = Twitter and an onother one is crawling data from Facebook.
On local Mode my topology runs  happily.
But on the Remote  Storm Cluster, it runs for quite sometimes and the= n crashes. The message is shown below.
I really need some help here to overcome this problem.

Thank you

"-url-visitCountId" is the Id of Bolt instances which counts vis= its.

34382575 [Thread-17-url-visitCountId] ERROR b.s.util - Halting process: (&= quot;Worker died")
java.lang.RuntimeException: ("Worker died")
        at backtype.storm.util$exit_pro= cess_BANG_.doInvoke(util.clj:336) [storm-core-0.10.0.jar:0.10.0]
        at clojure.lang.RestFn.invoke(R= estFn.java:423) [clojure-1.6.0.jar:?]
        at backtype.storm.daemon.worker= $fn__7184$fn__7185.invoke(worker.clj:532) [storm-core-0.10.0.jar:0.10.0]         at backtype.storm.daemon.execut= or$mk_executor_data$fn__5523$fn__5524.invoke(executor.clj:261) [storm-core= -0.10.0.jar:0.10.0]
        at backtype.storm.util$async_lo= op$fn__545.invoke(util.clj:489) [storm-core-0.10.0.jar:0.10.0]
        at clojure.lang.AFn.run(AFn.jav= a:22) [clojure-1.6.0.jar:?]
        at java.lang.Thread.run(Thread.= java:745) [?:1.7.0_80]

CONFIDENTIALITY NOTICE:
This email and any attachments transmitted with it are confidential and in= tended for the use of individual or entity to which it is addressed. If yo= u have received this email in error, please delete it immediately and info= rm the sender. Unless you are the intended recipient, you may not use, dis= close, copy or distribute this email or any attachments included. The cont= ents of the emails including any attachments may be subjected to copyright= s law, In such case the contents may not be copied, adapted, distributed o= r transmitted without the consent of the copyright owner.
--_000_942DA627837EB840A01D6AB27B08E3A84467762FQFM00013qforgqa_--