From user-return-14799-archive-asf-public=cust-asf.ponee.io@storm.apache.org Sun Nov 8 17:36:58 2020 Return-Path: X-Original-To: archive-asf-public@cust-asf.ponee.io Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mxout1-ec2-va.apache.org (mxout1-ec2-va.apache.org [3.227.148.255]) by mx-eu-01.ponee.io (Postfix) with ESMTPS id A38EE180637 for ; Sun, 8 Nov 2020 18:36:58 +0100 (CET) Received: from mail.apache.org (mailroute1-lw-us.apache.org [207.244.88.153]) by mxout1-ec2-va.apache.org (ASF Mail Server at mxout1-ec2-va.apache.org) with SMTP id D00FE43AE9 for ; Sun, 8 Nov 2020 17:36:57 +0000 (UTC) Received: (qmail 19188 invoked by uid 500); 8 Nov 2020 17:36:56 -0000 Mailing-List: contact user-help@storm.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@storm.apache.org Delivered-To: mailing list user@storm.apache.org Received: (qmail 19178 invoked by uid 99); 8 Nov 2020 17:36:56 -0000 Received: from spamproc1-he-fi.apache.org (HELO spamproc1-he-fi.apache.org) (95.217.134.168) by apache.org (qpsmtpd/0.29) with ESMTP; Sun, 08 Nov 2020 17:36:56 +0000 Received: from localhost (localhost [127.0.0.1]) by spamproc1-he-fi.apache.org (ASF Mail Server at spamproc1-he-fi.apache.org) with ESMTP id 8AFDDBFD6E for ; Sun, 8 Nov 2020 17:36:55 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamproc1-he-fi.apache.org X-Spam-Flag: NO X-Spam-Score: 0.009 X-Spam-Level: X-Spam-Status: No, score=0.009 tagged_above=-999 required=6.31 tests=[KAM_DMARC_STATUS=0.01, SPF_PASS=-0.001] autolearn=disabled Received: from mx1-he-de.apache.org ([116.203.227.195]) by localhost (spamproc1-he-fi.apache.org [95.217.134.168]) (amavisd-new, port 10024) with ESMTP id 00BZY_AlXlS0 for ; Sun, 8 Nov 2020 17:36:55 +0000 (UTC) Received-SPF: Pass (mailfrom) identity=mailfrom; client-ip=83.212.88.51; helo=webhost2.uom.gr; envelope-from=nicoleta@uom.gr; receiver= Received: from webhost2.uom.gr (webhost2.uom.gr [83.212.88.51]) by mx1-he-de.apache.org (ASF Mail Server at mx1-he-de.apache.org) with ESMTPS id CD3167F79E for ; Sun, 8 Nov 2020 17:36:54 +0000 (UTC) Received: from [::1] (port=56574 helo=webhost2.uom.gr) by webhost2.uom.gr with esmtpa (Exim 4.93) (envelope-from ) id 1kbocR-00Gnil-TX for user@storm.incubator.apache.org; Sun, 08 Nov 2020 19:36:47 +0200 MIME-Version: 1.0 Date: Sun, 08 Nov 2020 19:36:47 +0200 From: nicoleta@uom.gr To: user@storm.incubator.apache.org Subject: Message Passing Implementation User-Agent: Roundcube Webmail/1.4.8 Message-ID: <8af499c56007e9b8eb09076a95cb03f0@uom.gr> X-Sender: nicoleta@uom.gr Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 8bit X-AntiAbuse: This header was added to track abuse, please include it with any abuse report X-AntiAbuse: Primary Hostname - webhost2.uom.gr X-AntiAbuse: Original Domain - storm.incubator.apache.org X-AntiAbuse: Originator/Caller UID/GID - [47 12] / [47 12] X-AntiAbuse: Sender Address Domain - uom.gr X-Get-Message-Sender-Via: webhost2.uom.gr: authenticated_id: nicoleta@uom.gr X-Authenticated-Sender: webhost2.uom.gr: nicoleta@uom.gr X-Source: X-Source-Args: X-Source-Dir: Hello, I hope my email finds all of you well. I am a Phd candidate and I am writing to you with regard to scheduling in Apache Storm. According to the MPI implementation of Storm the workers manage connections to other workers and maintain a mapping from task to task. Also, transferring takes in a task id and a tuple, and it serializes the tuple and puts it onto a "transfer queue”. The question is, if there is a way to organise scheduling, such that certain tasks of an operator communicate to only certain tasks of the following operator at a given time according to the application’s topology (could ZeroMQ possibly do something like this?). Any hint would help. Thank you in advance for your valuable help. Kind regards, Nicole