Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id DF3432007D0 for ; Tue, 10 May 2016 20:46:30 +0200 (CEST) Received: by cust-asf.ponee.io (Postfix) id DD25016098A; Tue, 10 May 2016 18:46:30 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id 311C2160877 for ; Tue, 10 May 2016 20:46:30 +0200 (CEST) Received: (qmail 84063 invoked by uid 500); 10 May 2016 18:46:29 -0000 Mailing-List: contact dev-help@reef.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@reef.apache.org Delivered-To: mailing list dev@reef.apache.org Delivered-To: moderator for dev@reef.apache.org Received: (qmail 82217 invoked by uid 99); 10 May 2016 18:45:45 -0000 X-Virus-Scanned: Debian amavisd-new at spamd3-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 1.897 X-Spam-Level: * X-Spam-Status: No, score=1.897 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, HTML_MESSAGE=2, RCVD_IN_DNSWL_NONE=-0.0001, RCVD_IN_MSPIKE_H2=-0.001, SPF_HELO_PASS=-0.001, SPF_PASS=-0.001] autolearn=disabled Authentication-Results: spamd3-us-west.apache.org (amavisd-new); dkim=pass (1024-bit key) header.d=microsoft.com DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=selector1; h=From:To:Date:Subject:Message-ID:Content-Type:MIME-Version; bh=I1fhQVuSyjvNPqgnbvf3GZpw2lQdKHBYJWSaQzSq9ig=; b=hmxkzcIKdspgn+MOilymYHB9MvTgu7g1jVmmEjl5iYJ/7oSaMeIvZFj4JVJvq7rHjkNC3it8IcFDXFUe4y54auf5Cx3wmvUCa4Y3GvY4+jp/oeLv/uUZY8BgKq4VvtDEJ6K27JmH724eKmSSuE927pPyyDoqwxouavnG/LLPID8= From: Dushyant Bansal To: "dev@reef.apache.org" Subject: Heartbeat message limit Thread-Topic: Heartbeat message limit Thread-Index: AdGq6+p+MMs8G3tWSOWhjtEaWtktzg== Date: Tue, 10 May 2016 18:45:34 +0000 Message-ID: Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: authentication-results: reef.apache.org; dkim=none (message not signed) header.d=none;reef.apache.org; dmarc=none action=none header.from=microsoft.com; x-originating-ip: [2001:4898:80e8:5::2c6] x-ms-office365-filtering-correlation-id: 0e99f804-1baf-474f-ba79-08d3790345c6 x-microsoft-exchange-diagnostics: 1;DM2PR0301MB0734;5:V4/ljIgmZ+WBzv7JGyUY7n0sQPS8Dnby9cDLyUlLtgfSwSnsScvql9bQbSrIgyhLEyFqRQ3FXWm2H/rpOFJS8HZnBVY2tLHdQWjbaEDEcvQ9sD6hzuiyBA8XBvkh17JvnrZkwwEjGkyd/7iOjC/4hw==;24:RGvDX09rmcc4MblbWf3z0s8DXuQkQqhlzusWMd0YtGkJFSIEp4codZL6V3f4PhepFsXVXekXKTRAdLyHJgoFYdZG1L4XuE9evMauCegRSfE=;7:s6SWf1Jb3Pv8t/Q0Epe9OqJEnycxRfUpzaknuVm/BfbcEIK5qviyN12CKuqVbY6H2G3YvTumkz0RJZTaQV/PLTAs2dp+ekozQv5sUJW1XDrsli3HISKz7b57gazH2enpjO0bkQ+mDTgnhm3Xm4UZ3XBXrbO7zEFzl1YmrzcHdqjpuk0tJ75O6D4/xKGW51ou/g2/wLyOq4lH4bnL/s43vA== x-microsoft-antispam: UriScan:;BCL:0;PCL:0;RULEID:;SRVR:DM2PR0301MB0734; x-microsoft-antispam-prvs: x-exchange-antispam-report-test: UriScan:; x-exchange-antispam-report-cfa-test: BCL:0;PCL:0;RULEID:(61425038)(601004)(2401047)(8121501046)(5005006)(10201501046)(3002001)(6055026)(61426038)(61427038);SRVR:DM2PR0301MB0734;BCL:0;PCL:0;RULEID:;SRVR:DM2PR0301MB0734; x-forefront-prvs: 0938781D02 x-forefront-antispam-report: SFV:NSPM;SFS:(10019020)(229853001)(16236675004)(19580395003)(2351001)(5008740100001)(5002640100001)(3660700001)(19300405004)(86612001)(1220700001)(81166006)(122556002)(19617315012)(3280700002)(102836003)(6116002)(790700001)(50986999)(54356999)(586003)(2420400007)(5003600100002)(15650500001)(5004730100002)(77096005)(10090500001)(15975445007)(92566002)(450100001)(99286002)(2900100001)(8936002)(3480700004)(86362001)(10710500007)(2501003)(11100500001)(33656002)(10290500002)(10400500002)(2906002)(5005710100001)(110136002)(7110500001)(189998001)(8990500004)(76576001)(107886002)(19625215002)(9686002)(3826002);DIR:OUT;SFP:1102;SCL:1;SRVR:DM2PR0301MB0734;H:DM2PR0301MB0736.namprd03.prod.outlook.com;FPR:;SPF:None;MLV:sfv;LANG:en; spamdiagnosticoutput: 1:23 spamdiagnosticmetadata: NSPM Content-Type: multipart/alternative; boundary="_000_DM2PR0301MB07362E3671B91D4002D7B5EAF4710DM2PR0301MB0736_" MIME-Version: 1.0 X-OriginatorOrg: microsoft.com X-MS-Exchange-CrossTenant-originalarrivaltime: 10 May 2016 18:45:35.0011 (UTC) X-MS-Exchange-CrossTenant-fromentityheader: Hosted X-MS-Exchange-CrossTenant-id: 72f988bf-86f1-41af-91ab-2d7cd011db47 X-MS-Exchange-Transport-CrossTenantHeadersStamped: DM2PR0301MB0734 archived-at: Tue, 10 May 2016 18:46:31 -0000 --_000_DM2PR0301MB07362E3671B91D4002D7B5EAF4710DM2PR0301MB0736_ Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable Hi REEF team, I'm in Azure Stream Analytics at Microsoft. We're adding data to the heartb= eat that gets sent by the REEF task to the Driver. I want to make sure we = don't overflow any message buffers. There is general guidance on the REEF = site to keep the message to keep the = Driver performant at scale. But is there a limit on the message size beyond= which the communication will break? Is this limit configurable? Is there = any guidance on how much load is considered "too much" load for the Driver? "It is wise for that message to be small, as we otherwise run the risk of o= verwhelming the Driver with heartbeat traffic at scale." Thanks, Dushyant --_000_DM2PR0301MB07362E3671B91D4002D7B5EAF4710DM2PR0301MB0736_--