Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id 4C304200C04 for ; Tue, 24 Jan 2017 18:54:03 +0100 (CET) Received: by cust-asf.ponee.io (Postfix) id 4AB12160B3E; Tue, 24 Jan 2017 17:54:03 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id BAA12160B38 for ; Tue, 24 Jan 2017 18:54:02 +0100 (CET) Received: (qmail 82872 invoked by uid 500); 24 Jan 2017 17:54:01 -0000 Mailing-List: contact user-help@flink.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@flink.apache.org Delivered-To: mailing list user@flink.apache.org Received: (qmail 82862 invoked by uid 99); 24 Jan 2017 17:54:01 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd1-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 24 Jan 2017 17:54:01 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd1-us-west.apache.org (ASF Mail Server at spamd1-us-west.apache.org) with ESMTP id 668B0C20AB for ; Tue, 24 Jan 2017 17:54:01 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd1-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 1.966 X-Spam-Level: * X-Spam-Status: No, score=1.966 tagged_above=-999 required=6.31 tests=[RCVD_IN_DNSWL_NONE=-0.0001, SPF_NEUTRAL=0.652, URIBL_BLOCKED=0.001, URI_HEX=1.313] autolearn=disabled Received: from mx1-lw-eu.apache.org ([10.40.0.8]) by localhost (spamd1-us-west.apache.org [10.40.0.7]) (amavisd-new, port 10024) with ESMTP id YT4t7Pl6CsL3 for ; Tue, 24 Jan 2017 17:54:00 +0000 (UTC) Received: from mwork.nabble.com (mwork.nabble.com [162.253.133.43]) by mx1-lw-eu.apache.org (ASF Mail Server at mx1-lw-eu.apache.org) with ESMTP id F18A95F23A for ; Tue, 24 Jan 2017 17:53:59 +0000 (UTC) Received: from mjoe.nabble.com (unknown [162.253.133.57]) by mwork.nabble.com (Postfix) with ESMTP id AD4A41DBA78DD for ; Tue, 24 Jan 2017 10:53:58 -0700 (MST) Date: Tue, 24 Jan 2017 09:52:15 -0800 (PST) From: Jonas To: user@flink.apache.org Message-ID: <1485280335524-11272.post@n4.nabble.com> In-Reply-To: References: <1485256527970-11248.post@n4.nabble.com> Subject: Re: Improving Flink Performance MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: 7bit archived-at: Tue, 24 Jan 2017 17:54:03 -0000 The performance hit due to decoding the JSON is expected and there is not a lot (except for changing the encoding that I can do about that). Alright. When joining the above stream with another stream I get another performance hit by ~80% so that in the end I have only 1k msgs/s remaining. Do you know how to improve that? Might setting the buffer size / timeout be worth exploring? -- View this message in context: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/Improving-Flink-Performance-tp11248p11272.html Sent from the Apache Flink User Mailing List archive. mailing list archive at Nabble.com.