From user-return-29657-archive-asf-public=cust-asf.ponee.io@flink.apache.org Fri Sep 6 09:42:33 2019 Return-Path: X-Original-To: archive-asf-public@cust-asf.ponee.io Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [207.244.88.153]) by mx-eu-01.ponee.io (Postfix) with SMTP id 06FA9180645 for ; Fri, 6 Sep 2019 11:42:32 +0200 (CEST) Received: (qmail 71794 invoked by uid 500); 6 Sep 2019 20:33:22 -0000 Mailing-List: contact user-help@flink.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Delivered-To: mailing list user@flink.apache.org Received: (qmail 71784 invoked by uid 99); 6 Sep 2019 20:33:22 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd4-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 06 Sep 2019 20:33:22 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd4-us-west.apache.org (ASF Mail Server at spamd4-us-west.apache.org) with ESMTP id 521EEC1CE2 for ; Fri, 6 Sep 2019 09:42:31 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd4-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 2.55 X-Spam-Level: ** X-Spam-Status: No, score=2.55 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, FREEMAIL_ENVFROM_END_DIGIT=0.25, HTML_MESSAGE=2, KAM_NUMSUBJECT=0.5, RCVD_IN_DNSWL_NONE=-0.0001, SPF_HELO_NONE=0.001, SPF_PASS=-0.001] autolearn=disabled Authentication-Results: spamd4-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com Received: from mx1-he-de.apache.org ([10.40.0.8]) by localhost (spamd4-us-west.apache.org [10.40.0.11]) (amavisd-new, port 10024) with ESMTP id BiGmQcsfa_Fw for ; Fri, 6 Sep 2019 09:42:29 +0000 (UTC) Received-SPF: Pass (mailfrom) identity=mailfrom; client-ip=2607:f8b0:4864:20::e30; helo=mail-vs1-xe30.google.com; envelope-from=huanyang1024@gmail.com; receiver= Received: from mail-vs1-xe30.google.com (mail-vs1-xe30.google.com [IPv6:2607:f8b0:4864:20::e30]) by mx1-he-de.apache.org (ASF Mail Server at mx1-he-de.apache.org) with ESMTPS id 5A9C87D723 for ; Fri, 6 Sep 2019 09:42:28 +0000 (UTC) Received: by mail-vs1-xe30.google.com with SMTP id u21so3621565vsl.10 for ; Fri, 06 Sep 2019 02:42:28 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=F6kqu5rC63jQw5t8oybTlyDAgv+uAcqfMcn3Tbuvz20=; b=g9cp7SP42XaKjiKeHrVjjJtmBXdLhfmZlAhPbgXi2uHR+dgWGhSZfNahszPSf/gtbq PXg6wrwVoxTmzqLLPyF4gmF8pfk/t9m7g9miXxNFzOud1N6Fyhi171guXZKPY/22GgH5 kWvgkaEhKAXrIE0ZhZ3hHhcaNct5GA/lWr9eE4Y0C3dzNVopf+8E7H83iSfgw/iEa34d nnGEFRBDPx+mIgh75bGCIKZfB0nPFUL2McIy/J49eG/M0FpTTRaze1IH/xFxDMsArfDz 7WhPqJTph+J5ff1UOo9HPBL0l7OtGr4SBB4Vae7i7Mcsh4JP0fM6SKGRAqTfRI0W0WHT 2obA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=F6kqu5rC63jQw5t8oybTlyDAgv+uAcqfMcn3Tbuvz20=; b=TUGNhv8NX1Z+bRPfp8CmNRWMTkDScE1aIqDe9G6IXkV4nykh3elrtFkRSDUNHmqUss E2A+NsxRA0EWPp7vpxWj6fzsnOw+2vthSefcPYoCXsiZKHGpAJTJ+gSF1aBBBxiC+7uA MK3fSWTJpvhgP2IxJOBzyq5TJaJYN3Nyx7NyWD7sGEUOecLfv5IgG+U0g30GEffI1ybv nodarUpbWFe85i0xe+xtpvVWAHmBCiwQLvzypeYPqdqmhfgFfTzl18TGIzKbB0lu0nSv KzvtsbAg7bCmeX3r2wJrqMKykH+cS+xli6brm0g8cuq12xEYa3IN1FCWKcPFNLuy9zCc zwYw== X-Gm-Message-State: APjAAAX1cQ9ZMkDBr/Q55btIkOrPoojl6cSFPP6JJajl5Zlfa6GDTbuO LbzlrNbu91A520S4R5kgEbFEXho6dt1Lk4awN18= X-Google-Smtp-Source: APXvYqwzpg1gGVeFvnURV/EIvK1wdwiSU5MLSA65w1geX03iju/ZXjKxzsYEpZaOGZsJotTfNVv3AEMcGuPK/3G3qts= X-Received: by 2002:a67:e290:: with SMTP id g16mr4579714vsf.10.1567762947170; Fri, 06 Sep 2019 02:42:27 -0700 (PDT) MIME-Version: 1.0 References: In-Reply-To: From: Anyang Hu Date: Fri, 6 Sep 2019 17:42:14 +0800 Message-ID: Subject: Re: suggestion of FLINK-10868 To: Peter Huang Cc: Till Rohrmann , user , qi luo , snake.fly318@gmail.com Content-Type: multipart/alternative; boundary="0000000000008ee5570591df416d" --0000000000008ee5570591df416d Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable Thank you for the reply and look forward to the advice of Till. Anyang Peter Huang =E4=BA=8E2019=E5=B9=B49=E6=9C=885= =E6=97=A5=E5=91=A8=E5=9B=9B =E4=B8=8B=E5=8D=8811:53=E5=86=99=E9=81=93=EF=BC= =9A > Hi Anyang, > > Thanks for raising it up. I think it is reasonable as what you requested > is needed for batch. Let's wait for Till to give some more input. > > > > Best Regards > Peter Huang > > On Thu, Sep 5, 2019 at 7:02 AM Anyang Hu wrote: > >> Hi Peter&Till: >> >> As commented in the issue >> =EF=BC=8CWe have int= roduced >> the FLINK-10868 patc= h >> (mainly batch tasks) online, what do you think of the following two >> suggestions: >> >> 1) Parameter control time interval. At present, the default time >> interval of 1 min is used, which is too short for batch tasks; >> >> 2)Parameter Control When the failed Container number reaches >> MAXIMUM_WORKERS_FAILURE_RATE and JM disconnects whether to perform >> OnFatalError so that the batch tasks can exit as soon as possible. >> >> Best regards, >> Anyang >> > --0000000000008ee5570591df416d Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable
Thank you for the reply and look forward to the advice of = Till.

Anyang

<= div dir=3D"ltr" class=3D"gmail_attr">Peter Huang <huangzhenqiu0825@gmail.com> =E4=BA=8E2019=E5= =B9=B49=E6=9C=885=E6=97=A5=E5=91=A8=E5=9B=9B =E4=B8=8B=E5=8D=8811:53=E5=86= =99=E9=81=93=EF=BC=9A
Hi Anyang,

Thanks for raising it = up. I think it is reasonable as what you requested is needed for batch. Let= 's wait for Till to give some more input.


=

Best Regards
Peter Huang
On Thu, S= ep 5, 2019 at 7:02 AM Anyang Hu <huanyang1024@gmail.com> wrote:
Hi=C2=A0Peter&Till:

As commented in = the issue=EF=BC=8CWe have i= ntroduced the=C2=A0FLINK-10868=C2=A0patch (mainly batch tasks) online, what do you thi= nk of the following two suggestions:

1)=C2=A0Parameter control time interval. At present, the default ti= me interval of 1 min is used, which is too short for batch tasks;=C2=A0

2)Parameter Control When the failed Container number = reaches MAXIMUM_WORKERS_FAILURE_RATE and JM disconnects whether to perform = OnFatalError so that the batch tasks can exit as soon as possible.
Best reg= ards,
Anyang
--0000000000008ee5570591df416d--