Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id 0071A200CFC for ; Thu, 28 Sep 2017 16:33:39 +0200 (CEST) Received: by cust-asf.ponee.io (Postfix) id F30011609CD; Thu, 28 Sep 2017 14:33:38 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id 4437C1609C2 for ; Thu, 28 Sep 2017 16:33:38 +0200 (CEST) Received: (qmail 41419 invoked by uid 500); 28 Sep 2017 14:33:37 -0000 Mailing-List: contact user-help@flink.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Delivered-To: mailing list user@flink.apache.org Received: (qmail 41408 invoked by uid 99); 28 Sep 2017 14:33:37 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd1-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 28 Sep 2017 14:33:37 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd1-us-west.apache.org (ASF Mail Server at spamd1-us-west.apache.org) with ESMTP id B3576D208A for ; Thu, 28 Sep 2017 14:33:36 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd1-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: -0.822 X-Spam-Level: X-Spam-Status: No, score=-0.822 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, RCVD_IN_DNSWL_LOW=-0.7, RCVD_IN_MSPIKE_H3=-0.01, RCVD_IN_MSPIKE_WL=-0.01, RP_MATCHES_RCVD=-0.001, SPF_PASS=-0.001] autolearn=disabled Authentication-Results: spamd1-us-west.apache.org (amavisd-new); dkim=pass (1024-bit key) header.d=abv.bg Received: from mx1-lw-eu.apache.org ([10.40.0.8]) by localhost (spamd1-us-west.apache.org [10.40.0.7]) (amavisd-new, port 10024) with ESMTP id mWP4rouvGGl3 for ; Thu, 28 Sep 2017 14:33:35 +0000 (UTC) Received: from smtp-out.abv.bg (smtp-out.abv.bg [194.153.145.80]) by mx1-lw-eu.apache.org (ASF Mail Server at mx1-lw-eu.apache.org) with ESMTPS id 0606461035 for ; Thu, 28 Sep 2017 14:33:35 +0000 (UTC) Received: from nm71.abv.bg (nm71.ni.bg [192.168.151.57]) by smtp-out.abv.bg (Postfix) with ESMTP id A1BDE117323; Thu, 28 Sep 2017 17:33:34 +0300 (EEST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=abv.bg; s=smtp-out; t=1506609214; bh=7JS9PIpWjrKVWpRcCSdN9bQ62bKLcJPZ4w9g9oMoQ74=; h=Date:From:To:Cc:In-Reply-To:References:Subject:From; b=b8/NqxPHYhPm0StH49oNnzOzOyXU3iipuD+aJ+BukEKiJe3O06FVgdqcUtv1NMS5v aGRP6Vdbw+NeVXuDR95bclVBiIMEN0SZaKKAiIujDYDh8TFMrKq8eHcwhEzySwYv10 OHLtStJebueR288RiMR7tvsL9xMgZIgIOfxiIfWI= Received: from nm71.abv.bg (localhost [127.0.0.1]) by nm71.abv.bg (Postfix) with ESMTP id 91C7E1FBD3; Thu, 28 Sep 2017 17:33:34 +0300 (EEST) Date: Thu, 28 Sep 2017 17:33:33 +0300 (EEST) From: "r. r." To: Chesnay Schepler Cc: user@flink.apache.org Message-ID: <380321135.983307.1506609214594.JavaMail.apache@nm71.abv.bg> In-Reply-To: <78884c7a-f1ec-c9c4-58b6-8bcff97dda99@apache.org> References: <1948288594.903371.1506580276898.JavaMail.apache@nm72.abv.bg> <78884c7a-f1ec-c9c4-58b6-8bcff97dda99@apache.org> Subject: Re: how many 'run -c' commands to start? MIME-Version: 1.0 Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: 8bit X-Mailer: AbvMail 3.0 X-Originating-IP: 46.252.142.235 archived-at: Thu, 28 Sep 2017 14:33:39 -0000 Thank you, Chesnay to make sure - should the node where the job has been submitted goes down, the processing will continue, I hope? Do I need to ensure this by configuration? btw I added --detached param to the run cmd, but it didn't go into background process as I would've expected. Am I guessing wrong? Thanks! Rob >-------- Оригинално писмо -------- >От: Chesnay Schepler chesnay@apache.org >Относно: Re: how many 'run -c' commands to start? >До: user@flink.apache.org >Изпратено на: 28.09.2017 15:05 > Hi! > > Given a Flink cluster, you would only call `flink run ...` to submit a > job once; for simplicity i would submit it on the node where you started > the cluster. Flink will automatically distribute job across the cluster, > in smaller independent parts known as Tasks. > > Regards, > Chesnay > > On 28.09.2017 08:31, r. r. wrote: > > Hello > > > > I successfully ran a job with 'flink run -c', but this is for the local > > > > setup. > > > > How should i proceed with a cluster? Will flink automagically instantiate > > > > the job on all servers - i hope i don't have to start 'flink run -c' on all > > > > machines. > > > > New to flink and bigdata, so sorry for the probably silly question > > > > > > > > Thanks! > > > > Rob > > > >