Return-Path: X-Original-To: apmail-spark-user-archive@minotaur.apache.org Delivered-To: apmail-spark-user-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 2E6AC17F00 for ; Mon, 23 Feb 2015 11:31:14 +0000 (UTC) Received: (qmail 98973 invoked by uid 500); 23 Feb 2015 11:30:37 -0000 Delivered-To: apmail-spark-user-archive@spark.apache.org Received: (qmail 98898 invoked by uid 500); 23 Feb 2015 11:30:37 -0000 Mailing-List: contact user-help@spark.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Delivered-To: mailing list user@spark.apache.org Received: (qmail 98885 invoked by uid 99); 23 Feb 2015 11:30:37 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 23 Feb 2015 11:30:37 +0000 X-ASF-Spam-Status: No, hits=1.5 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of shahab.mokari@gmail.com designates 209.85.212.175 as permitted sender) Received: from [209.85.212.175] (HELO mail-wi0-f175.google.com) (209.85.212.175) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 23 Feb 2015 11:30:33 +0000 Received: by mail-wi0-f175.google.com with SMTP id r20so16047368wiv.2 for ; Mon, 23 Feb 2015 03:27:57 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; bh=HZf7pU3r36gLAhI2vBClXdaXL5iu/2VpdK8/NTntlVA=; b=UtQXzAA3WXKooSKWhXTW2X7yKaHoDlZRHoQmd0c8xuTt7DAqS75ZsmdVW1ICWvLgCy M2zWl7ebGiIP3Kr2sf/uhHnnUoQu7NGGjKA7/eiOK4caCsvOKCyebzQQK8P7c4LvyoK9 Ha/TTQGLB89rmQ27mFL2QnBPjfDCrMavuFM3BNGGhIkXJOvEAbIan1tseT5NIYJHtGa5 I/jH0jZInhBoL054FVRaETA62LP3giJQo8cn09m9v6wYvaed/HnI/eimLwPpESYDCJd5 ktE9xOR+PQUFVSULzIdg11TXCuavbRdLbIb5h7F8OIdGxiAqVF2Nehi2Zq5If4OAEdzj JncQ== MIME-Version: 1.0 X-Received: by 10.194.223.5 with SMTP id qq5mr21644176wjc.152.1424690877528; Mon, 23 Feb 2015 03:27:57 -0800 (PST) Received: by 10.27.32.194 with HTTP; Mon, 23 Feb 2015 03:27:57 -0800 (PST) In-Reply-To: References: Date: Mon, 23 Feb 2015 12:27:57 +0100 Message-ID: Subject: Re: what does "Submitting ... missing tasks from Stage" mean? From: shahab To: Imran Rashid Cc: "user@spark.apache.org" Content-Type: multipart/alternative; boundary=001a11c39ce2ab81c2050fbfb126 X-Virus-Checked: Checked by ClamAV on apache.org --001a11c39ce2ab81c2050fbfb126 Content-Type: text/plain; charset=UTF-8 Thanks Imran, but I do appreciate if you explain what this mean and what are the reasons make it happening. I do need it. If there is any documentation somewhere you can simply direct me there so I can try to understand it myself. best, /Shahab On Sat, Feb 21, 2015 at 12:26 AM, Imran Rashid wrote: > yeah, this is just the totally normal message when spark executes > something. The first time something is run, all of its tasks are > "missing". I would not worry about cases when all tasks aren't "missing" > if you're new to spark, its probably an advanced concept that you don't > care about. (and would take me some time to explain :) > > On Fri, Feb 20, 2015 at 8:20 AM, shahab wrote: > >> Hi, >> >> Probably this is silly question, but I couldn't find any clear >> documentation explaining why one should "submitting... missing tasks from >> Stage ..." in the logs? >> >> Specially in my case when I do not have any "failure" in job execution, I >> wonder why this should happen? >> Does it have any relation to lazy evaluation? >> >> best, >> /Shahab >> > > --001a11c39ce2ab81c2050fbfb126 Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: quoted-printable
Thanks Imran, but I do appreciate if you explain what this= mean and what are the reasons make it happening. I do need it.
If ther= e is any documentation somewhere you can simply direct me there so =C2=A0I = can try to understand it myself.=C2=A0

best,
/Shahab

On Sat, Feb 21, 2015 at 12:26 AM, Imran Rashid <irashid@clou= dera.com> wrote:
yeah, this is just the totally normal message when spark executes = something.=C2=A0 The first time something is run, all of its tasks are &quo= t;missing".=C2=A0 I would not worry about cases when all tasks aren= 9;t "missing" if you're new to spark, its probably an advance= d concept that you don't care about. =C2=A0(and would take me some time= to explain :)

On Fri, Feb 20, 2015 at 8:20 AM,= shahab <shahab.mokari@gmail.com> wrote:
Hi,

Probably this = is silly question, but I couldn't find any clear documentation explaini= ng why =C2=A0one =C2=A0should "submitting... missing tasks from Stage = ..." in the logs?

Specially in my case when I= do not have any "failure" in job execution, I wonder why this sh= ould happen?
Does it have any relation to lazy evaluation?
<= div>
best,
/Shahab


--001a11c39ce2ab81c2050fbfb126--