spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From shahab <shahab.mok...@gmail.com>
Subject Re: what does "Submitting ... missing tasks from Stage" mean?
Date Mon, 23 Feb 2015 11:27:57 GMT
Thanks Imran, but I do appreciate if you explain what this mean and what
are the reasons make it happening. I do need it.
If there is any documentation somewhere you can simply direct me there so
 I can try to understand it myself.

best,
/Shahab

On Sat, Feb 21, 2015 at 12:26 AM, Imran Rashid <irashid@cloudera.com> wrote:

> yeah, this is just the totally normal message when spark executes
> something.  The first time something is run, all of its tasks are
> "missing".  I would not worry about cases when all tasks aren't "missing"
> if you're new to spark, its probably an advanced concept that you don't
> care about.  (and would take me some time to explain :)
>
> On Fri, Feb 20, 2015 at 8:20 AM, shahab <shahab.mokari@gmail.com> wrote:
>
>> Hi,
>>
>> Probably this is silly question, but I couldn't find any clear
>> documentation explaining why  one  should "submitting... missing tasks from
>> Stage ..." in the logs?
>>
>> Specially in my case when I do not have any "failure" in job execution, I
>> wonder why this should happen?
>> Does it have any relation to lazy evaluation?
>>
>> best,
>> /Shahab
>>
>
>

Mime
View raw message