spark-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Chetan Khatri <chetan.opensou...@gmail.com>
Subject Re: Negative number of active tasks
Date Fri, 23 Dec 2016 18:28:53 GMT
Could you share Pseudo code for the same.

Cheers!

C Khatri.

On Fri, Dec 23, 2016 at 4:33 PM, Andy Dang <namd88@gmail.com> wrote:

> Hi all,
>
> Today I hit a weird bug in Spark 2.0.2 (vanilla Spark) - the executor tab
> shows negative number of active tasks.
>
> I have about 25 jobs, each with 20k tasks so the numbers are not that
> crazy.
>
> What could possibly the cause of this bug? This is the first time I've
> seen it and the only special thing I'm doing is saving multiple datasets at
> the same time to HDFS from different threads.
>
> Thanks,
> Andy
>
>
> ---------------------------------------------------------------------
> To unsubscribe e-mail: dev-unsubscribe@spark.apache.org
>

Mime
View raw message