Mailing-List: contact dev-help@spark.apache.org; run by ezmlm
Precedence: bulk
MIME-Version: 1.0
In-Reply-To: <CAHwdYF3ONpH_W8bzPaV+P3DM8Q6v23nPPiQ2y1kAH9jqFecV1A@mail.gmail.com>
References: <CAHwdYF3ONpH_W8bzPaV+P3DM8Q6v23nPPiQ2y1kAH9jqFecV1A@mail.gmail.com>
From: Chetan Khatri <chetan.opensource@gmail.com>
Date: Fri, 23 Dec 2016 23:58:53 +0530
Message-ID: <CA+MEsbBCP9VAzBViLC-RChCNB85G5gH2fii6wnjjd9q18PCGOg@mail.gmail.com>
Subject: Re: Negative number of active tasks
To: Andy Dang <namd88@gmail.com>
Cc: dev@spark.apache.org
Content-Type: multipart/alternative; boundary=001a113c2efee03ae60544578e88
archived-at: Fri, 23 Dec 2016 18:29:04 -0000

--001a113c2efee03ae60544578e88
Content-Type: text/plain; charset=UTF-8

Could you share Pseudo code for the same.

Cheers!

C Khatri.

On Fri, Dec 23, 2016 at 4:33 PM, Andy Dang <namd88@gmail.com> wrote:

> Hi all,
>
> Today I hit a weird bug in Spark 2.0.2 (vanilla Spark) - the executor tab
> shows negative number of active tasks.
>
> I have about 25 jobs, each with 20k tasks so the numbers are not that
> crazy.
>
> What could possibly the cause of this bug? This is the first time I've
> seen it and the only special thing I'm doing is saving multiple datasets at
> the same time to HDFS from different threads.
>
> Thanks,
> Andy
>
>
> ---------------------------------------------------------------------
> To unsubscribe e-mail: dev-unsubscribe@spark.apache.org
>

--001a113c2efee03ae60544578e88
Content-Type: text/html; charset=UTF-8
Content-Transfer-Encoding: quoted-printable

<div dir=3D"ltr">Could you share Pseudo code for the same.<div><br></div><d=
iv>Cheers!</div><div><br></div><div>C Khatri.</div></div><div class=3D"gmai=
l_extra"><br><div class=3D"gmail_quote">On Fri, Dec 23, 2016 at 4:33 PM, An=
dy Dang <span dir=3D"ltr">&lt;<a href=3D"mailto:namd88@gmail.com" target=3D=
"_blank">namd88@gmail.com</a>&gt;</span> wrote:<br><blockquote class=3D"gma=
il_quote" style=3D"margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-lef=
t:1ex"><div dir=3D"ltr">Hi all,<div><br></div><div>Today I hit a weird bug =
in Spark 2.0.2 (vanilla Spark) - the executor tab shows negative number of =
active tasks.</div><div><br></div><div>I have about 25 jobs, each with 20k =
tasks so the numbers are not that crazy.</div><div><br></div><div>What coul=
d possibly the cause of this bug? This is the first time I&#39;ve seen it a=
nd the only special thing I&#39;m doing is saving multiple datasets at the =
same time to HDFS from different threads.</div><div><br clear=3D"all"><div>=
<div class=3D"m_7709173335603518672gmail_signature" data-smartmail=3D"gmail=
_signature"><div dir=3D"ltr"><div><div dir=3D"ltr"><div><div dir=3D"ltr">Th=
anks,</div><div dir=3D"ltr">Andy</div></div></div></div></div></div></div>
</div></div>
<br><br>
------------------------------<wbr>------------------------------<wbr>-----=
----<br>
To unsubscribe e-mail: <a href=3D"mailto:dev-unsubscribe@spark.apache.org">=
dev-unsubscribe@spark.apache.<wbr>org</a><br></blockquote></div><br></div>

--001a113c2efee03ae60544578e88--