Mailing-List: contact dev-help@reef.apache.org; run by ezmlm
Precedence: bulk
Reply-To: dev@reef.apache.org
From: Saikat Kanjilal <sxk1969@gmail.com>
Content-Type: text/plain;
	charset=us-ascii
Content-Transfer-Encoding: quoted-printable
Mime-Version: 1.0 (1.0)
Date: Thu, 16 Feb 2017 20:07:40 -0800
Subject: Re: 0.16?
Message-Id: <936B6E93-C753-4917-9CAC-A81910BC9948@gmail.com>
References: <CAOFpRGCPC7c7RKbqDc3N6yf4=qLCQ0-Y68_g+F9PneEZP8VWnQ@mail.gmail.com> <MWHPR21MB0703C34B7CA88FCFC150B077D25A0@MWHPR21MB0703.namprd21.prod.outlook.com> <CAJ3duG5cfzkZE6MCsv1PPAJ5ebWp37g-=zxur1GO9hb+0w333A@mail.gmail.com> <91579B44-6C9C-4FA9-8DB3-4FEF0C0D5DC3@gmail.com> <C0263B6A-7CF0-4BBC-89B8-E65A01851E56@gmail.com> <CAJ3duG60OXYuNYKVLTme9qqScopR5eQkCtGR5dMSFPmyZgyupw@mail.gmail.com> <4B2CA4CF-7891-4D66-B07F-D1CF4D2EC6D5@gmail.com> <CAJ3duG4P+K=K0rUMt96HupVh4H0KWnRzaaTup6fz+irgWpiROA@mail.gmail.com>
In-Reply-To: <CAJ3duG4P+K=K0rUMt96HupVh4H0KWnRzaaTup6fz+irgWpiROA@mail.gmail.com>
To: dev@reef.apache.org
archived-at: Fri, 17 Feb 2017 04:07:49 -0000

Sergei,
I definitely have more experience with Java than .Net, maybe this is a JIRA t=
hat I also add to my collection and help you, might be a good case for pair c=
oding as well, let me know how you want to move forward.
Thanks

Sent from my iPad

> On Feb 16, 2017, at 6:23 PM, Sergiy Matusevych <sergiy.matusevych@gmail.co=
m> wrote:
>=20
> Hi Saikat,
>=20
> The cleanup work is purely Java, so if you are working on the .NET side of=

> things, I don't see much sense to switch the environment just for these
> issues. Still, it would be nice to get some help - maybe there are
> volunteers willing to debug some race conditions in Java and on YARN?
>=20
> Thank you,
> Sergiy.
>=20
>> On Thu, Feb 16, 2017 at 6:11 PM, Saikat Kanjilal <sxk1969@gmail.com> wrot=
e:
>>=20
>> Me and my big mouth :))))), just kidding, I am already working on .Net
>> core 2.0 conversion JIRA's , what sort of dev/test help can I provide?
>>=20
>> Sent from my iPhone
>>=20
>>> On Feb 16, 2017, at 5:41 PM, Sergiy Matusevych <
>> sergiy.matusevych@gmail.com> wrote:
>>>=20
>>> Hi Saikat,
>>>=20
>>> The failures are sporadic and most likely are due to some race condition=
s
>>> during the cleanup process. You don't need CI to replicate them, but we
>>> need to debug the issues not only in local mode, but also on YARN (and,
>>> ideally, for all other runtimes that we provide). A good indicator of
>>> successful cleanup would be JIRA issue
>>> https://issues.apache.org/jira/browse/REEF-1715 - when all threads are
>>> closed properly, we would no longer need System.exit() call at the end o=
f
>>> the Driver or Evaluator processes (regardless of the runtime). Would you=

>> be
>>> interested in helping me with that part?
>>>=20
>>> Thank you,
>>> Sergiy.
>>>=20
>>>=20
>>>> On Thu, Feb 16, 2017 at 5:29 PM, Saikat Kanjilal <sxk1969@gmail.com>
>> wrote:
>>>>=20
>>>> Out of curiosity have we been able to replicate these failures locally ,=

>>>> am wondering whether there's a need to have a local version of Travis c=
i
>>>> setup?
>>>>=20
>>>> Sent from my iPhone
>>>>=20
>>>>> On Feb 16, 2017, at 5:22 PM, Boris Shulman <shulmanb@gmail.com> wrote:=

>>>>>=20
>>>>> Is AM HA part of 0.16?
>>>>>=20
>>>>> Sent from my iPhone
>>>>>=20
>>>>>> On Feb 16, 2017, at 12:22 PM, Sergiy Matusevych <
>>>> sergiy.matusevych@gmail.com> wrote:
>>>>>>=20
>>>>>> Hi Markus,
>>>>>>=20
>>>>>> I think we can safely announce that Unmanaged AM and REEF-on-REEF wil=
l
>>>> be
>>>>>> part of 0.16, but the bugs that Mariia mentions prevent us from
>> calling
>>>>>> this release REEF-as-a-Library. Even for the unmanaged AM, I need som=
e
>>>> time
>>>>>> (likely till the end of this sprint) to make sure that Unmanaged AM
>>>> works
>>>>>> properly on Hadoop 2.7.3 and above.
>>>>>>=20
>>>>>> Thanks,
>>>>>> Sergiy.
>>>>>>=20
>>>>>> On Thu, Feb 16, 2017 at 9:43 AM, Mariia Mykhailova <
>>>>>> mamykhai@microsoft.com.invalid> wrote:
>>>>>>=20
>>>>>>> There are several transient test failures in both Java and .NET test=
s
>>>> and
>>>>>>> Travis CI job timeout (which indicates hidden problems in terminatin=
g
>>>> Java
>>>>>>> REEF jobs) which we've introduced since 0.15. I don't think we shoul=
d
>>>> do a
>>>>>>> release with these issues uninvestigated, especially Travis timeout.=

>>>> For
>>>>>>> now I've marked them as blocking REEF-1444.
>>>>>>>=20
>>>>>>> -Mariia
>>>>>>>=20
>>>>>>>=20
>>>>>>> ________________________________
>>>>>>> From: Markus Weimer <markus@weimo.de>
>>>>>>> Sent: Thursday, February 16, 2017 9:31:35 AM
>>>>>>> To: REEF Developers Mailinglist
>>>>>>> Subject: 0.16?
>>>>>>>=20
>>>>>>> Hi,
>>>>>>>=20
>>>>>>> where are we in the process of releasing 0.16? In other words: If we=

>>>> called
>>>>>>> the release today, what amazing feature that is on the cusp of
>> getting
>>>> in
>>>>>>> would we loose?
>>>>>>>=20
>>>>>>> I'm not suggesting to literally do it today, but a release around th=
e
>>>> VS
>>>>>>> 2017 availability would be convenient for us to switch to the new
>> build
>>>>>>> system and all early in the works towards 0.17.
>>>>>>>=20
>>>>>>> Markus
>>>>>>>=20
>>>>=20
>>=20