Mailing-List: contact user-help@flink.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@flink.apache.org
MIME-Version: 1.0
In-Reply-To: 
 <CAC27z=NXHVS8hRyYxApeJ2c4_v=FRCm7c3gXSm5r9HztRD7qGw@mail.gmail.com>
References: 
 <CAO0MGUjOybaL10=kschgTJnjfLjARM1yF-mwExzfD+rHaS7HPA@mail.gmail.com>
 <CAC27z=NXHVS8hRyYxApeJ2c4_v=FRCm7c3gXSm5r9HztRD7qGw@mail.gmail.com>
From: Ufuk Celebi <uce@apache.org>
Date: Tue, 26 Apr 2016 10:02:29 +0200
Message-ID: 
 <CAKiyyaFBxMLOAStQAdBkCF37bcNd_f0a0hu2kw+tYh94JnLCtA@mail.gmail.com>
Subject: Re: Job hangs
To: user@flink.apache.org
Content-Type: text/plain; charset=UTF-8
Content-Transfer-Encoding: quoted-printable

Hey Timur,

is it possible to connect to the VMs and get stack traces of the Flink
processes as well?

We can first have a look at the logs, but the stack traces will be
helpful if we can't figure out what the issue is.

=E2=80=93 Ufuk

On Tue, Apr 26, 2016 at 9:42 AM, Till Rohrmann <trohrmann@apache.org> wrote=
:
> Could you share the logs with us, Timur? That would be very helpful.
>
> Cheers,
> Till
>
> On Apr 26, 2016 3:24 AM, "Timur Fayruzov" <timur.fairuzov@gmail.com> wrot=
e:
>>
>> Hello,
>>
>> Now I'm at the stage where my job seem to completely hang. Source code i=
s
>> attached (it won't compile but I think gives a very good idea of what
>> happens). Unfortunately I can't provide the datasets. Most of them are a=
bout
>> 100-500MM records, I try to process on EMR cluster with 40 tasks 6GB mem=
ory
>> for each.
>>
>> It was working for smaller input sizes. Any idea on what I can do
>> differently is appreciated.
>>
>> Thans,
>> Timur