flink-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Jean Bez <jeanluca...@gmail.com>
Subject Re: Job Statistics
Date Thu, 18 Jun 2015 14:11:19 GMT
Hi Maximilian,

The metrics am interested in are I/O, run time and communication. Could you
please provide an example of how to obtain such results?

Thank you!!

2015-06-18 10:45 GMT-03:00 Maximilian Michels <mxm@apache.org>:

> Hi Jean,
>
> I think it would be a nice to have feature to display some metrics on the
> command line after a job has completed. We already have the run time and
> the accumulator results available at the CLI and printing those would be
> easy. What metrics in particular are you looking for?
>
> Best,
> Max
>
> On Thu, Jun 18, 2015 at 3:41 PM, Jean Bez <jeanlucabez@gmail.com> wrote:
>
>> Hi Fabian,
>>
>> I am trying to compare some examples on Hadoop, Spark and Flink. If
>> possible I would like to see the job statistics like the report given by
>> Hadoop. Since I am running these examples on a large cluster it would be
>> much better if I could obtain such data directly from the console.
>>
>> Thanks!
>> Jean
>> Em 18/06/2015 04:55, "Fabian Hueske" <fhueske@gmail.com> escreveu:
>>
>>> Hi Jean,
>>>
>>> what kind of job execution stats are you interested in?
>>>
>>> Cheers, Fabian
>>>
>>> 2015-06-18 9:01 GMT+02:00 Matthias J. Sax <mjsax@informatik.hu-berlin.de
>>> >:
>>>
>>>> Hi,
>>>>
>>>> the CLI cannot show any job statistics. However, you can use the
>>>> JobManager web interface that is accessible at port 8081 from a browser.
>>>>
>>>> -Matthias
>>>>
>>>>
>>>> On 06/17/2015 10:13 PM, Jean Bez wrote:
>>>> > Hello,
>>>> >
>>>> > Is it possible to view job statistics after it finished to execute
>>>> > directly in the command line? If so, could you please explain how? I
>>>> > could not find any mentions about this in the docs. I also tried to
>>>> set
>>>> > the logs to debug mode, but no other information was presented.
>>>> >
>>>> > Thank you!
>>>> >
>>>> > Regards,
>>>> > Jean
>>>>
>>>>
>>>
>

Mime
View raw message