spark-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Reynold Xin <r...@databricks.com>
Subject Re: Reporting serialized task size after task broadcast change?
Date Fri, 12 Sep 2014 01:33:24 GMT
I didn't know about that ....

On Thu, Sep 11, 2014 at 6:29 PM, Sandy Ryza <sandy.ryza@cloudera.com> wrote:

> It used to be available on the UI, no?
>
> On Thu, Sep 11, 2014 at 6:26 PM, Reynold Xin <rxin@databricks.com> wrote:
>
> > I don't think so. We should probably add a line to log it.
> >
> >
> > On Thursday, September 11, 2014, Sandy Ryza <sandy.ryza@cloudera.com>
> > wrote:
> >
> >> After the change to broadcast all task data, is there any easy way to
> >> discover the serialized size of the data getting sent down for a task?
> >>
> >> thanks,
> >> -Sandy
> >>
> >
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message