hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Thushara Wijeratna <thu...@gmail.com>
Subject Re: child task choking on large (19K) input line
Date Thu, 25 Jun 2009 23:47:18 GMT
done: https://issues.apache.org/jira/browse/HADOOP-6109
i attached the patch as a file (vs submitting) as that is what the doc
suggested.
could you please review it, and if all's well i'll submit it.

thanks,
thushara

On Wed, Jun 17, 2009 at 11:43 AM, Philip Zeyliger <philip@cloudera.com>wrote:

> On Fri, Jun 5, 2009 at 1:41 PM, Thushara Wijeratna<thushw@gmail.com>
> wrote:
> > i fixed this on my system - Text.append degraded for large buffers (225M
> > line could not be processed for over 20 min).
> > the fix was to substitute a ByteArrayOutputStream and now the map/reduce
> > runs in under 30s.
> >
> > should i submit a patch for this? what is the process?
>
> Please do contribute patches!  The instructions are at
> http://wiki.apache.org/hadoop/HowToContribute .  You'll end up
> submitting a JIRA, writing a patch, including some tests (and, for
> performance issues, some performance numbers and steps to reproduce).
>
> -- Philip
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message