hadoop-pig-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "pi song" <pi.so...@gmail.com>
Subject Re: Slow unit testing
Date Mon, 12 May 2008 14:29:30 GMT
After looking at the log files:-
1) It is not between tests but within the tests. Just my screen is updating
too slowly.
2) My log files look very messy. Is your file as messy as mine?

Pi

On Tue, May 13, 2008 at 12:20 AM, pi song <pi.songs@gmail.com> wrote:

> This started to happen since the introduction of Hadoop16 (which includes
> changes in HOD). The time shown in ANT-Junit is not accurate. What I can see
> here is that  time spent doing nothing between each tests is long but not
> taken into account.
>
> Is it possible to be something to do with connecting to HOD?
>
>     [junit] Tests run: 8, Failures: 0, Errors: 0, Time elapsed: 262.014
> sec
>     [junit] Running org.apache.pig.test.TestFilterOpString
>     [junit] Tests run: 6, Failures: 0, Errors: 0, Time elapsed: 234.839
> sec
>     [junit] Running org.apache.pig.test.TestGrunt
>     [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 0.159 sec
>
> Pi
>
>
> On Tue, May 13, 2008 at 12:15 AM, pi song <pi.songs@gmail.com> wrote:
>
> > Already more than 40 minutes.
> >
> >
> > On Tue, May 13, 2008 at 12:10 AM, Olga Natkovich <olgan@yahoo-inc.com>
> > wrote:
> >
> > > I run the tests on the regular basis and don't see a proble. MR tests
> > > take about 20 minites for me. How long does it take for you?
> > >
> > > Olga
> > >
> > > > -----Original Message-----
> > > > From: pi song [mailto:pi.songs@gmail.com]
> > > > Sent: Monday, May 12, 2008 6:57 AM
> > > > To: pig-dev@incubator.apache.org
> > > > Subject: Slow unit testing
> > > >
> > > > It has been a while since we moved from Hadoop15 to Hadoop16
> > > > that all the MapReduce unit tests run significantly slower
> > > > than before (at least 2-3x).
> > > > What is the reason behind this? Is there a way to fix?
> > > >
> > > > Since everyone has to run at least a full test before
> > > > submitting a patch.
> > > > This is not productive from developer's point of view.
> > > >
> > > > Pi
> > > >
> > >
> >
> >
>

Mime
View raw message