hadoop-pig-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Olga Natkovich" <ol...@yahoo-inc.com>
Subject RE: Hadoop setup for pig development
Date Wed, 09 Jan 2008 19:51:51 GMT
Hi Charlie,

Yes, currently the total unit test set takes about 40 minutes to


> -----Original Message-----
> From: Charlie Groves [mailto:charlie@threerings.net] 
> Sent: Wednesday, January 09, 2008 11:48 AM
> To: pig-dev@incubator.apache.org
> Subject: Hadoop setup for pig development
> I'm using a local, single-node hadoop cluster to run pig's 
> tests as I work on it.  Is this the preferred way to run the 
> tests?  I ask because with this setup it takes several 
> minutes for many of the tests to complete, which is different 
> than the normal quick unit test cycle I'm used to.
> I have set mapred.map.max.attempts and 
> mapred.reduce.max.attempts to 1, so if I do break something, 
> it fails after one attempt rather than several.  Is there 
> anything else I can tweak in the setup to speed things up?
> Thanks,
> Charlie

View raw message