Mailing-List: contact common-user-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
Reply-To: common-user@hadoop.apache.org
Received-SPF: neutral (nike.apache.org: local policy)
MIME-Version: 1.0
In-Reply-To: 
 <12CB02B10103F9488CBF215549B77EA80CD5BC@PVSWMAIL2010.pervasive.com>
References: <AANLkTinAELDY3r1zirwyDg2_J=dm8dS8dMDD=8J9VhkU@mail.gmail.com>
 <12CB02B10103F9488CBF215549B77EA80CD5BC@PVSWMAIL2010.pervasive.com>
From: Ted Dunning <tdunning@maprtech.com>
Date: Fri, 18 Feb 2011 14:35:41 -0800
Message-ID: <AANLkTimU-1-_nLuuN2mVC7n9QW2Ss7SzcSnhQZaEV-vd@mail.gmail.com>
Subject: Re: benchmark choices
To: common-user@hadoop.apache.org
Cc: Jim Falgout <jim.falgout@pervasive.com>
Content-Type: multipart/alternative; boundary=90e6ba6e899e7a15d7049c9623e1

--90e6ba6e899e7a15d7049c9623e1
Content-Type: text/plain; charset=ISO-8859-1

I just read the malstone report.  They report times for a Java version that
is many (5x) times slower than for a streaming implementation.  That single
fact indicates that the Java code is so appallingly bad that this is a very
bad benchmark.

On Fri, Feb 18, 2011 at 2:27 PM, Jim Falgout <jim.falgout@pervasive.com>wrote:

> We use MalStone and TeraSort. For Hive, you can use TPC-H, at least the
> data and the queries, if not the query generator. There is a Jira issue in
> Hive that discusses the TPC-H "benchmark" if you're interested. Sorry, I
> don't remember the issue number offhand.
>
> -----Original Message-----
> From: Shrinivas Joshi [mailto:jshrinivas@gmail.com]
> Sent: Friday, February 18, 2011 3:32 PM
> To: common-user@hadoop.apache.org
> Subject: benchmark choices
>
> Which workloads are used for serious benchmarking of Hadoop clusters? Do
> you care about any of the following workloads :
> TeraSort, GridMix v1, v2, or v3, MalStone, CloudBurst, MRBench, NNBench,
> sample apps shipped with Hadoop distro like PiEstimator, dbcount etc.
>
> Thanks,
> -Shrinivas
>
>

--90e6ba6e899e7a15d7049c9623e1--