Mailing-List: contact common-user-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
Reply-To: common-user@hadoop.apache.org
Received-SPF: neutral (athena.apache.org: 98.139.253.104 is neither permitted
 nor denied by domain of amarrk@yahoo-inc.com)
From: Amar Kamat <amarrk@yahoo-inc.com>
To: "common-user@hadoop.apache.org" <common-user@hadoop.apache.org>,
        "hadoop-user@lucene.apache.org" <hadoop-user@lucene.apache.org>
Date: Sat, 3 Dec 2011 13:14:20 +0530
Subject: Re: Availability of Job traces or logs
Thread-Topic: Availability of Job traces or logs
Thread-Index: Acyv1/2WsqZ/UJZPRUmNBjeNeTii+ABt2BHP
Message-ID: <CAFFD12C.2998C%amarrk@yahoo-inc.com>
In-Reply-To: <1322709494451-3550462.post@n3.nabble.com>
Accept-Language: en-US
Content-Language: en
acceptlanguage: en-US
Content-Type: multipart/alternative;
	boundary="_000_CAFFD12C2998Camarrkyahooinccom_"
MIME-Version: 1.0

--_000_CAFFD12C2998Camarrkyahooinccom_
Content-Type: text/plain; charset="iso-8859-1"
Content-Transfer-Encoding: quoted-printable

Arun,
You can very well run synthetic workloads like large scale sort, wordcount =
etc or more realistic workloads like PigMix (https://cwiki.apache.org/confl=
uence/display/PIG/PigMix). On a decent enough cluster, these workloads work=
 pretty well. Is there a specific reason why you want traces of varied size=
s from various organizations?

> How can i make sure that the rumen generates only say 25 jobs,50 jobs or =
so
Do you want to get 25/50 jobs based on some filtering criterion? I recently=
 faced a similar situation where I wanted to extract jobs from a Rumen trac=
e based on job ids. I will be happy to share these filtering tools.

Amar


On 12/1/11 8:48 AM, "ArunKumar" <arunk786@gmail.com> wrote:

Hi guys !

Apart from generating the job traces from RUMEN , can i get logs or job
traces of varied sizes from some organizations.

How can i make sure that the rumen generates only say 25 jobs,50 jobs or so
?


Thanks,
Arun

--
View this message in context: http://lucene.472066.n3.nabble.com/Availabili=
ty-of-Job-traces-or-logs-tp3550462p3550462.html
Sent from the Hadoop lucene-users mailing list archive at Nabble.com.


--_000_CAFFD12C2998Camarrkyahooinccom_--