Mailing-List: contact general-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
Reply-To: general@hadoop.apache.org
Received-SPF: pass (nike.apache.org: domain of vermaabhishekp@gmail.com
 designates 74.125.82.48 as permitted sender)
DomainKey-Signature: a=rsa-sha1; c=nofws;
        d=gmail.com; s=gamma;
        h=mime-version:sender:date:x-google-sender-auth:message-id:subject
         :from:to:content-type;
        b=XxGI6lK/cjLSiGhbrkSC450S5b/wsmtbNkb2ZHbZVcDqEFb8PhE8PoEliYGpOVdtqL
         SRKsU9h7IJayTXi0iZZ7lCqU8b802PwaE0MD2UbIo3dOZ6BVquogR9s5BEdVKbq+uI/M
         K18gyweMcpuZP1tGn7QeuBRbzM5ZU/VjofN9Y=
MIME-Version: 1.0
Sender: vermaabhishekp@gmail.com
Date: Tue, 25 Jan 2011 21:50:03 -0600
Message-ID: <AANLkTinxwQXxkbNk1Cy4T=P5pHj6mxuTrORc-7nJT279@mail.gmail.com>
Subject: Hadoop job logs for research
From: Abhishek Verma <verma7@illinois.edu>
To: general@hadoop.apache.org
Content-Type: multipart/alternative; boundary=0016e6deddc864d12f049ab7ba22

--0016e6deddc864d12f049ab7ba22
Content-Type: text/plain; charset=ISO-8859-1

Hi fellow Hadoop users and developers,

I am a third year PhD student at the University of Illinois and am working
on improving workload management and scheduling in Hadoop. I have tested
some of my ideas on synthetic workloads, GridMix, hadoop-examples and a few
of my own applications. I am looking for real workloads that are executed in
the industry. Specifically, I am interested in the job logs (stored by
default on the JobTracker) of real workloads. If people are concerned about
the confidentiality of the application, I would like to mention that these
logs contain very little information about the processed data or the
application itself. Anonymizing the job names (and their submission times,
etc.) would not be too much of a problem.

I would love to collaborate with folks from the industry in understanding
these workloads. I sincerely hope that the research that I am conducting
will benefit everybody.

Thanks a lot.
-Abhishek.

--0016e6deddc864d12f049ab7ba22--