Return-Path: X-Original-To: apmail-hadoop-common-user-archive@www.apache.org Delivered-To: apmail-hadoop-common-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 210B710DDC for ; Sat, 11 Jan 2014 16:20:07 +0000 (UTC) Received: (qmail 66487 invoked by uid 500); 11 Jan 2014 16:17:12 -0000 Delivered-To: apmail-hadoop-common-user-archive@hadoop.apache.org Received: (qmail 66408 invoked by uid 500); 11 Jan 2014 16:16:59 -0000 Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hadoop.apache.org Delivered-To: mailing list user@hadoop.apache.org Received: (qmail 66393 invoked by uid 99); 11 Jan 2014 16:16:56 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Sat, 11 Jan 2014 16:16:56 +0000 X-ASF-Spam-Status: No, hits=1.5 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of chris.mawata@gmail.com designates 209.85.223.177 as permitted sender) Received: from [209.85.223.177] (HELO mail-ie0-f177.google.com) (209.85.223.177) by apache.org (qpsmtpd/0.29) with ESMTP; Sat, 11 Jan 2014 16:16:50 +0000 Received: by mail-ie0-f177.google.com with SMTP id ar20so2120800iec.8 for ; Sat, 11 Jan 2014 08:16:29 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type; bh=7SnuPUqp/xxYC4PPTwj7Rvo7HtrSy5M+tDKGF2E/1bk=; b=HHEWa6a2lmazze/Q06CTVoFSnETvgeR+Fwehz9rtBj5oZ/MQ9GyGmt6g2YBoUPtCMy DI8Ssss0YVp/gSvxbJ8yomnv6DwD7NL6bHEpgEJdEdwBKymi8xt1sshI5BgQr0J8G8Wb XyG6S9daz8iLR611E5ppVHG77JVL65NEf1XSIwKnGO2eI4Ehfjkp6t+MyPvSDulIxVs5 dUYz/+IlYGYI45opsRaqSXA9EPIs3Y7sHd0wIvISPAt6aSgImwry3X0/itqD/4/Z9eSt etrVmAFxXmn0h/PsnEkBruOD64mX8BWIYrUz0kdgdoYsFNAeFqpPO0NXg1eTYOY5adpH PZ5w== MIME-Version: 1.0 X-Received: by 10.43.163.3 with SMTP id mm3mr1545068icc.63.1389456989246; Sat, 11 Jan 2014 08:16:29 -0800 (PST) Received: by 10.50.221.164 with HTTP; Sat, 11 Jan 2014 08:16:29 -0800 (PST) Received: by 10.50.221.164 with HTTP; Sat, 11 Jan 2014 08:16:29 -0800 (PST) In-Reply-To: References: <52CD6546.1010807@gmail.com> Date: Sat, 11 Jan 2014 11:16:29 -0500 Message-ID: Subject: Re: what all can be done using MR From: Chris Mawata To: user@hadoop.apache.org Content-Type: multipart/alternative; boundary=001a11c2fafe465aab04efb42ad1 X-Virus-Checked: Checked by ClamAV on apache.org --001a11c2fafe465aab04efb42ad1 Content-Type: text/plain; charset=ISO-8859-1 Results will be sorted by key so make A the key and put the rest in the value Chris On Jan 11, 2014 10:11 AM, "unmesha sreeveni" wrote: > What about sorting . > Acutually it is done by MapReduce itself. > But if we are giving a csv file as input and trying to sort one/multiple > column...Whether the corresponting columns also get reflectted?? > > eg: foo.csv > B,2,3 > A,4,6 > > When we apply sorting to first column:whether the resultent will be > A,4,6 > B,2,3 > A will be mapped to its correct values right? > If so what will be context.write() of mapper? > > > On Wed, Jan 8, 2014 at 8:18 PM, Chris Mawata wrote: > >> Yes. >> Check out, for example, >> http://packtlib.packtpub.com/library/hadoop-mapreduce-cookbook/ch06lvl1sec66# >> >> >> >> On 1/8/2014 2:41 AM, unmesha sreeveni wrote: >> >> Can we do aggregation with in Hadoop MR >> like find min,max,sum,avg of a column in a csv file. >> >> -- >> *Thanks & Regards* >> >> Unmesha Sreeveni U.B >> Junior Developer >> >> http://www.unmeshasreeveni.blogspot.in/ >> >> >> >> > > > -- > *Thanks & Regards* > > Unmesha Sreeveni U.B > Junior Developer > > http://www.unmeshasreeveni.blogspot.in/ > > > --001a11c2fafe465aab04efb42ad1 Content-Type: text/html; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable

Results will be sorted by key so make A the key and put the = rest in the value
Chris

On Jan 11, 2014 10:11 AM, "unmesha sreeveni= " <unmeshabiju@gmail.com> wrote:
What about sorting .
Acutually it is done by MapReduce itself.<= /div>
But if we are giving a csv file as input and trying to sort one/multiple co= lumn...Whether the corresponting columns also get reflectted??

eg: foo.csv
=A0B,2,3
A,4,6

When we apply sorting to first column:whether the resultent will be
A,= 4,6
B,2,3=
A will be mapped to its correct values right?
If so what will be context.write() of mapper?


On Wed, Jan 8, 2014 at 8:18 PM,= Chris Mawata <chris.mawata@gmail.com> wrote:
=20 =20 =20
Yes.
Check out, for example, http://packtlib.packtpub.com/library/hadoo= p-mapreduce-cookbook/ch06lvl1sec66#


=A0
On 1/8/2014 2:41 AM, unmesha sreeveni wrote:
Can we do aggregation with in Hadoop MR
like find min,max,sum,avg of a column in a csv file.

--
Thanks & Regards

Unmesha Sreeveni U.B
Junior Developer







--
Thanks & Regards

Unmesha Sreeveni U.B
Junior Developer

http:= //www.unmeshasreeveni.blogspot.in/


--001a11c2fafe465aab04efb42ad1--