Return-Path: X-Original-To: apmail-hadoop-mapreduce-user-archive@minotaur.apache.org Delivered-To: apmail-hadoop-mapreduce-user-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 646B410939 for ; Thu, 7 Nov 2013 06:15:06 +0000 (UTC) Received: (qmail 118 invoked by uid 500); 7 Nov 2013 06:14:59 -0000 Delivered-To: apmail-hadoop-mapreduce-user-archive@hadoop.apache.org Received: (qmail 99698 invoked by uid 500); 7 Nov 2013 06:14:57 -0000 Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hadoop.apache.org Delivered-To: mailing list user@hadoop.apache.org Received: (qmail 99679 invoked by uid 99); 7 Nov 2013 06:14:52 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 07 Nov 2013 06:14:52 +0000 X-ASF-Spam-Status: No, hits=1.5 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of unmeshabiju@gmail.com designates 209.85.220.174 as permitted sender) Received: from [209.85.220.174] (HELO mail-vc0-f174.google.com) (209.85.220.174) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 07 Nov 2013 06:14:48 +0000 Received: by mail-vc0-f174.google.com with SMTP id ld13so60296vcb.33 for ; Wed, 06 Nov 2013 22:14:27 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type; bh=6288NBWnaM6Z7Bvzk88naxLOAaMrMhENF0jLmnXAdfo=; b=mDuFLqBavlT+lMUY5nRaGpBNozTDa6tuO5Hn63KI8m+084bjUR1KkuRhERpT9HGAOw 1VZaRx86KepVFlaD45LnICNOiTXz+myO6CcmXlPnxCSfFVTby71JdhQC9n8Wlnp8tRKG vjNyGF40tpyO9len6l3x5jicwyVf5hgMAXUQqqwqPYjdgMZ0PNCtAtrZaEZShP6NObQF 3ZL+UZoHsSr3Nl0AFWLzMa92Ra/WuoJyl+pPMrpuTPfQKcknan3VfRACyqoN7ajgVaIK Dp8TFHYu/JGVZcexWMFO/08X5j5BPZVEdd4NBHuhOiGfI4FxMJVZYQavYdDquNz17Eak uwYw== MIME-Version: 1.0 X-Received: by 10.220.147.20 with SMTP id j20mr5358619vcv.21.1383804867788; Wed, 06 Nov 2013 22:14:27 -0800 (PST) Received: by 10.59.8.2 with HTTP; Wed, 6 Nov 2013 22:14:27 -0800 (PST) In-Reply-To: References: Date: Thu, 7 Nov 2013 11:44:27 +0530 Message-ID: Subject: Re: Mapper input as argument From: unmesha sreeveni To: User Hadoop Content-Type: multipart/alternative; boundary=047d7b34364e9543c804ea902df3 X-Virus-Checked: Checked by ClamAV on apache.org --047d7b34364e9543c804ea902df3 Content-Type: text/plain; charset=ISO-8859-1 Am i able to get the entire split data from mapper. i dnt need as line by line. my input is of say 50 lines.so these files can be splited into different mappers right. how to get each split data. are we able to get that data? On Thu, Nov 7, 2013 at 11:39 AM, Sonal Goyal wrote: > Hi Unmesha, > > What is the computation you are trying to do? If you are interested in > computing over multiple lines instead of a single line, have a look at > NLineInputFormat. > > Best Regards, > Sonal > Nube Technologies > > > > > > > On Thu, Nov 7, 2013 at 11:35 AM, unmesha sreeveni wrote: > >> one more doubt : how to copy each input split entering into mapper into a >> file for computation? >> >> >> On Thu, Nov 7, 2013 at 10:35 AM, unmesha sreeveni wrote: >> >>> My driver code is >>> FileInputFormat.setInputPaths(job, new Path(args[0])); >>> FileOutputFormat.setOutputPath(job,new Path(args[1])); >>> >>> and My mapper is >>> public void map(Object key, Text value, Context context) >>> throws IOException, InterruptedException { >>> where value.tostring() contains my input data. >>> >>> is that a better way to copy all the data s coming into a file and do >>> computations. OR read each line and do the calculation. >>> >>> -- >>> *Thanks & Regards* >>> >>> Unmesha Sreeveni U.B >>> >>> *Junior Developer* >>> >>> >>> >>> >> >> >> -- >> *Thanks & Regards* >> >> Unmesha Sreeveni U.B >> >> *Junior Developer* >> >> *Amrita Center For Cyber Security * >> >> >> * Amritapuri.www.amrita.edu/cyber/ * >> > > -- *Thanks & Regards* Unmesha Sreeveni U.B *Junior Developer* *Amrita Center For Cyber Security* * Amritapuri.www.amrita.edu/cyber/ * --047d7b34364e9543c804ea902df3 Content-Type: text/html; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable
Am i able to get the entire split data from mapper. i dnt need = as line by line.

my input is of say 50 lines.so these files can be splited into differe= nt mappers right. how to get each split data. are we able to get that data?=


On Thu,= Nov 7, 2013 at 11:39 AM, Sonal Goyal <sonalgoyal4@gmail.com> wrote:
Hi Unmesha,

<= div>What is the computation you are trying to do? If you are interested in = computing over multiple lines instead of a single line, have a look at NLin= eInputFormat.=A0

Best Regards,
Sonal
Nube Technologies=A0






On Thu, Nov 7, 2013 at 11:35 AM, unmesha= sreeveni <unmeshabiju@gmail.com> wrote:
one more doubt : how to copy each input split entering into map= per into a file for computation?


On Thu, Nov 7, 2013 at 10:35 AM, unmesha sreeveni <unmeshabiju@gmail.c= om> wrote:
My driver code is=A0
=A0 =A0 =A0 =A0 =A0= =A0 =A0 =A0 FileInputFormat.setInputPaths(job, new Path(args[0]));<= /div>
FileOutputFormat.setOutputPath(job,new P= ath(args[1]));

and My mapper is=A0
=A0 =A0 =A0 =A0 public void map(Object key, Text value, Conte= xt context)
throws IOExcept= ion, InterruptedException {
where value= .tostring() contains my input data.

is that a better way to copy all the data s coming into a file and do comp= utations. OR read each line and do the calculation.

--
Thanks & Regards

Unmesha Sreeveni U.B
Junior Developer





--
=
Thanks & Reg= ards

Unmesha Sreeveni U.B
Junior Developer
Amrita Center For Cyber Security




--
Thanks & Regards

Unmesha Sreeveni U.B
Junior Developer
Amrita Center For Cyber Security
--047d7b34364e9543c804ea902df3--