Mailing-List: contact mapreduce-user-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
Reply-To: mapreduce-user@hadoop.apache.org
Received-SPF: pass (nike.apache.org: domain of psdc1978@gmail.com designates
 74.125.82.48 as permitted sender)
Subject: Re: Streaming in mapreduce
References: <EFC30C88-A6C5-4D7C-BE5D-CB3910A43ED5@gmail.com>
 <CACBYqwT8dRZbTmNoPtDCY_7Yf=uYP22_KvtN2OPfECy1PX9ciQ@mail.gmail.com>
From: Pedro Costa <psdc1978@gmail.com>
Content-Type: multipart/alternative;
	boundary=Apple-Mail-7D576DAF-50DE-4219-9D60-961404491DA1
In-Reply-To: 
 <CACBYqwT8dRZbTmNoPtDCY_7Yf=uYP22_KvtN2OPfECy1PX9ciQ@mail.gmail.com>
Message-Id: <403191DC-12AE-4920-9AEC-18FF24685340@gmail.com>
Date: Sat, 16 Jun 2012 10:23:20 +0100
To: "mapreduce-user@hadoop.apache.org" <mapreduce-user@hadoop.apache.org>
Content-Transfer-Encoding: 7bit
Mime-Version: 1.0 (1.0)


--Apple-Mail-7D576DAF-50DE-4219-9D60-961404491DA1
Content-Transfer-Encoding: quoted-printable
Content-Type: text/plain;
	charset=us-ascii

I still don't get why hadoop streaming is useful. If I have man and reduce f=
unctions defined in shell script, like the one below, why should I use Hadoo=
p?
cat someInputFile | shellMapper.sh | shellReducer.sh > someOutputFile


On 16/06/2012, at 01:21, Ruslan Al-Fakikh <metaruslan@gmail.com> wrote:

> Hi Pedro,
>=20
> You can find it here
> http://wiki.apache.org/hadoop/HadoopStreaming
>=20
> Thanks
>=20
> On Sat, Jun 16, 2012 at 2:46 AM, Pedro Costa <psdc1978@gmail.com> wrote:
>> Hi,
>>=20
>> Hadoop mapreduce can be used for streaming. But what is streaming from th=
e point of view of mapreduce? For me, streaming are video and audio data.
>>=20
>>  Why mapreduce supports streaming?
>>=20
>> Can anyone give me an example on why to use streaming in mapreduce?
>>=20
>> Thanks,
>> Pedro

--Apple-Mail-7D576DAF-50DE-4219-9D60-961404491DA1
Content-Transfer-Encoding: quoted-printable
Content-Type: text/html;
	charset=utf-8

<html><head></head><body bgcolor=3D"#FFFFFF"><div>I still don't get why hado=
op streaming is useful. If I have man and reduce functions defined in shell s=
cript, like the one below, why should I use Hadoop?<br><pre style=3D"border-=
top-width: 1pt; border-right-width: 1pt; border-bottom-width: 1pt; border-le=
ft-width: 1pt; border-top-style: solid; border-right-style: solid; border-bo=
ttom-style: solid; border-left-style: solid; border-top-color: rgb(174, 189,=
 204); border-right-color: rgb(174, 189, 204); border-bottom-color: rgb(174,=
 189, 204); border-left-color: rgb(174, 189, 204); background-color: rgb(243=
, 245, 247); padding-top: 5pt; padding-right: 5pt; padding-bottom: 5pt; padd=
ing-left: 5pt; word-wrap: break-word; "><font class=3D"Apple-style-span" fac=
e=3D"Helvetica"><span class=3D"Apple-style-span" style=3D"white-space: norma=
l;">cat someInputFile | shellMapper.sh | shellReducer.sh &gt; someOutputFile=
</span></font></pre><div><br></div></div><div><br>On 16/06/2012, at 01:21, R=
uslan Al-Fakikh &lt;<a href=3D"mailto:metaruslan@gmail.com">metaruslan@gmail=
.com</a>&gt; wrote:<br><br></div><div></div><blockquote type=3D"cite"><div><=
span>Hi Pedro,</span><br><span></span><br><span>You can find it here</span><=
br><span><a href=3D"http://wiki.apache.org/hadoop/HadoopStreaming">http://wi=
ki.apache.org/hadoop/HadoopStreaming</a></span><br><span></span><br><span>Th=
anks</span><br><span></span><br><span>On Sat, Jun 16, 2012 at 2:46 AM, Pedro=
 Costa &lt;<a href=3D"mailto:psdc1978@gmail.com">psdc1978@gmail.com</a>&gt; w=
rote:</span><br><blockquote type=3D"cite"><span>Hi,</span><br></blockquote><=
blockquote type=3D"cite"><span></span><br></blockquote><blockquote type=3D"c=
ite"><span>Hadoop mapreduce can be used for streaming. But what is streaming=
 from the point of view of mapreduce? For me, streaming are video and audio d=
ata.</span><br></blockquote><blockquote type=3D"cite"><span></span><br></blo=
ckquote><blockquote type=3D"cite"><span>&nbsp;Why mapreduce supports streami=
ng?</span><br></blockquote><blockquote type=3D"cite"><span></span><br></bloc=
kquote><blockquote type=3D"cite"><span>Can anyone give me an example on why t=
o use streaming in mapreduce?</span><br></blockquote><blockquote type=3D"cit=
e"><span></span><br></blockquote><blockquote type=3D"cite"><span>Thanks,</sp=
an><br></blockquote><blockquote type=3D"cite"><span>Pedro</span><br></blockq=
uote></div></blockquote></body></html>=

--Apple-Mail-7D576DAF-50DE-4219-9D60-961404491DA1--