Mailing-List: contact user-help@flume.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@flume.apache.org
Received-SPF: pass (athena.apache.org: local policy)
DomainKey-Signature: a=rsa-sha1; q=dns; c=nofws;
  s=s1024; d=yahoo.com;
  h=X-YMail-OSG:Received:X-Rocket-MIMEInfo:X-Mailer:References:Message-ID:Date:From:Reply-To:Subject:To:In-Reply-To:MIME-Version:Content-Type;
  b=MESzkj/Lmke6vFhHayQ3wHa6alCTfihsI33VTkHiFMt+keU87l18OM5xX65naZQbks43HPitNJwgDPDNkH5N6x+gefWlUMWhPLZd66urntuGB4ZtpJyZ+SyDD/dfSJbx4B15WmzqrO8A8V6aAh5TIAWz7v43KBfzhSLBqMZVJxs=;
References: <1353362861.3476.YahooMailNeo@web162406.mail.bf1.yahoo.com>
 <05B128C7-96DE-4FA3-9E40-B27B13B7F0E1@gmail.com>
 <1353363480.23481.YahooMailNeo@web162406.mail.bf1.yahoo.com>
 <CAC6YYrhX_PnewR_5DJbzy5_hbaNMdwNSg4nVtjPMS5Abk39_Fg@mail.gmail.com>
 <CAOT3TWo8zAHr7fwWLA=8LeLX_iEq-BnECrdobYcjkfDLZ3jSew@mail.gmail.com>
 <432B8E08475C4E909FC1A6F25568AB95@cloudera.com>
Message-ID: <1353369854.53939.YahooMailNeo@web162402.mail.bf1.yahoo.com>
Date: Mon, 19 Nov 2012 16:04:14 -0800 (PST)
From: Rahul Ravindran <rahulrv@yahoo.com>
Reply-To: Rahul Ravindran <rahulrv@yahoo.com>
Subject: Re: Hadoop jars
To: "user@flume.apache.org" <user@flume.apache.org>
In-Reply-To: <432B8E08475C4E909FC1A6F25568AB95@cloudera.com>
MIME-Version: 1.0
Content-Type: multipart/alternative;
 boundary="-853603208-1078366379-1353369854=:53939"

---853603208-1078366379-1353369854=:53939
Content-Type: text/plain; charset=iso-8859-1
Content-Transfer-Encoding: quoted-printable

Thanks for the responses.=0A=0AGood to know that the only external dependen=
cies are Hadoop and Hbase. We will deploy those components only on boxes wh=
ich are going to have those sinks set up.=0A=0A=0A_________________________=
_______=0A From: Hari Shreedharan <hshreedharan@cloudera.com>=0ATo: user@fl=
ume.apache.org =0ASent: Monday, November 19, 2012 3:29 PM=0ASubject: Re: Ha=
doop jars=0A =0A=0AFlume installs all required binaries, except for Hadoop =
(and the dependencies it would pull in) and HBase. This is because Flume, l=
ike most other Hadoop ecosystem components is meant to work against binary =
incompatible versions of Hadoop (Hadoop-1/Hadoop2). So instead of packaging=
 hadoop jars with Flume, we expect Hadoop to be available on the machines y=
ou are running Flume on. Once you install Hadoop you should not have any de=
pendency issues. Same is true for HBase. =0A=0A=0AHari=0A=0A=0A--=A0=0AHari=
 Shreedharan=0A=0AOn Monday, November 19, 2012 at 2:33 PM, Mohit Anchlia wr=
ote:=0AEasiest way is to install cdh binary and point your flume's classpat=
h to it.=0A>=0A>=0A>On Mon, Nov 19, 2012 at 2:25 PM, Roshan Naik <roshan@ho=
rtonworks.com> wrote:=0A>=0A>Currently, unfortunately, i dont think there i=
s any such documentation. =0A>>A =A0very general answer would be..Normally =
this list would depend on the source/sink/channel you are using.=0A>>I thin=
k it would be nice if the user manual did list these external dependencies =
for each component.=0A>>I am not the expert on HDFS sink.. but i dont see w=
hy it would depend on anything more than HDFS itself.=A0=0A>>-roshan =0A>>=
=0A>>=0A>>=0A>>On Mon, Nov 19, 2012 at 2:18 PM, Rahul Ravindran <rahulrv@ya=
hoo.com> wrote:=0A>>=0A>>Are there other such libraries which will need to =
be downloaded? Is there a well-defined location for the hadoop jar and any =
other jars that flume may depend on?=0A>>>=0A>>>=0A>>=0A> 
---853603208-1078366379-1353369854=:53939
Content-Type: text/html; charset=iso-8859-1
Content-Transfer-Encoding: quoted-printable

<html><body><div style=3D"color:#000; background-color:#fff; font-family:ti=
mes new roman, new york, times, serif;font-size:12pt"><div><span>Thanks for=
 the responses.</span></div><div><span><br></span></div><div style=3D"color=
: rgb(0, 0, 0); font-size: 16px; font-family: 'times new roman', 'new york'=
, times, serif; background-color: transparent; font-style: normal;"><span>G=
ood to know that the only external dependencies are Hadoop and Hbase. We wi=
ll deploy those components only on boxes which are going to have those sink=
s set up.</span></div><div><br></div>  <div style=3D"font-family: 'times ne=
w roman', 'new york', times, serif; font-size: 12pt;"> <div style=3D"font-f=
amily: 'times new roman', 'new york', times, serif; font-size: 12pt;"> <div=
 dir=3D"ltr"> <font size=3D"2" face=3D"Arial"> <hr size=3D"1">  <b><span st=
yle=3D"font-weight:bold;">From:</span></b> Hari Shreedharan &lt;hshreedhara=
n@cloudera.com&gt;<br> <b><span style=3D"font-weight: bold;">To:</span></b>
 user@flume.apache.org <br> <b><span style=3D"font-weight: bold;">Sent:</sp=
an></b> Monday, November 19, 2012 3:29 PM<br> <b><span style=3D"font-weight=
: bold;">Subject:</span></b> Re: Hadoop jars<br> </font> </div> <br>=0A<div=
 id=3D"yiv1088506144">=0A                <div>=0A                    <span =
style=3D"font-size:12px;">Flume installs all required binaries, except for =
Hadoop (and the dependencies it would pull in) and HBase. This is because F=
lume, like most other Hadoop ecosystem components is meant to work against =
binary incompatible versions of Hadoop (Hadoop-1/Hadoop2). So instead of pa=
ckaging hadoop jars with Flume, we expect Hadoop to be available on the mac=
hines you are running Flume on. Once you install Hadoop you should not have=
 any dependency issues. Same is true for HBase.</span>=0A                </=
div><div><span style=3D"font-size:12px;"><br></span></div><div><br></div><d=
iv><span style=3D"font-size:12px;">Hari</span></div>=0A                <div=
><div><br></div><div>--&nbsp;</div><div>Hari Shreedharan</div><div><br></di=
v></div>=0A                 =0A                <div style=3D"color:#A0A0A8;=
">On Monday, November 19, 2012 at 2:33 PM, Mohit Anchlia wrote:</div>=0A   =
             <blockquote type=3D"cite" style=3D"border-left-style:solid;bor=
der-width:1px;margin-left:0px;padding-left:10px;">=0A                    <s=
pan><div><div>Easiest way is to install cdh binary and point your flume's c=
lasspath to it.<br><br>=0A<div>On Mon, Nov 19, 2012 at 2:25 PM, Roshan Naik=
 <span dir=3D"ltr">&lt;<a rel=3D"nofollow" ymailto=3D"mailto:roshan@hortonw=
orks.com" target=3D"_blank" href=3D"mailto:roshan@hortonworks.com">roshan@h=
ortonworks.com</a>&gt;</span> wrote:<br><blockquote type=3D"cite"><div>Curr=
ently, unfortunately, i dont think there is any such documentation.  =0A<di=
v>A &nbsp;very general answer would be..Normally this list would depend on =
the source/sink/channel you are using.</div>=0A<div>I think it would be nic=
e if the user manual did list these external dependencies for each componen=
t.</div>=0A<div>I am not the expert on HDFS sink.. but i dont see why it wo=
uld depend on anything more than HDFS itself.&nbsp;</div>=0A<div><span><fon=
t color=3D"#888888">-roshan</font></span>  =0A<div><br><br>=0A<div>On Mon, =
Nov 19, 2012 at 2:18 PM, Rahul Ravindran <span dir=3D"ltr">&lt;<a rel=3D"no=
follow" ymailto=3D"mailto:rahulrv@yahoo.com" target=3D"_blank" href=3D"mail=
to:rahulrv@yahoo.com">rahulrv@yahoo.com</a>&gt;</span> wrote:<br><blockquot=
e type=3D"cite"><div>=0A<div>=0A<div style=3D"font-family: 'times new roman=
', 'new york', times, serif; font-size: 12pt;">=0A<div><span>Are there othe=
r such libraries which will need to be downloaded? Is there a well-defined =
location for the hadoop jar and any other jars that flume may depend on?</s=
pan></div>=0A<div><br></div></div></div></div></blockquote></div><br></div>=
</div></div></blockquote></div><br>=0A</div></div></span>=0A               =
  =0A                 =0A                 =0A                 =0A          =
      </blockquote>=0A                 =0A                <div>=0A         =
           <br>=0A                </div>=0A            </div><br><br> </div=
> </div>  </div></body></html>
---853603208-1078366379-1353369854=:53939--