Mailing-List: contact user-help@ignite.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@ignite.apache.org
MIME-Version: 1.0
In-Reply-To: <1442220999059-1378.post@n6.nabble.com>
References: <1441349269988-1273.post@n6.nabble.com>
	<1441754212208-1302.post@n6.nabble.com>
	<1441863204725-1331.post@n6.nabble.com>
	<1441875130227-1336.post@n6.nabble.com>
	<1441973378556-1360.post@n6.nabble.com>
	<1441974090158-1361.post@n6.nabble.com>
	<1442216682993-1375.post@n6.nabble.com>
	<CAGt6o8nUZuxi0Gd3pJwO0cETaMBEvODN6wAVCq+c-S-W2aMPbQ@mail.gmail.com>
	<1442220999059-1378.post@n6.nabble.com>
Date: Mon, 14 Sep 2015 12:20:34 +0300
Message-ID: 
 <CAGt6o8=uVmmJBHqBwrUGX6VX11CfSJ9LBppQDK0LDo2a2FUExQ@mail.gmail.com>
Subject: Re: How to configure Hadoop accelerator for Hadoop-High Availability
 ?
From: Vladimir Ozerov <vozerov@gridgain.com>
To: user@ignite.apache.org
Content-Type: multipart/alternative; boundary=001a1135ae22e7e736051fb19365

--001a1135ae22e7e736051fb19365
Content-Type: text/plain; charset=UTF-8

Jesu,

Yes, normally we expect that one Ignite node will run on all machines where
file system is accessed. The main reason for this is performance. For
example, what if Hadoop sent a job to a node where HDFS is running, but
there is no Ignite node? In this case if you access HDFS through IGFS, you
will have to connect to some remote Ignite node and try fetching data form
there, what is less than optimal due to additoinla network trips. This is
why advised way to work with IGFS is to start Ignite node on each machine
running HDFS.

However, this is not strict requirement. You can work with remote Ignite
nodes through TCP endpoint of course. But if IGFS use some additional
Hadoop configuration files like *core-site.xml* or *hdfs-site.xml*, then
you must ensure that they are placed in the same directories on all
machnies where you access IGFS.

Please let me know if you have any further questions.

Vladimir.


On Mon, Sep 14, 2015 at 11:56 AM, Jesu <jesu.i.das@gmail.com> wrote:

> Vladimir,
> Yes, the processes are running in different machines. Does this mean ignite
> needs to run on all the machines in which igfs is accessed?
>
>
>
> --
> View this message in context:
> http://apache-ignite-users.70518.x6.nabble.com/How-to-configure-Hadoop-accelerator-for-Hadoop-High-Availability-tp1273p1378.html
> Sent from the Apache Ignite Users mailing list archive at Nabble.com.
>

--001a1135ae22e7e736051fb19365
Content-Type: text/html; charset=UTF-8
Content-Transfer-Encoding: quoted-printable

<div dir=3D"ltr">Jesu,<div><br></div><div>Yes, normally we expect that one =
Ignite node will run on all machines where file system is accessed. The mai=
n reason for this is performance. For example, what if Hadoop sent a job to=
 a node where HDFS is running, but there is no Ignite node? In this case if=
 you access HDFS through IGFS, you will have to connect to some remote Igni=
te node and try fetching data form there, what is less than optimal due to =
additoinla network trips. This is why advised way to work with IGFS is to s=
tart Ignite node on each machine running HDFS.</div><div><br></div><div>How=
ever, this is not strict requirement. You can work with remote Ignite nodes=
 through TCP endpoint of course. But if IGFS use some additional Hadoop con=
figuration files like <b>core-site.xml</b> or <b>hdfs-site.xml</b>, then yo=
u must ensure that they are placed in the same directories on all machnies =
where you access IGFS.=C2=A0</div><div><br></div><div>Please let me know if=
 you have any further questions.</div><div><br></div><div>Vladimir.</div><d=
iv><br></div></div><div class=3D"gmail_extra"><br><div class=3D"gmail_quote=
">On Mon, Sep 14, 2015 at 11:56 AM, Jesu <span dir=3D"ltr">&lt;<a href=3D"m=
ailto:jesu.i.das@gmail.com" target=3D"_blank">jesu.i.das@gmail.com</a>&gt;<=
/span> wrote:<br><blockquote class=3D"gmail_quote" style=3D"margin:0 0 0 .8=
ex;border-left:1px #ccc solid;padding-left:1ex">Vladimir,<br>
Yes, the processes are running in different machines. Does this mean ignite=
<br>
needs to run on all the machines in which igfs is accessed?<br>
<br>
<br>
<br>
--<br>
View this message in context: <a href=3D"http://apache-ignite-users.70518.x=
6.nabble.com/How-to-configure-Hadoop-accelerator-for-Hadoop-High-Availabili=
ty-tp1273p1378.html" rel=3D"noreferrer" target=3D"_blank">http://apache-ign=
ite-users.70518.x6.nabble.com/How-to-configure-Hadoop-accelerator-for-Hadoo=
p-High-Availability-tp1273p1378.html</a><br>
<div class=3D"HOEnZb"><div class=3D"h5">Sent from the Apache Ignite Users m=
ailing list archive at Nabble.com.<br>
</div></div></blockquote></div><br></div>

--001a1135ae22e7e736051fb19365--