Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@hadoop.apache.org
Subject: Re: WebHdfs API
MIME-Version: 1.0
From: Larry McCay <lmccay@hortonworks.com>
To: "user@hadoop.apache.org" <user@hadoop.apache.org>
Thread-Topic: WebHdfs API
Thread-Index: AQHQnS9jkbhxd8Wz/028rRF9y3pYRJ2Zsu2AgAAHHgA=
Date: Tue, 2 Jun 2015 14:22:20 +0000
Message-ID: <86C39281-9E11-4526-ABA7-F6FD9F4CEB17@hortonworks.com>
References: 
 <CAH361U86K19_R5M-Kiy+kPPrxp2PGpeBbFndeEa+O61WYszvVw@mail.gmail.com>
 <CACvfG=pqkVCh2DHkDudgaZxTHUh+2E_Pq=ZSPR2ES1pcTu_ELQ@mail.gmail.com>
In-Reply-To: 
 <CACvfG=pqkVCh2DHkDudgaZxTHUh+2E_Pq=ZSPR2ES1pcTu_ELQ@mail.gmail.com>
Accept-Language: en-US
Content-Language: en-US
Content-Type: multipart/alternative;
	boundary="_000_86C392819E114526ABA7F6FD9F4CEB17hortonworkscom_"

--_000_86C392819E114526ABA7F6FD9F4CEB17hortonworkscom_
Content-Type: text/plain; charset="Windows-1252"
Content-Transfer-Encoding: quoted-printable

To build on what Manoj has described, there are few aspects to your usecase=
 and cluster interaction from outside the cluster that you need to be aware=
 of=85

* If the cluster is secured - you will need to use SPNEGO - HttpClient does=
 support this too
* if you need to invoke the REST APIs as each authenticated enduser rather =
than as a single identity representing the application then you will need y=
our application to be configured as a trusted proxy to HDFS
* if you have the cluster firewalled off from the rest of your network then=
 you will need to punch holes in the firewall for the host:ports that you n=
eed access to

You can simplify the above by use a reverse proxy like Apache Knox to be an=
 API Gateway for the REST APIs that you need access to.
See http://knox.apache.org/ for more details.

On Jun 2, 2015, at 9:56 AM, Manoj Babu <manoj444@gmail.com<mailto:manoj444@=
gmail.com>> wrote:

Hi - You can invoke the REST service using HTTP request with help of any HT=
TP clients. Example if it is an Java web application you can use Apache com=
mons HTTP client.

Thanks.

On Tuesday, June 2, 2015, Carmen Manzulli <carmenmanzulli@gmail.com<mailto:=
carmenmanzulli@gmail.com>> wrote:
Hi,
I would like to know hot to use WebHDFS methods of RESTful Web Services to =
open and read a file from a web application....instead of using curl!

For example, i would know ho to create a client and submit a Get HTTP reque=
st to the namenode.

Thanks in advance,

Carmen.


--
Cheers!
Manoj.


--_000_86C392819E114526ABA7F6FD9F4CEB17hortonworkscom_
Content-Type: text/html; charset="Windows-1252"
Content-ID: <45B2806DD5E48C47874491381D0B1A03@exch080.serverpod.net>
Content-Transfer-Encoding: quoted-printable

<html>
<head>
<meta http-equiv=3D"Content-Type" content=3D"text/html; charset=3DWindows-1=
252">
</head>
<body style=3D"word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-lin=
e-break: after-white-space;">
<div>To build on what Manoj has described, there are few aspects to your us=
ecase and cluster interaction from outside the cluster that you need to be =
aware of=85</div>
<div><br>
</div>
<div>* If the cluster is secured - you will need to use SPNEGO - HttpClient=
 does support this too</div>
<div>* if you need to invoke the REST APIs as each authenticated enduser ra=
ther than as a single identity representing the application then you will n=
eed your application to be configured as a trusted proxy to HDFS</div>
<div>* if you have the cluster firewalled off from the rest of your network=
 then you will need to punch holes in the firewall for the host:ports that =
you need access to</div>
<div><br>
</div>
<div>You can simplify the above by use a reverse proxy like Apache Knox to =
be an API Gateway for the REST APIs that you need access to.</div>
<div>See&nbsp;<a href=3D"http://knox.apache.org/">http://knox.apache.org/</=
a>&nbsp;for more details.</div>
<br>
<div>
<div>On Jun 2, 2015, at 9:56 AM, Manoj Babu &lt;<a href=3D"mailto:manoj444@=
gmail.com">manoj444@gmail.com</a>&gt; wrote:</div>
<br class=3D"Apple-interchange-newline">
<blockquote type=3D"cite">Hi - You can invoke the REST service using HTTP r=
equest with help of any HTTP clients. Example if it is an Java web applicat=
ion you can use Apache commons HTTP client.
<div><br>
</div>
<div>Thanks.<span></span><br>
<br>
On Tuesday, June 2, 2015, Carmen Manzulli &lt;<a href=3D"mailto:carmenmanzu=
lli@gmail.com">carmenmanzulli@gmail.com</a>&gt; wrote:<br>
<blockquote class=3D"gmail_quote" style=3D"margin:0 0 0 .8ex;border-left:1p=
x #ccc solid;padding-left:1ex">
<div dir=3D"ltr">
<div>
<div>
<div>
<div>Hi,<br>
</div>
I would like to know hot to use WebHDFS methods of RESTful Web Services to =
open and read a file from a web application....instead of using curl!<br>
<br>
</div>
For example, i would know ho to create a client and submit a Get HTTP reque=
st to the namenode.<br>
<br>
</div>
Thanks in advance,<br>
<br>
</div>
Carmen.<br>
</div>
</blockquote>
</div>
<br>
<br>
-- <br>
Cheers!
<div>Manoj.</div>
<br>
</blockquote>
</div>
<br>
</body>
</html>

--_000_86C392819E114526ABA7F6FD9F4CEB17hortonworkscom_--