hadoop-hdfs-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Rajiv Chittajallu <raj...@yahoo-inc.com.INVALID>
Subject Re: Proxy for HDFS
Date Mon, 09 Feb 2015 23:11:30 GMT

If a client can use HDFS RPC why is a Proxy required? Are the clients not allowed to reach
data nodes directly? 

WebHDFS + Apache Traffic server or HDFS RPC + SOCK Proxy should work.

If you can share a use case, it would probably help.


----- Original Message -----
From: Rahul Shrivastava <rhshriva@gmail.com>
To: hdfs-dev@hadoop.apache.org; Rajiv Chittajallu <rajive@yahoo-inc.com>
Sent: Monday, February 9, 2015 2:58 PM
Subject: Re: Proxy for HDFS

Thanks Rajiv.

I did look into HttpFs before but i wanted a build a proxy at HDFS layer.
This is specific for clients which do not use HTTP ( i.e. HttpFs or
webHDFS) to talk to the HDFS cluster. That includes clients which uses HDFS
driver to talk to HDFS cluster.


On Mon, Feb 9, 2015 at 2:53 PM, Rajiv Chittajallu <
rajive@yahoo-inc.com.invalid> wrote:

> https://github.com/apache/hadoop/tree/branch-2.6/hadoop-hdfs-project/hadoop-hdfs-httpfs
> ----- Original Message -----
> From: Rahul Shrivastava <rhshriva@gmail.com>
> To: hdfs-dev@hadoop.apache.org
> Cc:
> Sent: Monday, February 9, 2015 2:35 PM
> Subject: Proxy for HDFS
> Hi,
> I have looking in HDFS code base ( 2.6.0) for the last couple of days for
> any possible proxy that we could utilize to create a proxy for HDFS.
> Is there any hook within HDFS to build a proxy around that.
> thanks
> Rahul

View raw message