hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Christophe Taton (JIRA)" <j...@apache.org>
Subject [jira] Updated: (HADOOP-1822) Allow SOCKS proxy configuration to remotely access the DFS and submit Jobs
Date Sat, 22 Sep 2007 17:41:50 GMT

     [ https://issues.apache.org/jira/browse/HADOOP-1822?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel

Christophe Taton updated HADOOP-1822:

    Attachment: 1822_2007-09-22_5.patch

New patch:
- Different Socket factories can be specified for different contexts (e.g. for different VersionedProtocols
like {{JobSubmissionProtocol}} or {{ClientProtocol}}).
- The DFS interface (ClientProtocol RPCs and sockets for transferring data blocs with DataNodes)
uses a {{SocketFactory}} configured with {{hadoop.rpc.socket.factory.class.ClientProtocol}}.
- The JobTracker interface (JobSubmissionProtocol RPCs) Socket factory is configured using
- All other created sockets are created using the default Socket Factory as specified by {{hadoop.rpc.socket.factory.class.default}}.

The configuration property that specifies a Socket factory follows the syntax: "{{package.FactoryClassName:factory-parameter}}".

The patch provides a {{ProxySocketFactory}} initialized with a factory parameter which can
- {{direct}}
- {{socks://host:port}}
- {{http://host:port}}

When implementing a new factory, the new factory class should provide a {{public static SocketFactory
initialize(String factoryParameter)}} method.

RPC Clients connections are cached based on the {{SocketFactory}} used to create them.

JUnit tests ok.

> Allow SOCKS proxy configuration to remotely access the DFS and submit Jobs
> --------------------------------------------------------------------------
>                 Key: HADOOP-1822
>                 URL: https://issues.apache.org/jira/browse/HADOOP-1822
>             Project: Hadoop
>          Issue Type: New Feature
>          Components: dfs, ipc
>            Reporter: Christophe Taton
>            Assignee: Christophe Taton
>            Priority: Minor
>             Fix For: 0.15.0
>         Attachments: 1822-2007-09-07a.patch, 1822-2007-09-11a.patch, 1822_2007-09-22_5.patch
> The purpose of this issue is to introduce a new configuration entry to setup SOCKS proxy
for DFS and JobTracker clients.
> This enable users to remotely access the DFS and submit Jobs as if they were directly
connected to the cluster Hadoop runs on.

This message is automatically generated by JIRA.
You can reply to this email to add a comment to the issue online.

View raw message