hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Aaron T. Myers" <...@cloudera.com>
Subject Re: Is it possible to use AF_UINX sockets in hadoop?
Date Mon, 28 Nov 2011 04:06:38 GMT
Hi Raghu,

You might want to check out the work that's been done over at

Aaron T. Myers
Software Engineer, Cloudera

On Thu, Nov 24, 2011 at 12:56 PM, Raghu Reddy <rreddy@psc.edu> wrote:

> Currently I'm experimenting with version 0.20.
> I would like to modify it so that it uses Unix Domain Sockets instead of
> INET sockets because we will be using this on a single node with a large
> number of cores.
> I would like to use junixsockets 1.3 implementation of AFUNIXSocket in
> place of INET sockets.
> The first question is is this possible?
> For the clients, it appears that one can provide a socket factory that
> returns AFUNIXSocket.  The problem seems to be to get the servers to use a
> different implementation because the servers are using
> ServerSocketChannels, and according to:
> <http://docs.oracle.com/**javase/6/docs/api/java/nio/**
> channels/ServerSocketChannel.**html<http://docs.oracle.com/javase/6/docs/api/java/nio/channels/ServerSocketChannel.html>
> >
> it is not possible to specify SocketImpl.
> I have tried to use ServerSocket.setSocketFactory(**) to try and set a
> different implementation, but I have not yet figured out if this is working
> or not.
> Does anyone have any idea if this is supposed to work?  Is there a better
> way of accomplishing this?
> Thanks!
> --rr

  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message