hadoop-yarn-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Sandy Ryza <sandy.r...@cloudera.com>
Subject Re: changing socket calls for ApplicationMaster
Date Fri, 06 Dec 2013 16:57:58 GMT
That's correct that ipc.Client and Server handle inter-node/process
communication in Hadoop.

-Sandy


On Fri, Dec 6, 2013 at 8:48 AM, Black, James A. <blackja@ornl.gov> wrote:

> It appears that it would be in hadoop-common in
> org.apache.hadoop.ipc.Server and org.apache.hadoop.ipc.Client, as the path
> I followed was:
> ContainerManagerImpl -> ContainerManagementProtocolPBServiceImpl ->
> ProtobufRpcEngine->Server
>
> Before I start making the changes to an event-based communication platform
> it would be nice to know that this is indeed the correct place.
>
> Thank you.
>
> From: Black, James A.
> Sent: Friday, December 06, 2013 9:47 AM
> To: 'yarn-dev@hadoop.apache.org'
> Subject: changing socket calls for ApplicationMaster
>
> Hello,
>   I am working on a project to get Hadoop 2 to work on a Cray
> supercomputer, and for that I need to change it from using TCP/IP sockets
> to using something else, as sockets run slow on the Cray computers we have.
>
>   So, I am looking at AMRMClientImpl and it seems that that section needs
> to be changed, but which class is actually used to communicate between the
> ApplicationMaster and the Containers?  I am looking for the place where the
> actual socket calls are made so I can change it to a different library.
>
> Thank you.
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message