hadoop-yarn-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Black, James A." <blac...@ornl.gov>
Subject RE: changing socket calls for ApplicationMaster
Date Fri, 06 Dec 2013 17:05:18 GMT
Thank you.

Now comes the hard work of making the changes, and ensuring nothing breaks. :)

-----Original Message-----
From: Sandy Ryza [mailto:sandy.ryza@cloudera.com] 
Sent: Friday, December 06, 2013 11:58 AM
To: yarn-dev@hadoop.apache.org
Subject: Re: changing socket calls for ApplicationMaster

That's correct that ipc.Client and Server handle inter-node/process communication in Hadoop.

-Sandy


On Fri, Dec 6, 2013 at 8:48 AM, Black, James A. <blackja@ornl.gov> wrote:

> It appears that it would be in hadoop-common in 
> org.apache.hadoop.ipc.Server and org.apache.hadoop.ipc.Client, as the 
> path I followed was:
> ContainerManagerImpl -> ContainerManagementProtocolPBServiceImpl ->
> ProtobufRpcEngine->Server
>
> Before I start making the changes to an event-based communication 
> platform it would be nice to know that this is indeed the correct place.
>
> Thank you.
>
> From: Black, James A.
> Sent: Friday, December 06, 2013 9:47 AM
> To: 'yarn-dev@hadoop.apache.org'
> Subject: changing socket calls for ApplicationMaster
>
> Hello,
>   I am working on a project to get Hadoop 2 to work on a Cray 
> supercomputer, and for that I need to change it from using TCP/IP 
> sockets to using something else, as sockets run slow on the Cray computers we have.
>
>   So, I am looking at AMRMClientImpl and it seems that that section 
> needs to be changed, but which class is actually used to communicate 
> between the ApplicationMaster and the Containers?  I am looking for 
> the place where the actual socket calls are made so I can change it to a different library.
>
> Thank you.
>

Mime
View raw message