hadoop-hdfs-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Roman Shaposhnik <ro...@shaposhnik.org>
Subject Re: access to hadoop cluster to post tasks remotely
Date Wed, 06 Nov 2013 23:59:45 GMT
On Wed, Nov 6, 2013 at 3:55 PM, Sergey Gerasimov
<gerasimov@mlab.cs.msu.su> wrote:
> But I still don’t understand why hadoop engine tries  to connect to
> DataNodes from client(!) machine during posting jar from client machine to
> the cluster.

Only metadata traffic goes to the NN, once metadata operations resolve
the block locations after that direct streaming to the DNs begins.

Thanks,
Roman.

Mime
View raw message