hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From <hadoop.supp...@visolve.com>
Subject RE: Hadoop - HTTPS communication between nodes - How to Confirm ?
Date Mon, 23 Feb 2015 06:33:31 GMT
Thanks for the help Ulul/Daemeon,

 

Problem has sorted using lsof –p <datanode pid> command. 

 

Thanks,

S.RagavendraGanesh

ViSolve Hadoop Support Team
ViSolve Inc. | San Jose, California
Website: www.visolve.com <http://www.visolve.com>  

Email: services@visolve.com <mailto:services@visolve.com>  | Phone:
408-850-2243

 

From: Ulul [mailto:hadoop@ulul.org] 
Sent: Sunday, February 22, 2015 5:23 AM
To: user@hadoop.apache.org
Subject: Re: Hadoop - HTTPS communication between nodes - How to Confirm ?

 

Hi

Be careful, HTTPS is to secure WebHDFS. If you want to protect all network
streams you need more than that :
 
<https://s3.amazonaws.com/dev.hortonworks.com/HDPDocuments/HDP2/HDP-2.1.2/bk
_reference/content/reference_chap-wire-encryption.html>
https://s3.amazonaws.com/dev.hortonworks.com/HDPDocuments/HDP2/HDP-2.1.2/bk_
reference/content/reference_chap-wire-encryption.html

If you're just interested in HTTPS an lsof -p <datanode pid> | grep TCP will
show you that DN listening on 50075 for HTTP, 50475 for HTTPS. For namenode
that would be 50070 and 50470

Ulul
 

Le 21/02/2015 19:53, hadoop.support@visolve.com
<mailto:hadoop.support@visolve.com>  a écrit :

Hello Everyone,

 

We are trying to measure performance between HTTP and HTTPS version on
Hadoop DFS, Mapreduce and other related modules.

 

As of now, we have tested using several metrics on Hadoop HTTP Mode.
Similiarly we are trying to test the same metrics on HTTPS Platform.
Basically our test suite cluster consists of one Master Node and two Slave
Nodes. 

We have configured HTTPS connection and now we need to verify whether Nodes
are communicating directly through HTTPS. Tried checking logs, clusters
webhdfs ui, health check information, dfs admin report but of no help. Since
there is only limited documentation available in HTTPS, we are unable to
verify whether Nodes are communicating through HTTPS. 

 

Hence any experts around here can shed some light on how to confirm HTTPS
communication status between nodes (might be with mapreduce/DFS).

 

Note: If I have missed any information, feel free to check with me for the
same. 

 

Thanks,

S.RagavendraGanesh

ViSolve Hadoop Support Team
ViSolve Inc. | San Jose, California
Website: www.visolve.com <http://www.visolve.com>  

email: services@visolve.com <mailto:services@visolve.com>  | Phone:
408-850-2243

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 


 


Mime
View raw message