Return-Path: 
 <user-return-18761-apmail-hadoop-user-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-user-archive@minotaur.apache.org
Delivered-To: apmail-hadoop-user-archive@minotaur.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
	by minotaur.apache.org (Postfix) with SMTP id 85AC017661
	for <apmail-hadoop-user-archive@minotaur.apache.org>;
 Mon, 23 Feb 2015 06:34:14 +0000 (UTC)
Received: (qmail 64629 invoked by uid 500); 23 Feb 2015 06:34:08 -0000
Delivered-To: apmail-hadoop-user-archive@hadoop.apache.org
Received: (qmail 64507 invoked by uid 500); 23 Feb 2015 06:34:08 -0000
Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:user-help@hadoop.apache.org>
List-Unsubscribe: <mailto:user-unsubscribe@hadoop.apache.org>
List-Post: <mailto:user@hadoop.apache.org>
List-Id: <user.hadoop.apache.org>
Reply-To: user@hadoop.apache.org
Delivered-To: mailing list user@hadoop.apache.org
Received: (qmail 64497 invoked by uid 99); 23 Feb 2015 06:34:08 -0000
Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136)
    by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 23 Feb 2015 06:34:07 +0000
X-ASF-Spam-Status: No, hits=1.5 required=5.0
	tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS
X-Spam-Check-By: apache.org
Received-SPF: pass (athena.apache.org: domain of hadoop.support@visolve.com
 designates 173.11.74.250 as permitted sender)
Received: from [173.11.74.250] (HELO mail.visolve.com) (173.11.74.250)
    by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 23 Feb 2015 06:34:03 +0000
Received: from ViMF (mail.visolve.com [173.11.74.250])
	by mail.visolve.com (Postfix) with ESMTPA id 44CEC525E;
	Sun, 22 Feb 2015 22:33:39 -0800 (PST)
Received: from abts-tn-static-154.230.165.122.airtelbroadband.in
	([122.165.230.154] helo=visolvePC) by ViMF with ESMTP (ASSP 1.9);
	22 Feb 2015 22:33:38 -0800
From: <hadoop.support@visolve.com>
To: <user@hadoop.apache.org>
Cc: <hadoop.support@visolve.com>
References: <002201d04e07$a07ba620$e172f260$@visolve.com>
 <54E91A60.5080204@ulul.org>
In-Reply-To: <54E91A60.5080204@ulul.org>
Subject: RE: Hadoop - HTTPS communication between nodes - How to Confirm ?
Date: Mon, 23 Feb 2015 12:03:31 +0530
Message-ID: <008a01d04f32$a6dd3b60$f497b220$@visolve.com>
MIME-Version: 1.0
Content-Type: multipart/alternative;
	boundary="----=_NextPart_000_008B_01D04F60.C09A5960"
X-Mailer: Microsoft Outlook 15.0
Thread-Index: AQGAoELXmE9daF8htpubynIWs7tCGwLFCKYlnYb7U0A=
Content-Language: en-us
X-Virus-Checked: Checked by ClamAV on apache.org

This is a multipart message in MIME format.

------=_NextPart_000_008B_01D04F60.C09A5960
Content-Type: text/plain;
	charset="iso-8859-1"
Content-Transfer-Encoding: quoted-printable

Thanks for the help Ulul/Daemeon,

=20

Problem has sorted using lsof =96p <datanode pid> command.=20

=20

Thanks,

S.RagavendraGanesh

ViSolve Hadoop Support Team
ViSolve Inc. | San Jose, California
Website: www.visolve.com <http://www.visolve.com> =20

Email: services@visolve.com <mailto:services@visolve.com>  | Phone:
408-850-2243

=20

From: Ulul [mailto:hadoop@ulul.org]=20
Sent: Sunday, February 22, 2015 5:23 AM
To: user@hadoop.apache.org
Subject: Re: Hadoop - HTTPS communication between nodes - How to Confirm =
?

=20

Hi

Be careful, HTTPS is to secure WebHDFS. If you want to protect all =
network
streams you need more than that :
=20
<https://s3.amazonaws.com/dev.hortonworks.com/HDPDocuments/HDP2/HDP-2.1.2=
/bk
_reference/content/reference_chap-wire-encryption.html>
https://s3.amazonaws.com/dev.hortonworks.com/HDPDocuments/HDP2/HDP-2.1.2/=
bk_
reference/content/reference_chap-wire-encryption.html

If you're just interested in HTTPS an lsof -p <datanode pid> | grep TCP =
will
show you that DN listening on 50075 for HTTP, 50475 for HTTPS. For =
namenode
that would be 50070 and 50470

Ulul
=20

Le 21/02/2015 19:53, hadoop.support@visolve.com
<mailto:hadoop.support@visolve.com>  a =E9crit :

Hello Everyone,

=20

We are trying to measure performance between HTTP and HTTPS version on
Hadoop DFS, Mapreduce and other related modules.

=20

As of now, we have tested using several metrics on Hadoop HTTP Mode.
Similiarly we are trying to test the same metrics on HTTPS Platform.
Basically our test suite cluster consists of one Master Node and two =
Slave
Nodes.=20

We have configured HTTPS connection and now we need to verify whether =
Nodes
are communicating directly through HTTPS. Tried checking logs, clusters
webhdfs ui, health check information, dfs admin report but of no help. =
Since
there is only limited documentation available in HTTPS, we are unable to
verify whether Nodes are communicating through HTTPS.=20

=20

Hence any experts around here can shed some light on how to confirm =
HTTPS
communication status between nodes (might be with mapreduce/DFS).

=20

Note: If I have missed any information, feel free to check with me for =
the
same.=20

=20

Thanks,

S.RagavendraGanesh

ViSolve Hadoop Support Team
ViSolve Inc. | San Jose, California
Website: www.visolve.com <http://www.visolve.com> =20

email: services@visolve.com <mailto:services@visolve.com>  | Phone:
408-850-2243

=20

=20

=20

=20

=20

=20

=20

=20

=20

=20

=20

=20

=20

=20

=20

=20

=20

=20

=20

=20

=20

=20

=20

=20

=20

=20

=20

=20

=20


=20


------=_NextPart_000_008B_01D04F60.C09A5960
Content-Type: text/html;
	charset="iso-8859-1"
Content-Transfer-Encoding: quoted-printable

<html xmlns:v=3D"urn:schemas-microsoft-com:vml" =
xmlns:o=3D"urn:schemas-microsoft-com:office:office" =
xmlns:w=3D"urn:schemas-microsoft-com:office:word" =
xmlns:m=3D"http://schemas.microsoft.com/office/2004/12/omml" =
xmlns=3D"http://www.w3.org/TR/REC-html40"><head><meta =
http-equiv=3DContent-Type content=3D"text/html; =
charset=3Diso-8859-1"><meta name=3DGenerator content=3D"Microsoft Word =
15 (filtered medium)"><style><!--
/* Font Definitions */
@font-face
	{font-family:"Cambria Math";
	panose-1:2 4 5 3 5 4 6 3 2 4;}
@font-face
	{font-family:Calibri;
	panose-1:2 15 5 2 2 2 4 3 2 4;}
@font-face
	{font-family:"Courier 10 Pitch";
	panose-1:0 0 0 0 0 0 0 0 0 0;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
	{margin:0in;
	margin-bottom:.0001pt;
	font-size:11.0pt;
	font-family:"Calibri",sans-serif;
	color:black;}
a:link, span.MsoHyperlink
	{mso-style-priority:99;
	color:#0563C1;
	text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
	{mso-style-priority:99;
	color:#954F72;
	text-decoration:underline;}
span.EmailStyle17
	{mso-style-type:personal;
	font-family:"Calibri",sans-serif;
	color:windowtext;}
span.EmailStyle18
	{mso-style-type:personal-reply;
	font-family:"Calibri",sans-serif;
	color:#1F497D;}
.MsoChpDefault
	{mso-style-type:export-only;
	font-size:10.0pt;}
@page WordSection1
	{size:8.5in 11.0in;
	margin:1.0in 1.0in 1.0in 1.0in;}
div.WordSection1
	{page:WordSection1;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext=3D"edit" spidmax=3D"1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext=3D"edit">
<o:idmap v:ext=3D"edit" data=3D"1" />
</o:shapelayout></xml><![endif]--></head><body bgcolor=3Dwhite =
lang=3DEN-US link=3D"#0563C1" vlink=3D"#954F72"><div =
class=3DWordSection1><p class=3DMsoNormal><span =
style=3D'color:#1F497D'>Thanks for the help =
Ulul/Daemeon,<o:p></o:p></span></p><p class=3DMsoNormal><span =
style=3D'color:#1F497D'><o:p>&nbsp;</o:p></span></p><p =
class=3DMsoNormal><span style=3D'color:#1F497D'> Problem has sorted =
using lsof &#8211;p &lt;datanode pid&gt; command. =
<o:p></o:p></span></p><p class=3DMsoNormal><span =
style=3D'color:#1F497D'><o:p>&nbsp;</o:p></span></p><p class=3DMsoNormal =
style=3D'margin-right:22.5pt;line-height:13.5pt;vertical-align:baseline'>=
<i><span style=3D'color:#1F497D'>Thanks,</span></i><span =
style=3D'color:#1F497D'><o:p></o:p></span></p><p class=3DMsoNormal =
style=3D'margin-right:22.5pt;line-height:13.5pt;vertical-align:baseline'>=
<i><span style=3D'color:#1F497D'>S.RagavendraGanesh</span></i><span =
style=3D'color:#1F497D'><o:p></o:p></span></p><p class=3DMsoNormal =
style=3D'margin-right:22.5pt;line-height:13.5pt;vertical-align:baseline'>=
<span style=3D'color:#1F497D'>ViSolve Hadoop Support Team<br>ViSolve =
Inc. | San Jose, California</span><br><i><span =
style=3D'color:#1F497D'>Website:</span></i> <a =
href=3D"http://www.visolve.com">www.visolve.com</a> <o:p></o:p></p><p =
class=3DMsoNormal =
style=3D'margin-right:22.5pt;line-height:13.5pt;vertical-align:baseline'>=
<span style=3D'color:#1F497D'>Email: </span><a =
href=3D"mailto:services@visolve.com">services@visolve.com</a> <span =
style=3D'color:#1F497D'>| Phone: 408-850-2243<o:p></o:p></span></p><p =
class=3DMsoNormal><span =
style=3D'color:#1F497D'><o:p>&nbsp;</o:p></span></p><div><div =
style=3D'border:none;border-top:solid #E1E1E1 1.0pt;padding:3.0pt 0in =
0in 0in'><p class=3DMsoNormal><b><span =
style=3D'color:windowtext'>From:</span></b><span =
style=3D'color:windowtext'> Ulul [mailto:hadoop@ulul.org] =
<br><b>Sent:</b> Sunday, February 22, 2015 5:23 AM<br><b>To:</b> =
user@hadoop.apache.org<br><b>Subject:</b> Re: Hadoop - HTTPS =
communication between nodes - How to Confirm =
?<o:p></o:p></span></p></div></div><p =
class=3DMsoNormal><o:p>&nbsp;</o:p></p><p class=3DMsoNormal><span =
style=3D'font-family:"Courier 10 Pitch",serif'>Hi<br><br>Be careful, =
HTTPS is to secure WebHDFS. If you want to protect all network streams =
you need more than that :<br></span><a =
href=3D"https://s3.amazonaws.com/dev.hortonworks.com/HDPDocuments/HDP2/HD=
P-2.1.2/bk_reference/content/reference_chap-wire-encryption.html"><span =
style=3D'font-family:"Courier 10 =
Pitch",serif'>https://s3.amazonaws.com/dev.hortonworks.com/HDPDocuments/H=
DP2/HDP-2.1.2/bk_reference/content/reference_chap-wire-encryption.html</s=
pan></a><span style=3D'font-family:"Courier 10 Pitch",serif'><br><br>If =
you're just interested in HTTPS an lsof -p &lt;datanode pid&gt; | grep =
TCP will show you that DN listening on 50075 for HTTP, 50475 for HTTPS. =
For namenode that would be 50070 and =
50470<br><br>Ulul<br>&nbsp;</span><span =
style=3D'font-size:12.0pt'><o:p></o:p></span></p><div><p =
class=3DMsoNormal>Le 21/02/2015 19:53, <a =
href=3D"mailto:hadoop.support@visolve.com">hadoop.support@visolve.com</a>=
 a =E9crit&nbsp;:<o:p></o:p></p></div><blockquote =
style=3D'margin-top:5.0pt;margin-bottom:5.0pt'><p =
class=3DMsoNormal>Hello Everyone,<o:p></o:p></p><p =
class=3DMsoNormal>&nbsp;<o:p></o:p></p><p class=3DMsoNormal>We are =
trying to measure performance between HTTP and HTTPS version on Hadoop =
DFS, Mapreduce and other related modules.<o:p></o:p></p><p =
class=3DMsoNormal>&nbsp;<o:p></o:p></p><p class=3DMsoNormal>As of now, =
we have tested using several metrics on Hadoop HTTP Mode. Similiarly we =
are trying to test the same metrics on HTTPS Platform. Basically our =
test suite cluster consists of one Master Node and two Slave Nodes. =
<o:p></o:p></p><p class=3DMsoNormal style=3D'margin-top:12.0pt'>We have =
configured HTTPS connection and now we need to verify whether Nodes are =
communicating directly through HTTPS. Tried checking logs, clusters =
webhdfs ui, health check information, dfs admin report but of no help. =
Since there is only limited documentation available in HTTPS, we are =
unable to verify whether Nodes are communicating through HTTPS. =
<o:p></o:p></p><p class=3DMsoNormal>&nbsp;<o:p></o:p></p><p =
class=3DMsoNormal>Hence any experts around here can shed some light on =
how to confirm HTTPS communication status between nodes (might be with =
mapreduce/DFS).<o:p></o:p></p><p =
class=3DMsoNormal>&nbsp;<o:p></o:p></p><p class=3DMsoNormal>Note: If I =
have missed any information, feel free to check with me for the same. =
<o:p></o:p></p><p class=3DMsoNormal>&nbsp;<o:p></o:p></p><p =
class=3DMsoNormal =
style=3D'margin-right:22.5pt;line-height:13.5pt;vertical-align:baseline'>=
<em><span =
style=3D'font-family:"Calibri",sans-serif'>Thanks,</span></em><o:p></o:p>=
</p><p class=3DMsoNormal =
style=3D'margin-right:22.5pt;line-height:13.5pt;vertical-align:baseline'>=
<em><span =
style=3D'font-family:"Calibri",sans-serif'>S.RagavendraGanesh</span></em>=
<o:p></o:p></p><p class=3DMsoNormal =
style=3D'margin-right:22.5pt;line-height:13.5pt;vertical-align:baseline'>=
ViSolve Hadoop Support Team<br>ViSolve Inc. | San Jose, =
California<br>Website: <a =
href=3D"http://www.visolve.com">www.visolve.com</a> <o:p></o:p></p><p =
class=3DMsoNormal =
style=3D'margin-right:22.5pt;line-height:13.5pt;vertical-align:baseline'>=
email: <a href=3D"mailto:services@visolve.com">services@visolve.com</a> =
| Phone: 408-850-2243<o:p></o:p></p><p =
class=3DMsoNormal>&nbsp;<o:p></o:p></p><p =
class=3DMsoNormal>&nbsp;<o:p></o:p></p><p =
class=3DMsoNormal>&nbsp;<o:p></o:p></p><p =
class=3DMsoNormal>&nbsp;<o:p></o:p></p><p =
class=3DMsoNormal>&nbsp;<o:p></o:p></p><p =
class=3DMsoNormal>&nbsp;<o:p></o:p></p><p =
class=3DMsoNormal>&nbsp;<o:p></o:p></p><p =
class=3DMsoNormal>&nbsp;<o:p></o:p></p><p =
class=3DMsoNormal>&nbsp;<o:p></o:p></p><p =
class=3DMsoNormal>&nbsp;<o:p></o:p></p><p =
class=3DMsoNormal>&nbsp;<o:p></o:p></p><p =
class=3DMsoNormal>&nbsp;<o:p></o:p></p><p =
class=3DMsoNormal>&nbsp;<o:p></o:p></p><p =
class=3DMsoNormal>&nbsp;<o:p></o:p></p><p =
class=3DMsoNormal>&nbsp;<o:p></o:p></p><p =
class=3DMsoNormal>&nbsp;<o:p></o:p></p><p =
class=3DMsoNormal>&nbsp;<o:p></o:p></p><p =
class=3DMsoNormal>&nbsp;<o:p></o:p></p><p =
class=3DMsoNormal>&nbsp;<o:p></o:p></p><p =
class=3DMsoNormal>&nbsp;<o:p></o:p></p><p =
class=3DMsoNormal>&nbsp;<o:p></o:p></p><p =
class=3DMsoNormal>&nbsp;<o:p></o:p></p><p =
class=3DMsoNormal>&nbsp;<o:p></o:p></p><p =
class=3DMsoNormal>&nbsp;<o:p></o:p></p><p =
class=3DMsoNormal>&nbsp;<o:p></o:p></p><p =
class=3DMsoNormal>&nbsp;<o:p></o:p></p><p =
class=3DMsoNormal>&nbsp;<o:p></o:p></p><p =
class=3DMsoNormal>&nbsp;<o:p></o:p></p><p =
class=3DMsoNormal>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&=
nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&n=
bsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nb=
sp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbs=
p;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp=
;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;=
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&=
nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&n=
bsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nb=
sp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbs=
p;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp=
;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;=
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&=
nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&n=
bsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nb=
sp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbs=
p;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp=
;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;=
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&=
nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; <o:p></o:p></p></blockquote><p =
class=3DMsoNormal><span style=3D'font-size:12.0pt;font-family:"Times New =
Roman",serif'><o:p>&nbsp;</o:p></span></p></div></body></html>
------=_NextPart_000_008B_01D04F60.C09A5960--