Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id 3AC0D200B4A for ; Wed, 20 Jul 2016 18:54:26 +0200 (CEST) Received: by cust-asf.ponee.io (Postfix) id 3907E160A64; Wed, 20 Jul 2016 16:54:26 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id 59794160A5B for ; Wed, 20 Jul 2016 18:54:25 +0200 (CEST) Received: (qmail 45504 invoked by uid 500); 20 Jul 2016 16:54:23 -0000 Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Delivered-To: mailing list user@hadoop.apache.org Received: (qmail 45487 invoked by uid 99); 20 Jul 2016 16:54:22 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd4-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 20 Jul 2016 16:54:22 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd4-us-west.apache.org (ASF Mail Server at spamd4-us-west.apache.org) with ESMTP id 7A0E0C0B66 for ; Wed, 20 Jul 2016 16:54:22 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd4-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 2.879 X-Spam-Level: ** X-Spam-Status: No, score=2.879 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, HTML_MESSAGE=2, KAM_LIVE=1, RCVD_IN_DNSWL_NONE=-0.0001, RCVD_IN_MSPIKE_H3=-0.01, RCVD_IN_MSPIKE_WL=-0.01, SPF_PASS=-0.001] autolearn=disabled Authentication-Results: spamd4-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com Received: from mx1-lw-us.apache.org ([10.40.0.8]) by localhost (spamd4-us-west.apache.org [10.40.0.11]) (amavisd-new, port 10024) with ESMTP id ds-E6-Rw0ajN for ; Wed, 20 Jul 2016 16:54:20 +0000 (UTC) Received: from mail-yw0-f181.google.com (mail-yw0-f181.google.com [209.85.161.181]) by mx1-lw-us.apache.org (ASF Mail Server at mx1-lw-us.apache.org) with ESMTPS id 3AD2C5FDB9 for ; Wed, 20 Jul 2016 16:54:20 +0000 (UTC) Received: by mail-yw0-f181.google.com with SMTP id z8so28905728ywa.1 for ; Wed, 20 Jul 2016 09:54:20 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc; bh=jiwZ+HjrwwiAH4VPkEWlmZwRD/VpWpdMUmn2SsjwZ14=; b=cWwz5UjoZax4cnV3WXBIlLufhthucrRd/nFpdQC2qcfVIz6+LZDvKfEudzU4H1nVHI 1ANNQKCe4Eziv66/lyKKeD+tart68CL1i3HfQkU7ZCG2OkjR5c1rZBjhMA5rk8BRvjB8 2D4BtlZWJLVnyf1b2CvRSDKm2mlBU5pMGajjv76lAFaEefYAFWAcuBD6MsEEAouOKowq HXGV2RXkcGuyszFtK8G3y09dtFyaAVG7XVPoR6ud1nLj3JIlzftBU01JLvNXIQpI7yYQ MB2UvhHGOfii5kmZ4lMTlVv3vgar9jr/rzmfOlHp9itaKNy162OJqE1QlBZiS2eHkzA6 B74A== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:mime-version:in-reply-to:references:date :message-id:subject:from:to:cc; bh=jiwZ+HjrwwiAH4VPkEWlmZwRD/VpWpdMUmn2SsjwZ14=; b=l8+LTLDsMGXNoBVrTEYvY0Z5YgyLaIB1Wjma8pxVyeIjewfrWZlhgIAby+oK8fhBCU vVuGTsiHMQ0EaNUCozHY4gAwYNlmMyn5sJ+7tJ3SgmE7v9PUyBazmeedgh5BaGNnGDpP g5G2AD/o4p1Hh3fFiRevwBLcYw3Ko7vYmR6TDFAobLsCl25poRRE1UzF8zk4BVTBja1v 2lpqABlOl5Q0K8kKoTjuXQ3IUAeLjnLqqEV2kf77YLP/VFaJxALEHSxFxmdzowlG60fw qRaYpS3/i7uORn3grC/Gkp3Z0OsSS6+7Ke8QmhFOt1dAzAu9SbaU4OmjGGiLPnmYpIRR hycQ== X-Gm-Message-State: ALyK8tJA1uNqgiuUXQdo+H/lB+X0qQhRfSIzEqixrHpFsfl7yU+IxsP065eYRs7HM0i7Dmu3Uon1qPrJWvtY4g== MIME-Version: 1.0 X-Received: by 10.13.212.139 with SMTP id w133mr31874617ywd.49.1469033658878; Wed, 20 Jul 2016 09:54:18 -0700 (PDT) Received: by 10.37.106.68 with HTTP; Wed, 20 Jul 2016 09:54:18 -0700 (PDT) Received: by 10.37.106.68 with HTTP; Wed, 20 Jul 2016 09:54:18 -0700 (PDT) In-Reply-To: References: <578f5c89.e318c20a.61a06.444e@mx.google.com> Date: Wed, 20 Jul 2016 22:24:18 +0530 Message-ID: Subject: RE: Windows and Linux hadoop cluster From: "sreebalineni ." To: Ashish Kumar9 Cc: Prachi Sharma , user@hadoop.apache.org, Alexander Alten-Lorenz Content-Type: multipart/alternative; boundary=001a114fd3346695540538140d04 archived-at: Wed, 20 Jul 2016 16:54:26 -0000 --001a114fd3346695540538140d04 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable Was it in production and good amount of workload? That's interesting. Which distribution was used On Jul 20, 2016 8:13 PM, "Ashish Kumar9" wrote: > I have tried heterogeneous hadoop 2.6 cluster across multiple linux > distros and h/w architecture ( x86_64,ppc64le,aarc64) and it worked . I d= id > not see any technical challenge . > > > > From: Alexander Alten-Lorenz > To: Prachi Sharma , " > user@hadoop.apache.org" > Date: 07/20/2016 04:42 PM > Subject: RE: Windows and Linux hadoop cluster > ------------------------------ > > > > Hi, > > That should be possible, but will have performance impacts / additional > configurations and potential misbehavior. But in general, it should work > for Yarn, but not for MRv1. > > *https://hadoop.apache.org/docs/r2.7.2/hadoop-yarn/hadoop-yarn-site/Secur= eContainer.html* > > > cheers, > --alex > > -- > b: mapredit.blogspot.com > > *From: **Prachi Sharma* > *Sent: *Wednesday, July 20, 2016 9:31 AM > *To: **user@hadoop.apache.org* > *Subject: *Windows and Linux hadoop cluster > > Hi All, > > Please let me know if it=E2=80=99s feasible to have hadoop cluster with d= ata nodes > running on multiple Operating systems. For instance few data nodes runnin= g > on windows server and others on linux based OS (RHEL,centOS). > > If above scenario is feasible then please provide configuration settings > required in various xml > files(hdfs-site.xml,core-site.xml,mapred-site.xml,yarn-site.xml) and > environment files(*hadoop-env.sh/hadoop-cmd.sh* > ) for windows and linux data nodes > and namenode. > > Thanks ! > Prachi > > > --001a114fd3346695540538140d04 Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: quoted-printable

Was it in production and good amount of workload? That's= interesting. Which distribution was used


On Jul 20, 2016 8= :13 PM, "Ashish Kumar9" <ashishk4@in.ibm.com> wrote:
I have tried heteroge= neous hadoop 2.6 cluster across multiple linux distros and h/w architecture ( x86_64,ppc64le,aarc64) and it worked . I did not see any technical challenge .


=
From: =C2=A0 =C2= =A0 =C2=A0 =C2=A0Alexander Alten-Lorenz <wget.null@gmai= l.com>
To: =C2=A0 =C2=A0 =C2=A0 =C2=A0Prachi Sharma <prachi.sharma0= 202.ps@gmail.com>, "user@hado= op.apache.org" <user@hadoop.apache.org>
Date: =C2=A0 =C2=A0 =C2=A0 =C2=A007/20/2016 04:42 PM
Subject: =C2=A0= =C2=A0 =C2=A0 =C2=A0RE: Windows and Linux hadoop cluster



Hi,
=C2=A0
That should be possible, but will= have performance impacts / additional configurations and potential misbehavior. But in general, it should work for Yarn, but not for MRv1.
https://hadoop.apache.org/docs/r2.7.2/hadoop-yarn/hadoop-ya= rn-site/SecureContainer.html
=C2=A0
cheers, =C2=A0--alex
=C2=A0
--
b: mapredit.blogspot.com
=C2=A0
From: Pr= achi Sharma
Sent: Wed= nesday, July 20, 2016 9:31 AM
To: user@hadoop.apache.org
Subject: Windows and Linux hadoop cluster
=C2=A0
Hi All,
=C2=A0
Please let me know if it=E2=80= =99s feasible to have hadoop cluster with data nodes running on multiple Operating systems. For instance few data nodes running on windows server and others on linux based OS (RHEL,centOS).
=C2=A0<= /font>
If above scenario is feasible t= hen please provide configuration settings required in various xml files(hdfs-site.xml,= core-site.xml,mapred-site.xml,yarn-site.xml) and environment files(hado= op-env.sh/hadoop-cmd.sh) for windows and linux data nodes and namenode.
=C2=A0
Thanks !=
Prachi
=C2=A0

--001a114fd3346695540538140d04--