hadoop-mapreduce-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ashish Kumar9" <ashis...@in.ibm.com>
Subject RE: Windows and Linux hadoop cluster
Date Thu, 21 Jul 2016 03:07:53 GMT
I had used community edition . It was PoC and not production . I had hive 
use-case .



From:   "sreebalineni ." <sreebalineni@gmail.com>
To:     Ashish Kumar9/India/IBM@IBMIN
Cc:     Prachi Sharma <prachi.sharma0202.ps@gmail.com>, 
user@hadoop.apache.org, Alexander Alten-Lorenz <wget.null@gmail.com>
Date:   07/20/2016 10:24 PM
Subject:        RE: Windows and Linux hadoop cluster



Was it in production and good amount of workload? That's interesting. 
Which distribution was used

On Jul 20, 2016 8:13 PM, "Ashish Kumar9" <ashishk4@in.ibm.com> wrote:
I have tried heterogeneous hadoop 2.6 cluster across multiple linux 
distros and h/w architecture ( x86_64,ppc64le,aarc64) and it worked . I 
did not see any technical challenge . 



From:        Alexander Alten-Lorenz <wget.null@gmail.com>
To:        Prachi Sharma <prachi.sharma0202.ps@gmail.com>, "
user@hadoop.apache.org" <user@hadoop.apache.org>
Date:        07/20/2016 04:42 PM
Subject:        RE: Windows and Linux hadoop cluster



Hi,
 
That should be possible, but will have performance impacts / additional 
configurations and potential misbehavior. But in general, it should work 
for Yarn, but not for MRv1.
https://hadoop.apache.org/docs/r2.7.2/hadoop-yarn/hadoop-yarn-site/SecureContainer.html

 
cheers, 
 --alex
 
--
b: mapredit.blogspot.com 
 
From: Prachi Sharma
Sent: Wednesday, July 20, 2016 9:31 AM
To: user@hadoop.apache.org
Subject: Windows and Linux hadoop cluster
 
Hi All,
 
Please let me know if it’s feasible to have hadoop cluster with data nodes 
running on multiple Operating systems. For instance few data nodes running 
on windows server and others on linux based OS (RHEL,centOS).
 
If above scenario is feasible then please provide configuration settings 
required in various xml 
files(hdfs-site.xml,core-site.xml,mapred-site.xml,yarn-site.xml) and 
environment files(hadoop-env.sh/hadoop-cmd.sh) for windows and linux data 
nodes and namenode.
 
Thanks !
Prachi 
 



Mime
View raw message