hadoop-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Kartashov, Andy" <Andy.Kartas...@mpac.ca>
Subject RE: Map-Reduce V/S Hadoop Ecosystem
Date Wed, 07 Nov 2012 16:06:35 GMT
The way I understand it...

Hadoop is a distributed file system that allows you to create folders in its own NameSpace,
copy  files to and  from your local Linux FS. Set-up Hadoop configuration for local|pseudo-distributed|fully-distributed
cluster.

You write your jobs using MapReduce API and execute them in Hadoop eco-system. I write mine
in Java and  would rate my experience, say at 6-7. I use Sqoop to import data into HDFS from
RDMS MySql. I use Sqoop-generated classes to read data into the Mapper and design my own classes
for the reducer which provide the required output.

Rgds,

-----Original Message-----
From: yogesh.kumar13@wipro.com [mailto:yogesh.kumar13@wipro.com]
Sent: Wednesday, November 07, 2012 10:33 AM
To: user@hadoop.apache.org
Subject: Map-Reduce V/S Hadoop Ecosystem

Hello Hadoop Champs,

Please give some suggestion..

As Hadoop Ecosystem(Hive, Pig...) internally do Map-Reduce to process.

My Question is

1). where Map-Reduce program(written in Java, python etc) are overtaking Hadoop Ecosystem.

2). Limitations of Hadoop Ecosystem comparing with Writing Map-Reduce program.

3) for writing Map-Reduce jobs in java how much we need to have skills in java out of 10 (?/10)


Please put some light over it.


Thanks & Regards
Yogesh Kumar


The information contained in this electronic message and any attachments to this message are
intended for the exclusive use of the addressee(s) and may contain proprietary, confidential
or privileged information. If you are not the intended recipient, you should not disseminate,
distribute or copy this e-mail. Please notify the sender immediately and destroy all copies
of this message and any attachments.

WARNING: Computer viruses can be transmitted via email. The recipient should check this email
and any attachments for the presence of viruses. The company accepts no liability for any
damage caused by any virus transmitted by this email.

www.wipro.com
NOTICE: This e-mail message and any attachments are confidential, subject to copyright and
may be privileged. Any unauthorized use, copying or disclosure is prohibited. If you are not
the intended recipient, please delete and contact the sender immediately. Please consider
the environment before printing this e-mail. AVIS : le présent courriel et toute pièce jointe
qui l'accompagne sont confidentiels, protégés par le droit d'auteur et peuvent être couverts
par le secret professionnel. Toute utilisation, copie ou divulgation non autorisée est interdite.
Si vous n'êtes pas le destinataire prévu de ce courriel, supprimez-le et contactez immédiatement
l'expéditeur. Veuillez penser à l'environnement avant d'imprimer le présent courriel
Mime
View raw message