hadoop-mapreduce-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Andre Kelpe <ake...@concurrentinc.com>
Subject Re: Hadoop 2.2.0 from source configuration
Date Mon, 02 Dec 2013 13:55:30 GMT
Hi Daniel,

first of all, before posting to a mailing list, take a deep breath and
let your frustrations out. Then write the email. Using words like
"crappy", "toxicware", "nightmare" are not going to help you getting
useful responses.

While I agree that the docs can be confusing, we should try to stay
constructive. You haven't  mentioned which documentation you are
using. I found the cluster tutorial sufficient to get me started:
http://hadoop.apache.org/docs/stable/hadoop-project-dist/hadoop-common/ClusterSetup.html

If you are looking for an easy way to spin up a small cluster with
hadoop 2.2, try the hadoop2 branch of this vagrant setup:

https://github.com/fs111/vagrant-hadoop-cluster/tree/hadoop2

- André

On Mon, Dec 2, 2013 at 5:34 AM, Daniel Savard <daniel.savard@gmail.com> wrote:
> I am trying to configure hadoop 2.2.0 from source code and I found the
> instructions really crappy and incomplete. It is like they were written to
> avoid someone can do the job himself and must contract someone else to do it
> or buy a packaged version.
>
> It is about three days I am struggling with this stuff with partial success.
> The documentation is less than clear and most of the stuff out there apply
> to earlier version and they haven't been updated for version 2.2.0.
>
> I was able to setup HDFS, however I am still unable to use it. I am doing a
> single node installation and the instruction page doesn't explain anything
> beside telling you to do this and that without documenting what each thing
> is doing and what choices are available and what guidelines you should
> follow. There is even environment variables you are told to set, but nothing
> is said about what they mean and to which value they should be set. It seems
> it assumes prior knowledge of everything about hadoop.
>
> Anyone knows a site with proper documentation about hadoop or it's hopeless
> and this whole thing is just a piece of toxicware?
>
> I am already looking for alternate solutions to hadoop which for sure will
> be a nightmare to manage and install each time a new version, release will
> become available.
>
> TIA
> -----------------
> Daniel Savard



-- 
André Kelpe
andre@concurrentinc.com
http://concurrentinc.com

Mime
View raw message