Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@hadoop.apache.org
Received-SPF: pass (athena.apache.org: domain of russell.jurney@gmail.com
 designates 209.85.216.176 as permitted sender)
References: <25119728.35086.1351193115152.JavaMail.mobile-sync@iebqf5>
From: Russell Jurney <russell.jurney@gmail.com>
In-Reply-To: <25119728.35086.1351193115152.JavaMail.mobile-sync@iebqf5>
Mime-Version: 1.0 (1.0)
Date: Sat, 27 Oct 2012 02:19:14 -0700
Message-ID: <5836084739702032378@unknownmsgid>
Subject: Re: reference architecture
To: "user@hadoop.apache.org" <user@hadoop.apache.org>
Content-Type: text/plain; charset=ISO-8859-1
Content-Transfer-Encoding: quoted-printable

Russell Jurney http://datasyndrome.com

On Oct 25, 2012, at 12:24 PM, "Daniel K=E4fer" <d.kaefer@hs-furtwangen.de> =
wrote:

> Hello all,
>
> I'm looking for a reference architecture for hadoop. The only result I
> found is Lambda architecture from Nathan Marz[0].
>
> With architecture I mean answers to question like:
> - How should I store the data? CSV, Thirft, ProtoBuf
You should use Avro.
> - How should I model the data? ER-Model, Starschema, something new?
You should use document format.
> - normalized or denormalized or both (master data normalized, then
> transformation to denormalized, like ETL)
Demoralized fully, into document format.
> - How should i combine database and HDFS-Files?
Don't. Put everything on HDFS.
>
> Are there any other documented architectures for hadoop?
I really did make an example in my book. It is just one example, but
you wanted answers to questions that always 'depend.' You can check it
out in slides: http://www.slideshare.net/mobile/hortonworks/agile-analytics=
-applications-on-hadoop
>
> Regards
> Daniel K=E4fer
>
>
> [0] http://www.manning.com/marz/ just a preprint yet, not completed
>