hadoop-hdfs-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From visioner sadak <visioner.sa...@gmail.com>
Subject Re: Hadoop Federation help
Date Mon, 20 Aug 2012 09:03:26 GMT
Thanks Harsh

saw tht federation is available in release 0.23.0 (
http://hadoop.apache.org/common/releases.html) so thought that it must be
in 1.0.x as it is latest stable  than 0.23.0...

yeah but for small file i think will have to go by HAR only,but are HAR's
mutable in newer versions
or its still immutable...
On Mon, Aug 20, 2012 at 2:21 PM, Harsh J <harsh@cloudera.com> wrote:

> Apache Hadoop 1.x does not have Federated NameNodes. It is however
> present in the Apache Hadoop 2.x releases. NameNodes can indeed scale
> with federated setups, but for faster bulk processing it is still not
> a good idea to keep around tiny files when you can have them bigger.
>
> On Mon, Aug 20, 2012 at 1:26 PM, visioner sadak
> <visioner.sadak@gmail.com> wrote:
> > Hello experts,
> >
> > Need some help, does the latest stable release 1.0.3 has hadoop
> federation
> > (in which we can have multiple name nodes), can the problem of large
> small
> > file uploads(
> http://www.cloudera.com/blog/2009/02/the-small-files-problem/)
> > be solved if we use this version with hadoop federation as we get name
> nodes
> > in clusters
>
>
>
> --
> Harsh J
>

Mime
View raw message