hadoop-general mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Marcos Pinto <marcos...@gmail.com>
Subject Re: Is it possible write directly to datanode's?
Date Sat, 02 Oct 2010 21:16:08 GMT
Thanks Guys, I misunderstood the picture in the hadoop site. Now I know that
the namenode says in which datanode should be written and which part of
file. So I dont need to worry about it. Thanks.

On Sat, Oct 2, 2010 at 2:57 PM, Ryan Rawson <ryanobjc@gmail.com> wrote:

> I suggest you read this:
> http://hadoop.apache.org/common/docs/r0.20.0/hdfs_design.html
>
> -ryan
>
> On Fri, Oct 1, 2010 at 8:06 AM, Marcos Pinto <marcoscba@gmail.com> wrote:
> > Hi guys, I gotta a question and I really would appreciate some help,
> > suggestion, or advices.
> > Is it possible write directly to the datanode's and eliminate the
> bottleneck
> > to write into HDFS?
> > for example: I gotta 40 writers and I writes th data direct to namenode,
> i
> > was wondering if it would become a bottleneck so I would like to know
> > if it is possible to write the data direct to the datanode's.
> > I've read that Hadoop doesnt support multiple writes so how can we deal
> with
> > big cluster? I mean I am really going to have this bottleneck???
> >
> > Thanks in advanced.
> >
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message