hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From kartheek muthyala <kartheek0...@gmail.com>
Subject Re: HDFS file into Blocks
Date Mon, 26 Sep 2011 06:34:32 GMT
@Uma,
Thanks alot!!.
I have found the flow...
Thanks,
Kartheek.

On Mon, Sep 26, 2011 at 10:03 AM, He Chen <airbots@gmail.com> wrote:

> Hi
>
> It is interesting that a guy from Huawei is also working on Hadoop project.
> :)
>
> Chen
>
> On Sun, Sep 25, 2011 at 11:29 PM, Uma Maheswara Rao G 72686 <
> maheswara@huawei.com> wrote:
>
> >
> > Hi,
> >
> >  You can find the Code in DFSOutputStream.java
> >  Here there will be one thread DataStreamer thread. This thread will pick
> > the packets from DataQueue and write on to the sockets.
> >  Before this, when actually writing the chunks, based on the block size
> > parameter passed from client, it will set the last packet parameter in
> > Packet.
> >  If the streamer thread finds that is the last block then it end the
> block.
> > That means it will close the socket which were used for witing the block.
> >  Streamer thread repeat the loops. When it find there is no sockets open
> > then it will again create the pipeline for the next block.
> >  Go throgh the flow from writeChunk in DFSOutputStream.java, where
> exactly
> > enqueing the packets in dataQueue.
> >
> > Regards,
> > Uma
> > ----- Original Message -----
> > From: kartheek muthyala <kartheek0274@gmail.com>
> > Date: Sunday, September 25, 2011 11:06 am
> > Subject: HDFS file into Blocks
> > To: common-user@hadoop.apache.org
> >
> > > Hi all,
> > > I am working around the code to understand where HDFS divides a
> > > file into
> > > blocks. Can anyone point me to this section of the code?
> > > Thanks,
> > > Kartheek
> > >
> >
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message