hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Uma Maheswara Rao G 72686 <mahesw...@huawei.com>
Subject Re: HDFS file into Blocks
Date Mon, 26 Sep 2011 06:41:18 GMT
@Kartheek,
 Great :-)

----- Original Message -----
From: kartheek muthyala <kartheek0274@gmail.com>
Date: Monday, September 26, 2011 12:06 pm
Subject: Re: HDFS file into Blocks
To: common-user@hadoop.apache.org

> @Uma,
> Thanks alot!!.
> I have found the flow...
> Thanks,
> Kartheek.
> 
> On Mon, Sep 26, 2011 at 10:03 AM, He Chen <airbots@gmail.com> wrote:
> 
> > Hi
> >
> > It is interesting that a guy from Huawei is also working on 
> Hadoop project.
> > :)
> >
> > Chen
> >
> > On Sun, Sep 25, 2011 at 11:29 PM, Uma Maheswara Rao G 72686 <
> > maheswara@huawei.com> wrote:
> >
> > >
> > > Hi,
> > >
> > >  You can find the Code in DFSOutputStream.java
> > >  Here there will be one thread DataStreamer thread. This 
> thread will pick
> > > the packets from DataQueue and write on to the sockets.
> > >  Before this, when actually writing the chunks, based on the 
> block size
> > > parameter passed from client, it will set the last packet 
> parameter in
> > > Packet.
> > >  If the streamer thread finds that is the last block then it 
> end the
> > block.
> > > That means it will close the socket which were used for witing 
> the block.
> > >  Streamer thread repeat the loops. When it find there is no 
> sockets open
> > > then it will again create the pipeline for the next block.
> > >  Go throgh the flow from writeChunk in DFSOutputStream.java, where
> > exactly
> > > enqueing the packets in dataQueue.
> > >
> > > Regards,
> > > Uma
> > > ----- Original Message -----
> > > From: kartheek muthyala <kartheek0274@gmail.com>
> > > Date: Sunday, September 25, 2011 11:06 am
> > > Subject: HDFS file into Blocks
> > > To: common-user@hadoop.apache.org
> > >
> > > > Hi all,
> > > > I am working around the code to understand where HDFS 
> divides a
> > > > file into
> > > > blocks. Can anyone point me to this section of the code?
> > > > Thanks,
> > > > Kartheek
> > > >
> > >
> >
> 

Mime
View raw message