hadoop-hdfs-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Yoonmin Nam" <rony...@dgist.ac.kr>
Subject The work-process file creation and block generation.
Date Tue, 08 Oct 2013 07:04:07 GMT
Hello.

 

I want to see every detail of 

1)     Block generation on hdfs when I put the file which has size over at
lease 64MB.

2)     Generating inputsplits given several blocks in hdfs.

 

So, at first I tried to find related unit test source codes and I found
TestFileCreationClient.java.

However, there is any specific reference such as Block, BlockMetaInfo and I
just found a FSDataOutputStream reference.

 

In addition, In the TestFileCreation.java in mapred test package, it is so
complicated and really hard to figure how this all processes were occurred.

 

Please give me some tips and advices or relative documents for these
processes.

 

Thanks!


Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message