hadoop-hdfs-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Konstantin Boudnik <...@yahoo-inc.com>
Subject Re: Problem formatting namenode
Date Thu, 18 Mar 2010 17:41:01 GMT
These are 2004 dated issues. JDK team at Sun is better than not touching bugs
for almost 6 years, c'mon.

    Cos

On Thu, Mar 18, 2010 at 12:15AM, Gokulakannan M wrote:
>    Hi Todd,
> 
>     
> 
>                What I meant is that sun nio has issues when it comes to large
>    volume of data.
> 
>               
> 
>                These are the references related to this.
> 
>                http://bugs.sun.com/bugdatabase/view_bug.do?bug_id=4938442
>                http://forums.sun.com/thread.jspa?threadID=607775
> 
>     
> 
>                Coming back to this issue, I suspected that nio might be
>    having similar problem when it comes to large disk volume also.
> 
>     
> 
>     Thanks,
> 
>      Gokul
> 
>     
> 
>    --------------------------------------------------------------------------
> 
>    From: Todd Lipcon [mailto:todd@cloudera.com]
>    Sent: Wednesday, March 17, 2010 9:26 PM
>    To: hdfs-user@hadoop.apache.org; gokulm@huawei.com
>    Subject: Re: Problem formatting namenode
> 
>     
> 
>    Hi Gokul,
> 
>    Do you have a reference to a Java bug ID that discusses this? I wasn't
>    aware of problems with large disks and Java NIO.
> 
>    -Todd
> 
>    On Tue, Mar 16, 2010 at 11:49 PM, Gokulakannan M <gokulm@huawei.com>
>    wrote:
> 
>    Hi,
> 
>     
> 
>          The problem here is the FileDispatcher.pwrite of sun nio.
> 
>          The FileDispatcher.java has so many issues when it comes to large
>    volume.    
> 
>     
> 
>          Can anyone suggest an alternative that can be used instead of sun
> 
>          nio's FileDispatcher.java in
> 
>     
> 
>         
>    org.apache.hadoop.hdfs.server.namenode.FSEditLog$EditLogFileOutputStream.pre
>    allocate(FSEditLog.java:228) ???
> 
>     
> 
>     
> 
>     Thanks,
> 
>      Gokul
> 
>     
> 
>     
> 
>     
> 
>    --
>    Todd Lipcon
>    Software Engineer, Cloudera

Mime
View raw message