Mailing-List: contact hdfs-user-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
Reply-To: hdfs-user@hadoop.apache.org
Received-SPF: neutral (nike.apache.org: local policy)
Date: Thu, 18 Mar 2010 10:41:01 -0700
From: Konstantin Boudnik <cos@yahoo-inc.com>
To: "hdfs-user@hadoop.apache.org" <hdfs-user@hadoop.apache.org>,
        "gokulm@huawei.com" <gokulm@huawei.com>
Cc: "todd@cloudera.com" <todd@cloudera.com>
Subject: Re: Problem formatting namenode
Message-ID: <20100318174101.GB68847@wlanvpn-mc2e-246-164.corp.yahoo.com>
References: <45f85f71003170855n49307064j831176953cb853de@mail.gmail.com>
 <000701cac66a$c41c4320$2401120a@china.huawei.com>
MIME-Version: 1.0
Content-Type: text/plain; charset=koi8-r
Content-Disposition: inline
In-Reply-To: <000701cac66a$c41c4320$2401120a@china.huawei.com>
User-Agent: Mutt/1.5.20 (2009-06-14)

These are 2004 dated issues. JDK team at Sun is better than not touching bugs
for almost 6 years, c'mon.

    Cos

On Thu, Mar 18, 2010 at 12:15AM, Gokulakannan M wrote:
>    Hi Todd,
> 
>     
> 
>                What I meant is that sun nio has issues when it comes to large
>    volume of data.
> 
>               
> 
>                These are the references related to this.
> 
>                http://bugs.sun.com/bugdatabase/view_bug.do?bug_id=4938442
>                http://forums.sun.com/thread.jspa?threadID=607775
> 
>     
> 
>                Coming back to this issue, I suspected that nio might be
>    having similar problem when it comes to large disk volume also.
> 
>     
> 
>     Thanks,
> 
>      Gokul
> 
>     
> 
>    --------------------------------------------------------------------------
> 
>    From: Todd Lipcon [mailto:todd@cloudera.com]
>    Sent: Wednesday, March 17, 2010 9:26 PM
>    To: hdfs-user@hadoop.apache.org; gokulm@huawei.com
>    Subject: Re: Problem formatting namenode
> 
>     
> 
>    Hi Gokul,
> 
>    Do you have a reference to a Java bug ID that discusses this? I wasn't
>    aware of problems with large disks and Java NIO.
> 
>    -Todd
> 
>    On Tue, Mar 16, 2010 at 11:49 PM, Gokulakannan M <gokulm@huawei.com>
>    wrote:
> 
>    Hi,
> 
>     
> 
>          The problem here is the FileDispatcher.pwrite of sun nio.
> 
>          The FileDispatcher.java has so many issues when it comes to large
>    volume.    
> 
>     
> 
>          Can anyone suggest an alternative that can be used instead of sun
> 
>          nio's FileDispatcher.java in
> 
>     
> 
>         
>    org.apache.hadoop.hdfs.server.namenode.FSEditLog$EditLogFileOutputStream.pre
>    allocate(FSEditLog.java:228) ???
> 
>     
> 
>     
> 
>     Thanks,
> 
>      Gokul
> 
>     
> 
>     
> 
>     
> 
>    --
>    Todd Lipcon
>    Software Engineer, Cloudera