Mailing-List: contact hdfs-user-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
Reply-To: hdfs-user@hadoop.apache.org
Received-SPF: pass (nike.apache.org: domain of qwertymaniac@gmail.com
 designates 209.85.161.48 as permitted sender)
DomainKey-Signature: a=rsa-sha1; c=nofws;
        d=gmail.com; s=gamma;
        h=mime-version:in-reply-to:references:from:date:message-id:subject:to
         :content-type;
        b=FFcmIXBKDd0osOIzyv4KL3tzbg42+nCB5XJFarchqHmrz/zb2JNKodaP3BE6Ip57Uf
         x/fXmTgi31QlH1xp/4t5iodHBkfq9vHXdOI/Aha5gcoiU1wo1Q1+57yHpbTDq9keFdPx
         FQ8uUvdsIDLumns4yGPPTMtNanNqVE8MbiVj0=
MIME-Version: 1.0
In-Reply-To: <AANLkTikFebGD0-cmabwg64fpiGGOS-TSKq9TE+Qs+VCU@mail.gmail.com>
References: <AANLkTikFebGD0-cmabwg64fpiGGOS-TSKq9TE+Qs+VCU@mail.gmail.com>
From: Harsh J <qwertymaniac@gmail.com>
Date: Mon, 14 Mar 2011 23:32:05 +0530
Message-ID: <AANLkTim2FHop_9GhZCWZK04ixFcdchob6mTt-_rJEp+n@mail.gmail.com>
Subject: Re: problem to write on HDFS
To: hdfs-user@hadoop.apache.org
Content-Type: text/plain; charset=ISO-8859-1

You're running into ulimit issues (You have hit the number of open
files allowed for a/the user). It is not an uncommon problem, and some
web-searching should help you solve it :)

http://www.google.com/search?q=Too+many+open+files

Also, do remember to close your open files and file-system connections
when you're done with them for a task.

On Mon, Mar 14, 2011 at 11:18 PM, Alessandro Binhara <binhara@gmail.com> wrote:
> Hello ...
> I have a servlet on tomcat.. and it open a hdfs and write simple file with a
> content of post information.
> Well , in first test we had a 14.000 request per second.
> My servet start many trads to write on filesystem.
> i got this message on tomcat:
> Mar 11, 2011 6:00:20 PM org.apache.tomcat.util.net.JIoEndpoint$Acceptor run
> SEVERE: Socket accept failed
> java.net.SocketException: Too many open files
>
> HDFS is slow to write a file?
> How is a better strategy to write on HFDS...
> In real aplication we will have a 100.000 request per second to salve in
> hdfs.
> thanks..
>
>


-- 
Harsh J
http://harshj.com