Mailing-List: contact common-user-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
Reply-To: common-user@hadoop.apache.org
Received-SPF: pass (nike.apache.org: domain of airbots@gmail.com designates
 74.125.82.176 as permitted sender)
DomainKey-Signature: a=rsa-sha1; c=nofws;
        d=gmail.com; s=gamma;
        h=mime-version:in-reply-to:references:date:message-id:subject:from:to
         :content-type;
        b=ZyAWWz5mDQjvTvxATCTyma2Ul30oh9xgG3SIoqXUq+98TdqOPCA5rSuO+oW0LargDO
         DHx9G+Sb8YA8XST8y505bzQqf/pxcOGX/6qA/Yyyzs6dFDXpz452S5qjli2somAcWIW4
         e5Uy1UH+0enoLRlv6u9SVRCgrxujvy+Lza+Jk=
MIME-Version: 1.0
In-Reply-To: <AANLkTik+5GFT03Mwqg=LZNJXmv94B-FKBfJ_31gQxRAA@mail.gmail.com>
References: <AANLkTikjyZYrq3MKgQ1EsDxMQxyV+HW13QN3Q58Q6fvG@mail.gmail.com>
	<AANLkTinteb_ziSRbUy9FM=ssw_6z9CRPqLcrDycaTgNX@mail.gmail.com>
	<AANLkTikJaNAYA6pxb6B9MGhCK+PNVCazf0Uj5piea=wc@mail.gmail.com>
	<AANLkTik+5GFT03Mwqg=LZNJXmv94B-FKBfJ_31gQxRAA@mail.gmail.com>
Date: Sun, 26 Sep 2010 06:29:03 -0500
Message-ID: <AANLkTi=JQw9AEueaa4ynuE=LdqAqFdNbs7vT0z8pcvvE@mail.gmail.com>
Subject: Re: Can not upload local file to HDFS
From: He Chen <airbots@gmail.com>
To: common-user@hadoop.apache.org
Content-Type: multipart/alternative; boundary=0016364c7949452eb7049127eb89

--0016364c7949452eb7049127eb89
Content-Type: text/plain; charset=ISO-8859-1

The problem is every datanode may be listed in the error report. That means
all my datanodes are bad?

One thing I forgot to mention. I can not use start-all.sh and stop-all.sh to
start and stop all dfs and mapred processes on my clusters. But the
jobtracker and namenode web interface still work.

I think I can solve this problem by ssh to every node and kill current
hadoop processes and restart them again. The previous problem will also be
solved( it's my opinion). But I really want to know why the HDFS reports me
previous errors.


On Sat, Sep 25, 2010 at 11:20 PM, Nan Zhu <zhunansjtu@gmail.com> wrote:

> Hi Chen,
>
> It seems that you have a bad datanode? maybe you should reformat them?
>
> Nan
>
> On Sun, Sep 26, 2010 at 10:42 AM, He Chen <airbots@gmail.com> wrote:
>
> > Hello Neil
> >
> > No matter how big the file is. It always report this to me. The file size
> > is
> > from 10KB to 100MB.
> >
> > On Sat, Sep 25, 2010 at 6:08 PM, Neil Ghosh <neil.ghosh@gmail.com>
> wrote:
> >
> > > How Big is the file? Did you try Formatting Name node and Datanode?
> > >
> > > On Sun, Sep 26, 2010 at 2:12 AM, He Chen <airbots@gmail.com> wrote:
> > >
> > > > Hello everyone
> > > >
> > > > I can not load local file to HDFS. It gave the following errors.
> > > >
> > > > WARN hdfs.DFSClient: DFSOutputStream ResponseProcessor exception  for
> > > block
> > > > blk_-236192853234282209_419415java.io.EOFException
> > > >        at java.io.DataInputStream.readFully(DataInputStream.java:197)
> > > >        at java.io.DataInputStream.readLong(DataInputStream.java:416)
> > > >        at
> > > >
> > > >
> > >
> >
> org.apache.hadoop.hdfs.DFSClient$DFSOutputStream$ResponseProcessor.run(DFSClient.java:2397)
> > > > 10/09/25 15:38:25 WARN hdfs.DFSClient: Error Recovery for block
> > > > blk_-236192853234282209_419415 bad datanode[0] 192.168.0.23:50010
> > > > 10/09/25 15:38:25 WARN hdfs.DFSClient: Error Recovery for block
> > > > blk_-236192853234282209_419415 in pipeline 192.168.0.23:50010,
> > > > 192.168.0.39:50010: bad datanode 192.168.0.23:50010
> > > > Any response will be appreciated!
> > > >
> > > >
>

--0016364c7949452eb7049127eb89--