hama-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Martin Illecker <millec...@apache.org>
Subject Re: fs.FSInputChecker: Problem opening checksum file: file:/home/hadoop/file/kmeans/center/cen.seq
Date Thu, 09 Jan 2014 10:12:58 GMT
Hi,

a patch [1] is available and will be committed into TRUNK shortly.

Please use the TRUNK.
Thanks for your report.

Kind regards,

Martin

[1] https://issues.apache.org/jira/browse/HAMA-834


2014/1/9 Martin Illecker <millecker@apache.org>

> Hi,
>
> sorry for inconvenience, I have reopened a issue [1] to fix this.
>
> The problem exists only when K = N. (amount of centers is equal to the
> amount of vectors)
>
> The following parameter should work:
>
> file:///home/hadoop/file/kmeans/kmeansinput file:///home/hadoop/file/kmeansoutput
> 5 5 -g *6* 5
>
> I will fix this asap.
>
> Kind regards,
>
> Martin
>
> [1] https://issues.apache.org/jira/browse/HAMA-834
>
>
>
>
> 2014/1/9 步青云 <mailliuping@qq.com>
>
>> Hi,
>>       I'm trying to run the Kmeans example of Hama.The args is
>> "file:///home/hadoop/file/kmeans/kmeansinput
>> file:///home/hadoop/file/kmeansoutput 5 5 -g 5 5". What's more , the attach
>> is "kmeansinput.txt".But I got the problem as follows:
>>
>> 14/01/09 16:38:52 WARN fs.FSInputChecker: Problem opening checksum file:
>> file:/home/hadoop/file/kmeans/center/cen.seq.  Ignoring exception:
>> java.io.EOFException
>> at java.io.DataInputStream.readFully(DataInputStream.java:197)
>>  at java.io.DataInputStream.readFully(DataInputStream.java:169)
>> at
>> org.apache.hadoop.fs.ChecksumFileSystem$ChecksumFSInputChecker.<init>(ChecksumFileSystem.java:134)
>>  at
>> org.apache.hadoop.fs.ChecksumFileSystem.open(ChecksumFileSystem.java:283)
>> at
>> org.apache.hadoop.io.SequenceFile$Reader.openFile(SequenceFile.java:1437)
>>  at
>> org.apache.hadoop.io.SequenceFile$Reader.<init>(SequenceFile.java:1424)
>> at org.apache.hadoop.io.SequenceFile$Reader.<init>(SequenceFile.java:1417)
>>  at
>> org.apache.hadoop.io.SequenceFile$Reader.<init>(SequenceFile.java:1412)
>> at org.apache.hama.ml.kmeans.KMeansBSP.setup(KMeansBSP.java:90)
>>  at
>> org.apache.hama.bsp.LocalBSPRunner$BSPRunner.run(LocalBSPRunner.java:255)
>> at
>> org.apache.hama.bsp.LocalBSPRunner$BSPRunner.call(LocalBSPRunner.java:286)
>>  at
>> org.apache.hama.bsp.LocalBSPRunner$BSPRunner.call(LocalBSPRunner.java:1)
>> at java.util.concurrent.FutureTask.run(FutureTask.java:262)
>>  at
>> java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
>> at java.util.concurrent.FutureTask.run(FutureTask.java:262)
>>  at
>> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
>> at
>> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
>>  at java.lang.Thread.run(Thread.java:724)
>>
>>        And "cen.seq" is empty.There might be old checksum files in your
>> HDFS or local filesystem.But I don't how to clean them up.
>>        Could you help me to solve this problem?
>>        Thanks.
>>        Best wishes.
>> Ping Liu
>> 01-09,2014
>>
>
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message