hama-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Yexi Jiang <yexiji...@gmail.com>
Subject Re: ML test case fails
Date Wed, 28 Aug 2013 02:42:16 GMT
Since neural network leverages the randomization (for weight
initialization), with small probability it will fail to learn the correct
hypothesis and thus cause the error. I have remove all the assertion for
the test case to avoid such failure. The fix will come alone with issue 795.


2013/8/27 Yexi Jiang <yexijiang@gmail.com>

> I will check it.
>
>
> 2013/8/27 Tommaso Teofili <tommaso.teofili@gmail.com>
>
>> I couldn't reproduce it, which testcase is exactly failing?
>> Tommaso
>>
>>
>> 2013/8/24 Chia-Hung Lin <clin4j@googlemail.com>
>>
>> > When testing with the latest source obtained from svn (r1514736), ml
>> > test seems to fail. Is any setting is required? Just to check in case
>> > it's environment specific issue.
>> >
>> > -------------------------------------------------------
>> >  T E S T S
>> > -------------------------------------------------------
>> > Running org.apache.hama.ml.ann.TestSmallLayeredNeuralNetwork
>> > 13/08/24 17:38:20 WARN util.NativeCodeLoader: Unable to load
>> > native-hadoop library for your platform... using builtin-java classes
>> > where applicable
>> >
>> > 13/08/24 17:38:29 INFO mortbay.log: Training time: 9.488000s
>> >
>> >
>> > 13/08/24 17:38:29 INFO mortbay.log: Relative error: 20.000000%
>> >
>> >
>> > 13/08/24 17:38:20 INFO mortbay.log: Logging to
>> > org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via
>> > org.mortbay.log.Slf4jLog
>> >
>> > 13/08/24 17:38:20 INFO bsp.FileInputFormat: Total input paths to
>> process :
>> > 1
>> >
>> > 13/08/24 17:38:20 INFO bsp.FileInputFormat: Total input paths to
>> process :
>> > 1
>> >
>> > 13/08/24 17:38:20 WARN bsp.BSPJobClient: No job jar file set.  User
>> > classes may not be found. See BSPJob#setJar(String) or check Your jar
>> > file.
>> >
>> > 13/08/24 17:38:20 INFO bsp.BSPJobClient: Running job:
>> job_localrunner_0001
>> >
>> > 13/08/24 17:38:20 INFO bsp.LocalBSPRunner: Setting up a new barrier for
>> 1
>> > tasks!
>> >
>> > 13/08/24 17:38:23 INFO bsp.BSPJobClient: Current supersteps number: 1
>> >
>> > 13/08/24 17:38:23 INFO bsp.BSPJobClient: The total number of
>> supersteps: 1
>> >
>> > 13/08/24 17:38:23 INFO bsp.BSPJobClient: Counters: 6
>> >
>> > 13/08/24 17:38:23 INFO bsp.BSPJobClient:
>> > org.apache.hama.bsp.JobInProgress$JobCounter
>> >
>> > 13/08/24 17:38:23 INFO bsp.BSPJobClient:     SUPERSTEPS=1
>> >
>> > 13/08/24 17:38:23 INFO bsp.BSPJobClient:     LAUNCHED_TASKS=1
>> >
>> > 13/08/24 17:38:23 INFO bsp.BSPJobClient:
>> > org.apache.hama.bsp.BSPPeerImpl$PeerCounter
>> >
>> > 13/08/24 17:38:23 INFO bsp.BSPJobClient:     SUPERSTEP_SUM=2
>> >
>> > 13/08/24 17:38:23 INFO bsp.BSPJobClient:     IO_BYTES_READ=57416
>> >
>> > 13/08/24 17:38:23 INFO bsp.BSPJobClient:     TIME_IN_SYNC_MS=0
>> >
>> > 13/08/24 17:38:23 INFO bsp.BSPJobClient:     TASK_INPUT_RECORDS=618
>> >
>> > 13/08/24 17:38:23 INFO bsp.FileInputFormat: Total input paths to
>> process :
>> > 5
>> >
>> > 13/08/24 17:38:23 WARN bsp.BSPJobClient: No job jar file set.  User
>> > classes may not be found. See BSPJob#setJar(String) or check Your jar
>> > file.
>> >
>> > 13/08/24 17:38:23 INFO bsp.BSPJobClient: Running job:
>> job_localrunner_0001
>> >
>> > 13/08/24 17:38:23 INFO bsp.LocalBSPRunner: Setting up a new barrier for
>> 5
>> > tasks!
>> >
>> > 13/08/24 17:38:23 INFO mortbay.log: Begin to train
>> >
>> > 13/08/24 17:38:26 INFO bsp.BSPJobClient: Current supersteps number: 375
>> >
>> > 13/08/24 17:38:29 INFO bsp.BSPJobClient: Current supersteps number: 849
>> >
>> > 13/08/24 17:38:32 INFO bsp.BSPJobClient: Current supersteps number: 1377
>> >
>> > 13/08/24 17:38:35 INFO bsp.BSPJobClient: Current supersteps number: 1877
>> >
>> > 13/08/24 17:38:38 INFO bsp.BSPJobClient: Current supersteps number: 2435
>> >
>> > 13/08/24 17:38:41 INFO bsp.BSPJobClient: Current supersteps number: 3001
>> >
>> > 13/08/24 17:38:44 INFO bsp.BSPJobClient: Current supersteps number: 3573
>> >
>> > 13/08/24 17:38:46 INFO mortbay.log: End of training, number of
>> iterations:
>> > 2001.
>> >
>> >
>> > 13/08/24 17:38:46 INFO mortbay.log: Write model back to
>> > /tmp/distributed-model
>> >
>> >
>> > 13/08/24 17:38:47 INFO bsp.BSPJobClient: Current supersteps number: 3999
>> >
>> > 13/08/24 17:38:47 INFO bsp.BSPJobClient: The total number of supersteps:
>> > 3999
>> >
>> > 13/08/24 17:38:47 INFO bsp.BSPJobClient: Counters: 8
>> >
>> > 13/08/24 17:38:47 INFO bsp.BSPJobClient:
>> > org.apache.hama.bsp.JobInProgress$JobCounter
>> >
>> > 13/08/24 17:38:47 INFO bsp.BSPJobClient:     SUPERSTEPS=3999
>> >
>> > 13/08/24 17:38:47 INFO bsp.BSPJobClient:     LAUNCHED_TASKS=5
>> >
>> > 13/08/24 17:38:47 INFO bsp.BSPJobClient:
>> > org.apache.hama.bsp.BSPPeerImpl$PeerCounter
>> >
>> > 13/08/24 17:38:47 INFO bsp.BSPJobClient:     SUPERSTEP_SUM=20000
>> >
>> > 13/08/24 17:38:47 INFO bsp.BSPJobClient:     IO_BYTES_READ=278427240
>> >
>> > 13/08/24 17:38:47 INFO bsp.BSPJobClient:     TIME_IN_SYNC_MS=39611
>> >
>> > 13/08/24 17:38:47 INFO bsp.BSPJobClient:     TOTAL_MESSAGES_SENT=20000
>> >
>> > 13/08/24 17:38:47 INFO bsp.BSPJobClient:     TASK_INPUT_RECORDS=3000000
>> >
>> > 13/08/24 17:38:47 INFO bsp.BSPJobClient:
>> TOTAL_MESSAGES_RECEIVED=20000
>> >
>> > 13/08/24 17:38:47 INFO mortbay.log: Reload model from
>> > /tmp/distributed-model.
>> >
>> > 13/08/24 17:38:47 INFO mortbay.log: Training time: 27.490000s
>> >
>> >
>> > 13/08/24 17:38:47 INFO mortbay.log: Relative error: 24.666667%
>> >
>> >
>> > Tests run: 7, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 0.009
>> > sec <<< FAILURE!
>> >
>>
>
>
>
> --
> ------
> Yexi Jiang,
> ECS 251,  yjian004@cs.fiu.edu
> School of Computer and Information Science,
> Florida International University
> Homepage: http://users.cis.fiu.edu/~yjian004/
>
>


-- 
------
Yexi Jiang,
ECS 251,  yjian004@cs.fiu.edu
School of Computer and Information Science,
Florida International University
Homepage: http://users.cis.fiu.edu/~yjian004/

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message