hama-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Edward J. Yoon (JIRA)" <j...@apache.org>
Subject [jira] Commented: (HAMA-116) ArrayIndexOutOfBoundsException at BlockingMapRed
Date Mon, 01 Dec 2008 16:41:44 GMT

    [ https://issues.apache.org/jira/browse/HAMA-116?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12652052#action_12652052
] 

Edward J. Yoon commented on HAMA-116:
-------------------------------------

BTW, There is too many read/write operation. 

This is a blocking job of 3000 * 3000 matrix. 
----
08/12/02 01:20:54 INFO mapred.JobClient: Counters: 13
08/12/02 01:20:54 INFO mapred.JobClient:   File Systems
08/12/02 01:20:54 INFO mapred.JobClient:     Local bytes read=917571894
08/12/02 01:20:54 INFO mapred.JobClient:     Local bytes written=1493961988
08/12/02 01:20:54 INFO mapred.JobClient:   Job Counters
08/12/02 01:20:54 INFO mapred.JobClient:     Launched reduce tasks=12
08/12/02 01:20:54 INFO mapred.JobClient:     Launched map tasks=14
08/12/02 01:20:54 INFO mapred.JobClient:   Map-Reduce Framework
08/12/02 01:20:54 INFO mapred.JobClient:     Reduce input groups=100
08/12/02 01:20:54 INFO mapred.JobClient:     Combine output records=0
08/12/02 01:20:54 INFO mapred.JobClient:     Map input records=5665
08/12/02 01:20:54 INFO mapred.JobClient:     Reduce output records=0
08/12/02 01:20:54 INFO mapred.JobClient:     Map output bytes=572484210
08/12/02 01:20:54 INFO mapred.JobClient:     Map input bytes=0
08/12/02 01:20:54 INFO mapred.JobClient:     Combine input records=0
08/12/02 01:20:54 INFO mapred.JobClient:     Map output records=56650
08/12/02 01:20:54 INFO mapred.JobClient:     Reduce input records=56650

> ArrayIndexOutOfBoundsException at BlockingMapRed
> ------------------------------------------------
>
>                 Key: HAMA-116
>                 URL: https://issues.apache.org/jira/browse/HAMA-116
>             Project: Hama
>          Issue Type: Bug
>          Components: mapred 
>            Reporter: Edward J. Yoon
>             Fix For: 0.1.0
>
>         Attachments: HAMA-116.patch
>
>
> [d8g053:/root/hama-trunk]# bin/hama examples mult -m 100 -r 100 1000 1000 
> ----
> 08/11/30 11:56:07 INFO mapred.JobClient:  map 100% reduce 1%
> 08/11/30 11:56:26 INFO mapred.JobClient:  map 100% reduce 0%
> 08/11/30 11:56:26 INFO mapred.JobClient: Task Id : attempt_200811271544_0006_r_0
> 00001_1, Status : FAILED
> java.lang.ArrayIndexOutOfBoundsException: 10
>         at org.apache.hama.SubMatrix.set(SubMatrix.java:61)
>         at org.apache.hama.mapred.BlockingMapRed$BlockingReducer.reduce(Blocking
> MapRed.java:146)
>         at org.apache.hama.mapred.BlockingMapRed$BlockingReducer.reduce(Blocking
> MapRed.java:127)
>         at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:318)
>         at org.apache.hadoop.mapred.TaskTracker$Child.main(TaskTracker.java:2207
> )

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message