hama-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Edward J. Yoon (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HAMA-558) Add graph generators from our benchmark section
Date Wed, 23 May 2012 02:02:41 GMT

    [ https://issues.apache.org/jira/browse/HAMA-558?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13281353#comment-13281353
] 

Edward J. Yoon commented on HAMA-558:
-------------------------------------

BTW, I'm receiving an below error with this patch. Is this a bug of VertexWritable?

{code}
12/05/23 10:58:57 INFO mapred.JobClient:  map 0% reduce 0%
12/05/23 10:59:11 INFO mapred.JobClient: Task Id : attempt_201205231058_0002_m_000000_0, Status
: FAILED
java.lang.NullPointerException
        at org.apache.hama.graph.VertexWritable.readFields(VertexWritable.java:100)
        at org.apache.hadoop.io.WritableComparator.compare(WritableComparator.java:97)
        at org.apache.hadoop.mapred.MapTask$MapOutputBuffer.compare(MapTask.java:1111)
        at org.apache.hadoop.util.QuickSort.fix(QuickSort.java:30)
        at org.apache.hadoop.util.QuickSort.sortInternal(QuickSort.java:83)
        at org.apache.hadoop.util.QuickSort.sort(QuickSort.java:59)
        at org.apache.hadoop.mapred.MapTask$MapOutputBuffer.sortAndSpill(MapTask.java:1399)
        at org.apache.hadoop.mapred.MapTask$MapOutputBuffer.flush(MapTask.java:1298)
        at org.apache.hadoop.mapred.MapTask$NewOutputCollector.close(MapTask.java:699)
        at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:766)
        at org.apache.hadoop.mapred.MapTask.run(MapTask.java:370)
        at org.apache.hadoop.mapred.Child$4.run(Child.java:255)
        at java.security.AccessController.doPrivileged(Native Method)
        at javax.security.auth.Subject.doAs(Subject.java:396)
        at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1083)
        at org.apache.hadoop.mapred.Child.main(Child.java:249)
{code}
                
> Add graph generators from our benchmark section
> -----------------------------------------------
>
>                 Key: HAMA-558
>                 URL: https://issues.apache.org/jira/browse/HAMA-558
>             Project: Hama
>          Issue Type: New Feature
>          Components: bsp core, examples, graph
>            Reporter: Thomas Jungblut
>            Assignee: Thomas Jungblut
>         Attachments: HAMA-558.patch, HAMA-558_2.patch
>
>
> In our graph algorithm benchmarks we used an MR based graph generator: http://wiki.apache.org/hama/Benchmarks#Single_Shortest_Path_Problem
> I have translated it to the new API and made a patch for it.
> So people can reproduce the results, create sample graphs and don't have to compile the
stuff from a java file.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Mime
View raw message