incubator-hama-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Edward J. Yoon (JIRA)" <j...@apache.org>
Subject [jira] Updated: (HAMA-143) Improve of random_mapred()
Date Tue, 06 Jan 2009 13:00:48 GMT

     [ https://issues.apache.org/jira/browse/HAMA-143?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Edward J. Yoon updated HAMA-143:
--------------------------------

    Attachment: HAMA-143_v01.patch

I add flushCommits() to recordwriter.close().

    public void close(@SuppressWarnings("unused")
    Reporter reporter) throws IOException {
      m_table.flushCommits();
    }

----
Speed also improved.

09/01/06 21:52:22 INFO mapred.JobClient: Running job: job_200901061852_0016
09/01/06 21:52:23 INFO mapred.JobClient:  map 0% reduce 0%
09/01/06 21:52:36 INFO mapred.JobClient:  map 1% reduce 0%
09/01/06 21:52:38 INFO mapred.JobClient:  map 3% reduce 0%
09/01/06 21:52:39 INFO mapred.JobClient:  map 10% reduce 0%
09/01/06 21:52:41 INFO mapred.JobClient:  map 12% reduce 0%
09/01/06 21:52:43 INFO mapred.JobClient:  map 14% reduce 0%
09/01/06 21:52:46 INFO mapred.JobClient:  map 17% reduce 0%
09/01/06 21:52:47 INFO mapred.JobClient:  map 21% reduce 0%
09/01/06 21:52:48 INFO mapred.JobClient:  map 23% reduce 0%
09/01/06 21:52:51 INFO mapred.JobClient:  map 28% reduce 0%
09/01/06 21:52:52 INFO mapred.JobClient:  map 30% reduce 0%
09/01/06 21:52:53 INFO mapred.JobClient:  map 34% reduce 0%
09/01/06 21:52:55 INFO mapred.JobClient:  map 36% reduce 0%
09/01/06 21:52:56 INFO mapred.JobClient:  map 36% reduce 1%
09/01/06 21:52:57 INFO mapred.JobClient:  map 40% reduce 1%
09/01/06 21:52:58 INFO mapred.JobClient:  map 44% reduce 2%
09/01/06 21:53:03 INFO mapred.JobClient:  map 48% reduce 3%
09/01/06 21:53:04 INFO mapred.JobClient:  map 54% reduce 4%
09/01/06 21:53:08 INFO mapred.JobClient:  map 60% reduce 5%
09/01/06 21:53:09 INFO mapred.JobClient:  map 65% reduce 6%
09/01/06 21:53:13 INFO mapred.JobClient:  map 69% reduce 6%
09/01/06 21:53:14 INFO mapred.JobClient:  map 75% reduce 7%
09/01/06 21:53:18 INFO mapred.JobClient:  map 79% reduce 7%
09/01/06 21:53:19 INFO mapred.JobClient:  map 81% reduce 8%
09/01/06 21:53:20 INFO mapred.JobClient:  map 87% reduce 8%
09/01/06 21:53:22 INFO mapred.JobClient:  map 89% reduce 8%
09/01/06 21:53:24 INFO mapred.JobClient:  map 89% reduce 9%
09/01/06 21:53:25 INFO mapred.JobClient:  map 89% reduce 10%
09/01/06 21:53:29 INFO mapred.JobClient:  map 89% reduce 11%
09/01/06 21:53:30 INFO mapred.JobClient:  map 91% reduce 12%
09/01/06 21:53:32 INFO mapred.JobClient:  map 99% reduce 14%
09/01/06 21:53:37 INFO mapred.JobClient:  map 99% reduce 15%
09/01/06 21:53:38 INFO mapred.JobClient:  map 100% reduce 15%
09/01/06 21:53:41 INFO mapred.JobClient:  map 100% reduce 22%
09/01/06 21:53:42 INFO mapred.JobClient:  map 100% reduce 23%
09/01/06 21:53:43 INFO mapred.JobClient:  map 100% reduce 30%
09/01/06 21:53:45 INFO mapred.JobClient:  map 100% reduce 37%
09/01/06 21:53:47 INFO mapred.JobClient:  map 100% reduce 38%
09/01/06 21:53:51 INFO mapred.JobClient:  map 100% reduce 46%
09/01/06 21:53:55 INFO mapred.JobClient:  map 100% reduce 48%
09/01/06 21:53:56 INFO mapred.JobClient:  map 100% reduce 60%
09/01/06 21:54:00 INFO mapred.JobClient:  map 100% reduce 61%
09/01/06 21:54:01 INFO mapred.JobClient:  map 100% reduce 62%
09/01/06 21:54:05 INFO mapred.JobClient:  map 100% reduce 63%
09/01/06 21:54:06 INFO mapred.JobClient:  map 100% reduce 64%
09/01/06 21:54:10 INFO mapred.JobClient:  map 100% reduce 65%
09/01/06 21:54:11 INFO mapred.JobClient:  map 100% reduce 66%
09/01/06 21:54:15 INFO mapred.JobClient:  map 100% reduce 67%
09/01/06 21:54:16 INFO mapred.JobClient:  map 100% reduce 68%
09/01/06 21:54:18 INFO mapred.JobClient:  map 100% reduce 75%


> Improve of random_mapred()
> --------------------------
>
>                 Key: HAMA-143
>                 URL: https://issues.apache.org/jira/browse/HAMA-143
>             Project: Hama
>          Issue Type: Improvement
>          Components: mapred 
>    Affects Versions: 0.1.0
>            Reporter: Edward J. Yoon
>            Assignee: Edward J. Yoon
>            Priority: Minor
>             Fix For: 0.1.0
>
>         Attachments: HAMA-143.patch, HAMA-143_v01.patch
>
>
> To generate large random matrix, it should be improved.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message