mahout-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Deneche A. Hakim (JIRA)" <j...@apache.org>
Subject [jira] Issue Comment Edited: (MAHOUT-145) PartialData mapreduce Random Forests
Date Wed, 12 Aug 2009 10:40:15 GMT

    [ https://issues.apache.org/jira/browse/MAHOUT-145?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12742262#action_12742262
] 

Deneche A. Hakim edited comment on MAHOUT-145 at 8/12/09 3:39 AM:
------------------------------------------------------------------

update: I did a re-run on 50 map tests, the new results are more coherent

KDD 25%
|| Num Map Tasks || Num Trees || Oob Error || Build Time || Step 1 || Step 1-2 || Step 2 ||
Step 2-2 || Step 3 ||
| 10 | 100 | 0.0194 | 0h 1m 23s 210 | 39s | 4s | 20s | 20s | 33s |
| 10 | 200 | 0.0203 | 0h 2m 16s 510 | 1m 1s | 9s | 26s | 41s | 33s |
| 10 | 400 | 0.0195 | 0h 4m 10s 9 | 1m 53s | 18s | 39s | 1m 20s | 32s |
| 20 | 100 | 0.3875 | 0h 1m 5s 288 | 20s | 2s | 18s | 25s | 31s |
| 20 | 200 | 0.3626 | 0h 1m 29s 145 | 23s | 5s | 22s | 39s | 33s |
| 20 | 400 | 0.5003 | 0h 2m 30s 789 | 35s | 8s | 28s | 1m 19s | 32s |
| 50 | 100 | 0.5041 | 0h 1m 1s 375 | 19s | 3s | 19s | 21s | 32s |
| 50 | 200 | 0.5041 | 0h 1m 19s 202 | 19s | 2s | 22s | 36s | 32s |
| 50 | 400 | 0.5041 | 0h 2m 2s 250 | 18s | 4s | 28s | 1m 12s | 33s |


      was (Author: adeneche):
    KDD 25%
|| Num Map Tasks || Num Trees || Oob Error || Build Time || Step 1 || Step 1-2 || Step 2 ||
Step 2-2 || Step 3 ||
| 10 | 100 | 0.0194 | 0h 1m 23s 210 | 39s | 4s | 20s | 20s | 33s |
| 10 | 200 | 0.0203 | 0h 2m 16s 510 | 1m 1s | 9s | 26s | 41s | 33s |
| 10 | 400 | 0.0195 | 0h 4m 10s 9 | 1m 53s | 18s | 39s | 1m 20s | 32s |
| 20 | 100 | 0.3875 | 0h 1m 5s 288 | 20s | 2s | 18s | 25s | 31s |
| 20 | 200 | 0.3626 | 0h 1m 29s 145 | 23s | 5s | 22s | 39s | 33s |
| 20 | 400 | 0.5003 | 0h 2m 30s 789 | 35s | 8s | 28s | 1m 19s | 32s |
| 50 | 100 | 0.5041 | 0h 1m 46s 717 | 14s | 2s | 1m 11s | 20s | 33s |
| 50 | 200 | 0.5041 | 0h 1m 20s 977 | 17s | 2s | 22s | 40s | 33s |
| 50 | 400 | 0.5041 | 0h 2m 1s 714 | 16s | 4s | 29s | 1m 12s | 34s |

  
> PartialData mapreduce Random Forests
> ------------------------------------
>
>                 Key: MAHOUT-145
>                 URL: https://issues.apache.org/jira/browse/MAHOUT-145
>             Project: Mahout
>          Issue Type: New Feature
>          Components: Classification
>            Reporter: Deneche A. Hakim
>            Priority: Minor
>         Attachments: partial_August_10.patch, partial_August_2.patch, partial_August_9.patch
>
>
> This implementation is based on a suggestion by Ted:
> "modify the original algorithm to build multiple trees for different portions of the
data. That loses some of the solidity of the original method, but could actually do better
if the splits exposed non-stationary behavior."

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message