mahout-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Viva Friend <vivafri...@gmail.com>
Subject Re: Any memory limitation in Mahout
Date Sat, 10 Jul 2010 23:38:03 GMT
Thanks Ted.

Glad to hear that the number training examples will not be limited the
physical memory size of one box.

Also, will the number of features and class labels affect the memory
usage for the Liblinear Mahout implementation?

vivafriend



On Sat, Jul 10, 2010 at 4:21 PM, Ted Dunning <ted.dunning@gmail.com> wrote:
> Both MAHOUT-334 and MAHOUT-228 will help you with your memory problems.
>  Both are on-line algorithms which means that they use a constant amount of
> memory regardless of how many training examples you have.
>
> On Sat, Jul 10, 2010 at 4:15 PM, Viva Friend <vivafriend@gmail.com> wrote:
>
>> Hi All,
>>
>> I have been using SVM LibLINEAR
>> http://wiki.pentaho.com/display/DATAMINING/LibLINEAR in WEKA. After
>> maxing out the physical memory size of machine, I am still facing
>> OutOfMemoryError
>>
>> Will Mahout implementations eliminate all memory limitation issues
>> because of its distributed processing nature?
>>
>> For example, will the following jira issue for implementing LibLinear
>> in Mahhout solve the OutOfMemoryError in WEKA LibLinear
>> implementation?
>> https://issues.apache.org/jira/browse/MAHOUT-334
>>
>> Thanks in advance.
>>
>> vivafriend
>>
>

Mime
View raw message