Mailing-List: contact dev-help@mahout.apache.org; run by ezmlm
Precedence: bulk
Reply-To: dev@mahout.apache.org
Date: Fri, 30 Mar 2012 17:58:27 +0000 (UTC)
From: "Andrew Harbick (Created) (JIRA)" <jira@apache.org>
To: dev@mahout.apache.org
Message-ID: 
 <784543456.39090.1333130307671.JavaMail.tomcat@hel.zones.apache.org>
Subject: [jira] [Created] (MAHOUT-997) Make splitData smart enough to not
 consider a CSV header to be part of the data
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit

Make splitData smart enough to not consider a CSV header to be part of the data
-------------------------------------------------------------------------------

                 Key: MAHOUT-997
                 URL: https://issues.apache.org/jira/browse/MAHOUT-997
             Project: Mahout
          Issue Type: Improvement
          Components: Integration
    Affects Versions: 0.6
         Environment: OS X
            Reporter: Andrew Harbick
            Priority: Minor
             Fix For: 0.6


If you do something like:

MAHOUT_LOCAL=1 $MAHOUT_HOME/bin/mahout splitDataset  --input all.csv --output split --trainingPercentage 0.9 --probePercentage 0.1

The header row from your CSV will end up with 90% chance in your training data and 10% chance in your evaluation data.  To use a tool like trainlogistic or runlogistic the header file is needed in both.

Perhaps add an argument to splitData to duplicate the header line?

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira