Mailing-List: contact dev-help@mahout.apache.org; run by ezmlm
Precedence: bulk
Reply-To: dev@mahout.apache.org
Content-Type: text/plain; charset=us-ascii
Mime-Version: 1.0 (Apple Message framework v1084)
Subject: Re: What about a universal input data handling mechanism for Mahout?
From: Grant Ingersoll <gsingers@apache.org>
In-Reply-To: 
 <CAJwFCa32X-CGpZ_6vs6RjeVqGkQ8FhiohVh-CUwZY35Hpuj4_A@mail.gmail.com>
Date: Tue, 26 Jul 2011 05:50:32 -0400
Content-Transfer-Encoding: quoted-printable
Message-Id: <CC00B99F-7F84-4664-BD1C-4E3785D36006@apache.org>
References: 
 <CACOCgc=8W=OBAU8p9hNaDJL9CDWnBrOzzwP01Xoax+Ce2zJ+Tg@mail.gmail.com>
 <CALszqtgZgsB5KoYZ=4CiPRe3mgzhpcNrPKhzQ5w6B9NkWJQV+A@mail.gmail.com>
 <CAJwFCa3BMv5pBmFG=tUf+2dXVDXbYKus2WuDgiQBcSvE+rSYRA@mail.gmail.com>
 <004a01cc4adf$63a1eae0$2ae5c0a0$@com> <4E2D8DC7.3060709@apache.org>
 <CACOCgc=7YR-hgN-avA1RKypA3Spr04XNdzHAEnibDi=teq+xpw@mail.gmail.com>
 <4E2D8FB6.1090409@apache.org>
 <CACOCgcnOY=j91mX2d_FsiXkBSx6SXXTAjNWPQrmsY3kUwjY4vA@mail.gmail.com>
 <4E2E6856.6090902@apache.org>
 <CAJwFCa32X-CGpZ_6vs6RjeVqGkQ8FhiohVh-CUwZY35Hpuj4_A@mail.gmail.com>
To: dev@mahout.apache.org

We do have:
SequenceFilesFromCsvFilter, although it is somewhat basic
CSVVectorIterator, which takes a CSV file and produces a dense vector


On Jul 26, 2011, at 3:58 AM, Ted Dunning wrote:

> The critical design step here is to decide how to express the schema =
of the
> CSV file.  There is a beginning of this in the CsvRecordFactory, but I =
was
> never happy with the (lack of) speed.
>=20
> On Tue, Jul 26, 2011 at 12:10 AM, Sebastian Schelter <ssc@apache.org> =
wrote:
>=20
>> 2. SequenceFile is not file format that command line users can
>>> prepare, is there tool for converting CSV files into SequenceFiles
>>>=20
>>=20
>> I don't think we have that yet, but it would be very useful imho.
>>=20

--------------------------
Grant Ingersoll