mahout-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Suneel Marthi (JIRA)" <j...@apache.org>
Subject [jira] [Comment Edited] (MAHOUT-944) LuceneIndexToSequenceFiles (lucene2seq) utility
Date Wed, 12 Jun 2013 22:18:22 GMT

    [ https://issues.apache.org/jira/browse/MAHOUT-944?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13681694#comment-13681694
] 

Suneel Marthi edited comment on MAHOUT-944 at 6/12/13 10:17 PM:
----------------------------------------------------------------

See this error when running SequenceFilesFromLuceneStorageMRJobTest (from Mahout-Quality build-2076):

see https://builds.apache.org/job/Mahout-Quality/2076 


{Code}

java.lang.ClassCastException: org.apache.mahout.text.LuceneSegmentInputSplit cannot be cast
to org.apache.hadoop.mapred.InputSplit
	at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:412)
	at org.apache.hadoop.mapred.MapTask.run(MapTask.java:372)
	at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:214)

{Code}

Seems like the issue is that the old MR InputSplit is being referenced somewhere in the code,
have not looked deeply into it yet.
                
      was (Author: smarthi):
    See this error when running SequenceFilesFromLuceneStorageMRJobTest (from Mahout-Quality
build-2076):

see https://builds.apache.org/job/Mahout-Quality/2076 

{Code}

java.lang.ClassCastException: org.apache.mahout.text.LuceneSegmentInputSplit cannot be cast
to org.apache.hadoop.mapred.InputSplit
	at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:412)
	at org.apache.hadoop.mapred.MapTask.run(MapTask.java:372)
	at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:214)

{Code}

Seems like the issue is that the old MR InputSplit is being referenced somewhere in the code,
have not looked deeply into it yet?
                  
> LuceneIndexToSequenceFiles (lucene2seq) utility
> -----------------------------------------------
>
>                 Key: MAHOUT-944
>                 URL: https://issues.apache.org/jira/browse/MAHOUT-944
>             Project: Mahout
>          Issue Type: New Feature
>          Components: Integration
>    Affects Versions: 0.5
>            Reporter: Frank Scholten
>            Assignee: Grant Ingersoll
>            Priority: Minor
>             Fix For: 0.8
>
>         Attachments: MAHOUT-944-minor.patch, MAHOUT-944.patch, MAHOUT-944.patch, MAHOUT-944.patch,
MAHOUT-944.patch, MAHOUT-944.patch, MAHOUT-944.patch, MAHOUT-944.patch, MAHOUT-944.patch,
MAHOUT-944.patch, MAHOUT-944.patch, MAHOUT-944.patch, MAHOUT-944.patch
>
>
> Here is a lucene2seq tool I used in a project. It creates sequence files based on the
stored fields of a lucene index.
> The output from this tool can be then fed into seq2sparse and from there you can do text
clustering.
> Comes with Java bean configuration.
> Let me know what you think. Some CLI code can be added later on. I used this for a small-scale
project +- 100.000 docs. Is a MR version useful or is that overkill?
> See https://github.com/frankscholten/mahout/tree/lucene2seq for commits and review comments
from Simon Willnauer (Thanks Simon!)
> or the attached patch.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message