mahout-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ASF GitHub Bot (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (MAHOUT-1579) Implement a datamodel which can load data from hadoop filesystem directly
Date Mon, 16 Jun 2014 03:33:01 GMT

    [ https://issues.apache.org/jira/browse/MAHOUT-1579?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14032095#comment-14032095
] 

ASF GitHub Bot commented on MAHOUT-1579:
----------------------------------------

Github user sscdotopen commented on a diff in the pull request:

    https://github.com/apache/mahout/pull/19#discussion_r13791184
  
    --- Diff: mrlegacy/src/test/java/org/apache/mahout/cf/taste/impl/model/HadoopFSDataModelTest.java
---
    @@ -0,0 +1,276 @@
    +/**
    + * Licensed to the Apache Software Foundation (ASF) under one or more
    + * contributor license agreements.  See the NOTICE file distributed with
    + * this work for additional information regarding copyright ownership.
    + * The ASF licenses this file to You under the Apache License, Version 2.0
    + * (the "License"); you may not use this file except in compliance with
    + * the License.  You may obtain a copy of the License at
    + *
    + *     http://www.apache.org/licenses/LICENSE-2.0
    + *
    + * Unless required by applicable law or agreed to in writing, software
    + * distributed under the License is distributed on an "AS IS" BASIS,
    + * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
    + * See the License for the specific language governing permissions and
    + * limitations under the License.
    + */
    +
    +package org.apache.mahout.cf.taste.impl.model;
    +
    +import static org.junit.Assert.*;
    --- End diff --
    
    no star imports please


> Implement a datamodel which can load data from hadoop filesystem directly
> -------------------------------------------------------------------------
>
>                 Key: MAHOUT-1579
>                 URL: https://issues.apache.org/jira/browse/MAHOUT-1579
>             Project: Mahout
>          Issue Type: Improvement
>            Reporter: Xiaomeng Huang
>            Priority: Minor
>         Attachments: Mahout-1579.patch
>
>
> As we all know, FileDataModel can only load data from local filesystem.
> But the big-data are usually stored in hadoop filesystem(e.g. hdfs).
> If we want to deal with the data in hdfs, we must run mapred job. 
> It's necessay to implement a data model which can load data from hadoop filesystem directly.



--
This message was sent by Atlassian JIRA
(v6.2#6252)

Mime
View raw message