apex-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ASF GitHub Bot (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (APEXMALHAR-2008) Create hdfs file input module
Date Wed, 09 Mar 2016 12:37:40 GMT

    [ https://issues.apache.org/jira/browse/APEXMALHAR-2008?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15187031#comment-15187031
] 

ASF GitHub Bot commented on APEXMALHAR-2008:
--------------------------------------------

Github user sandeepdeshmukh commented on a diff in the pull request:

    https://github.com/apache/incubator-apex-malhar/pull/207#discussion_r55511842
  
    --- Diff: library/src/test/java/com/datatorrent/lib/io/fs/FileSplitterInputTest.java ---
    @@ -215,7 +213,7 @@ public void testTimeScan() throws InterruptedException, IOException,
TimeoutExce
         testMeta.blockMetadataSink.clear();
     
         Thread.sleep(1000);
    -    //added a new relativeFilePath
    +    // added a new relativeFilePath
    --- End diff --
    
    Example of white space change. Please revert this and all such changes.


> Create hdfs file input module 
> ------------------------------
>
>                 Key: APEXMALHAR-2008
>                 URL: https://issues.apache.org/jira/browse/APEXMALHAR-2008
>             Project: Apache Apex Malhar
>          Issue Type: Task
>            Reporter: Priyanka Gugale
>            Assignee: Priyanka Gugale
>            Priority: Minor
>   Original Estimate: 72h
>  Remaining Estimate: 72h
>
> To read HDFS files in parallel using Apex we normally use FileSplitter and FileReader
module. It would be a good idea to combine those operators as a unit in module. Having a module
will give us readily usable set of operators to read HDFS files. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message