flink-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ASF GitHub Bot (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (FLINK-1081) Add HDFS file-stream source for streaming
Date Fri, 28 Nov 2014 16:29:12 GMT

    [ https://issues.apache.org/jira/browse/FLINK-1081?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14228378#comment-14228378
] 

ASF GitHub Bot commented on FLINK-1081:
---------------------------------------

Github user rmetzger commented on the pull request:

    https://github.com/apache/incubator-flink/pull/226#issuecomment-64910646
  
    Mh. I would be interested in @gyfora's opinion on this.
    I took a closer look to the StreamExecutionEnvironment and it seems that all data sources
are assuming newline separated text files. So its probably fine the way you implemented it
for this pull request.


> Add HDFS file-stream source for streaming
> -----------------------------------------
>
>                 Key: FLINK-1081
>                 URL: https://issues.apache.org/jira/browse/FLINK-1081
>             Project: Flink
>          Issue Type: Improvement
>          Components: Streaming
>    Affects Versions: 0.7.0-incubating
>            Reporter: Gyula Fora
>            Assignee: Chiwan Park
>              Labels: starter
>
> Add data stream source that will monitor a slected directory on HDFS (or other filesystems
as well) and will process all new files created.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message