flink-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Neelesh Srinivas Salian (JIRA)" <j...@apache.org>
Subject [jira] [Assigned] (FLINK-992) Create CollectionDataSets by reading (client) local files.
Date Wed, 21 Jun 2017 21:03:00 GMT

     [ https://issues.apache.org/jira/browse/FLINK-992?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel

Neelesh Srinivas Salian reassigned FLINK-992:

    Assignee: Neelesh Srinivas Salian  (was: niraj rai)

> Create CollectionDataSets by reading (client) local files.
> ----------------------------------------------------------
>                 Key: FLINK-992
>                 URL: https://issues.apache.org/jira/browse/FLINK-992
>             Project: Flink
>          Issue Type: New Feature
>          Components: DataSet API, Python API
>            Reporter: Fabian Hueske
>            Assignee: Neelesh Srinivas Salian
>            Priority: Minor
>              Labels: starter
> {{CollectionDataSets}} are a nice way to feed data into programs.
> We could add support to read a client-local file at program construction time using a
FileInputFormat, put its data into a CollectionDataSet, and ship its data together with the
> This would remove the need to upload small files into DFS which are used together with
some large input (stored in DFS).

This message was sent by Atlassian JIRA

View raw message