ignite-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Anton Dmitriev (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (IGNITE-10996) [ML] Add additional host and port into IgniteDataset to retrieve schema
Date Mon, 21 Jan 2019 08:49:00 GMT

     [ https://issues.apache.org/jira/browse/IGNITE-10996?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Anton Dmitriev updated IGNITE-10996:
------------------------------------
    Description: 
Currently [IgniteDataset](https://github.com/tensorflow/io/tree/master/tensorflow_io/ignite#distributed-in-memory-datasource)
provides ability to specify only a single host/port for data schema extraction and for data
loading. This limitation doesn't allow to use [Dataset.interleave(...)](https://www.tensorflow.org/api_docs/python/tf/data/Dataset#interleave)
and [
tf.data.experimental.parallel_interleave](https://www.tensorflow.org/api_docs/python/tf/data/experimental/parallel_interleave)
function for parallel data loading.

We need to add ability to specify host/port separately for schema extraction and to data loading.

> [ML] Add additional host and port into IgniteDataset to retrieve schema
> -----------------------------------------------------------------------
>
>                 Key: IGNITE-10996
>                 URL: https://issues.apache.org/jira/browse/IGNITE-10996
>             Project: Ignite
>          Issue Type: Improvement
>          Components: ml
>    Affects Versions: 2.8
>            Reporter: Anton Dmitriev
>            Assignee: Anton Dmitriev
>            Priority: Major
>             Fix For: 2.8
>
>
> Currently [IgniteDataset](https://github.com/tensorflow/io/tree/master/tensorflow_io/ignite#distributed-in-memory-datasource)
provides ability to specify only a single host/port for data schema extraction and for data
loading. This limitation doesn't allow to use [Dataset.interleave(...)](https://www.tensorflow.org/api_docs/python/tf/data/Dataset#interleave)
and [
> tf.data.experimental.parallel_interleave](https://www.tensorflow.org/api_docs/python/tf/data/experimental/parallel_interleave)
function for parallel data loading.
> We need to add ability to specify host/port separately for schema extraction and to data
loading.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Mime
View raw message