spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Wesley Hoffman (JIRA)" <j...@apache.org>
Subject [jira] [Comment Edited] (SPARK-23255) Add user guide and examples for DataFrame image reading functions
Date Fri, 16 Mar 2018 15:32:00 GMT

    [ https://issues.apache.org/jira/browse/SPARK-23255?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16402052#comment-16402052
] 

Wesley Hoffman edited comment on SPARK-23255 at 3/16/18 3:31 PM:
-----------------------------------------------------------------

Formal documentation for this feature would be wonderful as currently I've only found a [Microsoft
blog post |https://blogs.technet.microsoft.com/machinelearning/2018/03/05/image-data-support-in-apache-spark/]about
the subject. There are issues between using ImageSchema from sparkdl and from {{spark.ml.image.imageSchema}}
Perhaps it is due to version mismatch between sparkdl for 2.2 and 2.3 which wouldn't include
[spark-deep-learning PR-85 | https://github.com/databricks/spark-deep-learning/pull/85]. But
documentation would clear this right up!

If anyone from Databricks or Microsoft reads this before March 22, this is relevant for a
talk at the Microsoft/Databricks hackathon so that may cause more traffic to this new feature.


was (Author: spacerangerwes):
Formal documentation for this feature would be wonderful as currently I've only found a [Microsoft
blog post |https://blogs.technet.microsoft.com/machinelearning/2018/03/05/image-data-support-in-apache-spark/]about
the subject. There are issues between using ImageSchema from sparkdl and from \{{spark.ml.image.imageSchema.
}}Perhaps it is due to version mismatch between sparkdl for 2.2 and 2.3 which wouldn't include
[spark-deep-learning PR-85
|https://github.com/databricks/spark-deep-learning/pull/85]. But documentation would clear
this right up!

If anyone from Databricks or Microsoft reads this before March 22, this is relevant for a
talk at the Microsoft/Databricks hackathon so that may cause more traffic to this new feature.

> Add user guide and examples for DataFrame image reading functions
> -----------------------------------------------------------------
>
>                 Key: SPARK-23255
>                 URL: https://issues.apache.org/jira/browse/SPARK-23255
>             Project: Spark
>          Issue Type: Documentation
>          Components: ML, PySpark
>    Affects Versions: 2.3.0
>            Reporter: Nick Pentreath
>            Priority: Minor
>
> SPARK-21866 added built-in support for reading image data into a DataFrame. This new
functionality should be documented in the user guide, with example usage.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org


Mime
View raw message