spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Keiji Yoshida (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (SPARK-26335) Add a property for Dataset#show not to care about wide characters when padding them
Date Thu, 13 Dec 2018 14:03:00 GMT

    [ https://issues.apache.org/jira/browse/SPARK-26335?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16720201#comment-16720201
] 

Keiji Yoshida commented on SPARK-26335:
---------------------------------------

https://github.com/apache/spark/pull/23307#issuecomment-446978389

> Add a property for Dataset#show not to care about wide characters when padding them
> -----------------------------------------------------------------------------------
>
>                 Key: SPARK-26335
>                 URL: https://issues.apache.org/jira/browse/SPARK-26335
>             Project: Spark
>          Issue Type: Improvement
>          Components: SQL
>    Affects Versions: 2.4.0
>            Reporter: Keiji Yoshida
>            Priority: Major
>         Attachments: Screen Shot 2018-12-11 at 17.53.54.png
>
>
> h2. Issue
> https://issues.apache.org/jira/browse/SPARK-25108 makes Dataset#show care about wide
characters when padding them. That is useful for humans to read a result of Dataset#show.
On the other hand, that makes it impossible for programs to parse a result of Dataset#show
because each cell's length can be different from its header's length. My company develops
and manages a Jupyter/Apache Zeppelin-like visualization tool named "OASIS" ([https://databricks.com/session/oasis-collaborative-data-analysis-platform-using-apache-spark]).
On this application, a result of Dataset#show on a Scala or Python process is parsed to visualize
it as an HTML table format. (A screenshot of OASIS has been attached to this ticket as a file
named "Screen Shot 2018-12-11 at 17.53.54.png".)
> h2. Solution
> Add a property for Dataset#show not to care about wide characters when padding them.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org


Mime
View raw message