hudi-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "vinoyang (Jira)" <j...@apache.org>
Subject [jira] [Created] (HUDI-660) Make HoodieWriteConfig spark free
Date Thu, 05 Mar 2020 09:21:00 GMT
vinoyang created HUDI-660:
-----------------------------

             Summary: Make HoodieWriteConfig spark free
                 Key: HUDI-660
                 URL: https://issues.apache.org/jira/browse/HUDI-660
             Project: Apache Hudi (incubating)
          Issue Type: Sub-task
            Reporter: vinoyang
            Assignee: vinoyang


Currently, {{HoodieWriteConfig}} related to {{org.apache.spark.storage.StorageLevel}}. Considering
{{StorageLevel}} provides {{StorageLevel.fromString}} method. IMO, we can just store the string
representation. Further more, we can split some spark-job specific config options into a sub
config class e.g. {{HoodieSparkWriteConfig}}.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Mime
View raw message