hudi-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Vinoth Chandar (Jira)" <j...@apache.org>
Subject [jira] [Updated] (HUDI-118) Hudi CLI : Provide options for passing properties to Compactor, Cleaner and ParquetImporter
Date Mon, 03 Feb 2020 18:12:09 GMT

     [ https://issues.apache.org/jira/browse/HUDI-118?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Vinoth Chandar updated HUDI-118:
--------------------------------
    Fix Version/s:     (was: 0.5.2)
                   0.5.1

> Hudi CLI : Provide options for passing properties to Compactor, Cleaner and ParquetImporter

> --------------------------------------------------------------------------------------------
>
>                 Key: HUDI-118
>                 URL: https://issues.apache.org/jira/browse/HUDI-118
>             Project: Apache Hudi (incubating)
>          Issue Type: Improvement
>          Components: CLI, Common Core, newbie
>            Reporter: Balaji Varadarajan
>            Assignee: Pratyaksh Sharma
>            Priority: Minor
>              Labels: pull-request-available
>             Fix For: 0.5.1
>
>          Time Spent: 20m
>  Remaining Estimate: 0h
>
> For non-trivial CLI operations, we have a standalone script in hudi-utilities that users
can call directly using spark-submit (usually). We also have commands in hudi-cli to invoke
the commands directly from hudi-cli shell.
> There was an earlier effort to allow users to pass properties directly to the scripts
in hudi-utilities but we still need to give the same functionality to the corresponding commands
in hudi-cli.
> In hudi-cli, Compaction (schedule/compact), Cleaner and HDFSParquetImporter command does
not have option to pass DFS properties file. This is a followup to PRĀ [https://github.com/apache/incubator-hudi/pull/691]



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Mime
View raw message