hudi-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Pratyaksh Sharma (Jira)" <j...@apache.org>
Subject [jira] [Updated] (HUDI-616) Parquet files not getting created on DFS docker instance but on local FS in TestHoodieDeltaStreamer
Date Mon, 17 Feb 2020 17:13:00 GMT

     [ https://issues.apache.org/jira/browse/HUDI-616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Pratyaksh Sharma updated HUDI-616:
----------------------------------
    Status: Open  (was: New)

> Parquet files not getting created on DFS docker instance but on local FS in TestHoodieDeltaStreamer
> ---------------------------------------------------------------------------------------------------
>
>                 Key: HUDI-616
>                 URL: https://issues.apache.org/jira/browse/HUDI-616
>             Project: Apache Hudi (incubating)
>          Issue Type: Bug
>          Components: DeltaStreamer, Testing
>            Reporter: Pratyaksh Sharma
>            Assignee: Pratyaksh Sharma
>            Priority: Major
>             Fix For: 0.5.2
>
>
> In TestHoodieDeltaStreamer, 
> PARQUET_SOURCE_ROOT gets initialised even before function annotated with @BeforeClass
gets called as below - 
> private static final String PARQUET_SOURCE_ROOT = dfsBasePath + "/parquetFiles";
> At this point, dfsBasePath variable is null and as a result, parquet files get created
on local FS which need to be cleared manually after testing. This needs to be rectified.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Mime
View raw message