hudi-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Pratyaksh Sharma (Jira)" <j...@apache.org>
Subject [jira] [Created] (HUDI-616) Parquet files not getting created on DFS docker instance but on local FS in TestHoodieDeltaStreamer
Date Mon, 17 Feb 2020 17:12:00 GMT
Pratyaksh Sharma created HUDI-616:
-------------------------------------

             Summary: Parquet files not getting created on DFS docker instance but on local
FS in TestHoodieDeltaStreamer
                 Key: HUDI-616
                 URL: https://issues.apache.org/jira/browse/HUDI-616
             Project: Apache Hudi (incubating)
          Issue Type: Bug
          Components: DeltaStreamer, Testing
            Reporter: Pratyaksh Sharma
            Assignee: Pratyaksh Sharma
             Fix For: 0.5.2


In TestHoodieDeltaStreamer, 

PARQUET_SOURCE_ROOT gets initialised even before function annotated with @BeforeClass gets
called as below - 

private static final String PARQUET_SOURCE_ROOT = dfsBasePath + "/parquetFiles";

At this point, dfsBasePath variable is null and as a result, parquet files get created on
local FS which need to be cleared manually after testing. This needs to be rectified.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Mime
View raw message