flink-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ASF GitHub Bot (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (FLINK-9739) Regression in supported filesystems for RocksDB
Date Mon, 30 Jul 2018 09:10:00 GMT

    [ https://issues.apache.org/jira/browse/FLINK-9739?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16561666#comment-16561666
] 

ASF GitHub Bot commented on FLINK-9739:
---------------------------------------

sampathBhat opened a new pull request #6452: [FLINK-9739] Regression in supported filesystems
for RocksDB
URL: https://github.com/apache/flink/pull/6452
 
 
   Like mentioned in the description and comments of the bug -
   The issue https://issues.apache.org/jira/browse/FLINK-9739 is due to the refactoring of
the flink Path to java Files API. Secondly the usage File.isAbsolute() throws an java.lang.IllegalArgumentException:
Relative paths are not supported which should not have happened.
   
   The reason why java.lang.IllegalArgumentException is thrown is -
   The calling function is splitting the filepaths based on File.pathSeparator and in linux
systems the file seperator is ':' therefore if file paths given to state.backend.rocksdb.localdir
is of form file:///some/local/path then "file" and "/some/local/path" will be considered as
different path and would fail in the below absolute path check.
   
   Solution:
   1. Since "state.backend.rocksdb.localdir" expects only local file path an extra check can
be added to see if the path contains "file". This is the change done in this commit.
   
   2. The other possible solution could be to revert the API change from java File to flink
Path. 

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


> Regression in supported filesystems for RocksDB
> -----------------------------------------------
>
>                 Key: FLINK-9739
>                 URL: https://issues.apache.org/jira/browse/FLINK-9739
>             Project: Flink
>          Issue Type: Bug
>          Components: FileSystem, State Backends, Checkpointing
>    Affects Versions: 1.5.0, 1.6.0
>            Reporter: Chesnay Schepler
>            Priority: Major
>              Labels: pull-request-available
>
> A user reporter on the [mailing list|http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/Checkpointing-in-Flink-1-5-0-tt21173.html]
has reported that the {{RocksDBStateBackend}} no longer supports GlusterFS mounted volumes.
> Configuring {{file:///home/abc/share}} lead to an exception that claimed the path to
not be absolute.
> This was working fine in 1.4.2.
> In FLINK-6557 the {{RocksDBStateBackend}} was refactored to use java {{Files}} instead
of Flink {{Paths}}, potentially causing the issue.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Mime
View raw message