kafka-jira mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Damian Guy (JIRA)" <j...@apache.org>
Subject [jira] [Resolved] (KAFKA-6186) RocksDB based WindowStore fail to create db file on Windows OS
Date Wed, 08 Nov 2017 12:14:00 GMT

     [ https://issues.apache.org/jira/browse/KAFKA-6186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Damian Guy resolved KAFKA-6186.
-------------------------------
    Resolution: Duplicate

> RocksDB based WindowStore fail to create db file on Windows OS
> --------------------------------------------------------------
>
>                 Key: KAFKA-6186
>                 URL: https://issues.apache.org/jira/browse/KAFKA-6186
>             Project: Kafka
>          Issue Type: Bug
>          Components: streams
>    Affects Versions: 1.0.0
>         Environment: Windows OS
>            Reporter: James Wu
>
> Code snippet just like below
> ...
>         textLines.flatMapValues(value -> Arrays.asList(pattern.split(value.toLowerCase()))).groupBy((key,
word) -> word)
>                 .windowedBy(TimeWindows.of(10000)).count(Materialized.as("Counts"));
> ...
> Run it on Windows, then the exception is throw as below
> Caused by: org.rocksdb.RocksDBException: Failed to create dir: F:\tmp\kafka-streams\wordcount-lambda-example\1_0\Counts\Counts:1510099200000:
Invalid argument
> 	at org.rocksdb.RocksDB.open(Native Method) ~[rocksdbjni-5.7.3.jar:na]
> 	at org.rocksdb.RocksDB.open(RocksDB.java:231) ~[rocksdbjni-5.7.3.jar:na]
> 	at org.apache.kafka.streams.state.internals.RocksDBStore.openDB(RocksDBStore.java:197)
~[kafka-streams-1.0.0.jar:na]
> 	... 29 common frames omitted
> Checked the code, I found the issue is caused by line 72 in org.apache.kafka.streams.state.internals.Segments
>     String segmentName(final long segmentId) {
>         // previous format used - as a separator so if this changes in the future
>         // then we should use something different.
>         return name + ":" + segmentId * segmentInterval;
>     }
> "segmentName" is passed to RocksDB, RockDB will use it as file name to create the DB
file, as we known, the ":" cannot be part of file name in Windows OS.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Mime
View raw message