distributedlog-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Gerrit Sundaram <gerritsunda...@gmail.com>
Subject Re: FileSystem API over distributedlog logs
Date Wed, 02 Nov 2016 10:14:52 GMT
FYI - I tried to use the AppendOnlyStreamWriter and AppendOnlyStreamReader
to demonstrate the idea :
https://github.com/apache/incubator-distributedlog/pulls/43 Let me know if
this is a good direction to go after.

- Gerrit

On Wed, Nov 2, 2016 at 2:21 AM, Gerrit Sundaram <gerritsundaram@gmail.com>

> Hi distributedlog folks,
> I am new to this community. I am wondering is there anyone tried to build
> a file system over replicated logs. There are a lot of similarities between
> a filesystem file and a replicated log. You can use files to build
> replicated log or use replicated logs to build a filesystem.
> I took at the code repo and found there are two files
> 'AppendOnlyStreamReader' and 'AppendOnlyStreamWriter'. They seem to
> implement file I/O related API. Did you guys attempt to provide filesystem
> API over distributedlog?
> I am wondering if it is possible to build a filesystem over
> distributedlog. Would this be an interesting topic to this project and the
> community? I have two reasons for that
> - I can leverage the good stuffs like parallel replication, low latency
> for better performance?
> - DL uses zookeeper for metadata storage. ZooKeeper has pretty nice
> filesystem-like interface. So it would be a nice fit.
> - Gerrit

  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message