arrow-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Antoine Pitrou <>
Subject [DISCUSS] C++ Filesystem abstraction
Date Mon, 29 Apr 2019 16:25:51 GMT


For the datasets project (*), one requirement is for Arrow to grow a
filesystem abstraction.  The aim is to access various kinds of storage
systems (local filesystem, S3, HadoopFS...) with a single API.
Hopefully, the API can be made good enough to avoid inefficiencies.

I've pushed a draft PR with a simple API proposal in:

This PR is meant as a starting point for discussion.  If you have any
insight or experience on the subject, please review and give
suggestions / comments.




View raw message