hadoop-hdfs-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Bob Hansen (JIRA)" <j...@apache.org>
Subject [jira] [Created] (HDFS-10796) libhdfs++: rationalize ioservice interactions
Date Thu, 25 Aug 2016 14:17:20 GMT
Bob Hansen created HDFS-10796:

             Summary: libhdfs++: rationalize ioservice interactions
                 Key: HDFS-10796
                 URL: https://issues.apache.org/jira/browse/HDFS-10796
             Project: Hadoop HDFS
          Issue Type: Sub-task
            Reporter: Bob Hansen

Firstly, we should be pulling the number of threads from options.io_threads (which should
default to std::thread::hardware_concurrency()).  The library should pass all tests always
with io_threads set to 1 or to <a very high number>

Secondly, we should have _a_ constructor where the consumer doesn't need to manage the IOService
explicitly, and the FileSystemImpl should create its own internally.

Since the FileSystem is defined as being for a particular user/identity, there is a valid
use case for the consumer to be constructing many FileSystem instances to represent many authenticated
users in the same process, but want to share resources (notably have a single io_service shared
amongst them all).  In this case, the consumer would want to own the IOService and pass the
same instance to multiple FileSystem instances.

This message was sent by Atlassian JIRA

To unsubscribe, e-mail: hdfs-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-help@hadoop.apache.org

View raw message