accumulo-notifications mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From GitBox <...@apache.org>
Subject [GitHub] keith-turner opened a new issue #631: Add operations to Volume Manager for creating and deleting many files
Date Wed, 05 Sep 2018 17:48:46 GMT
keith-turner opened a new issue #631: Add operations to Volume Manager for creating and deleting
many files
URL: https://github.com/apache/accumulo/issues/631
 
 
   Creating and/or deleting a lot of files is a pattern that occurs in multiple places in
the Accumulo code (like GC, create table, and delete table).  HDFS does not offer any primitives
to make this efficient.  However I think doing these ops in a thread pool can be efficient
because HDFS client  batch calls from multiple threads into since NN RPC calls.  It might
be nice to offer high level abstractions for batch NN ops in the Accumulo code that are implemented
using thread pools.  These could be implemented in Accumulo's volumne manager code.  This
issue was created based on the following.
   
   https://github.com/apache/accumulo/pull/575#discussion_r215355339

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services

Mime
View raw message