arrow-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Robert Nishihara (JIRA)" <j...@apache.org>
Subject [jira] [Created] (ARROW-3548) Speed up storing small objects in the object store.
Date Thu, 18 Oct 2018 01:25:00 GMT
Robert Nishihara created ARROW-3548:
---------------------------------------

             Summary: Speed up storing small objects in the object store.
                 Key: ARROW-3548
                 URL: https://issues.apache.org/jira/browse/ARROW-3548
             Project: Apache Arrow
          Issue Type: Bug
          Components: Plasma (C++)
            Reporter: Robert Nishihara
            Assignee: Robert Nishihara


Currently, to store an object in the plasma object store, there are a lot of IPCs. We first
call "Create", which does an IPC round trip. Then we call "Seal", which is one IPC. Then we
call "Release", which is another IPC.

For small objects, we can just inline the object and metadata directly into the message to
the store, and wait for the response (the response tells us if the object was successfully
created). This is just a single IPC round trip, which can be much faster.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Mime
View raw message