arrow-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Wes McKinney (JIRA)" <j...@apache.org>
Subject [jira] [Created] (ARROW-1096) [C++] Memory mapping file over 4GB fails on Windows
Date Wed, 07 Jun 2017 03:50:18 GMT
Wes McKinney created ARROW-1096:
-----------------------------------

             Summary: [C++] Memory mapping file over 4GB fails on Windows
                 Key: ARROW-1096
                 URL: https://issues.apache.org/jira/browse/ARROW-1096
             Project: Apache Arrow
          Issue Type: Bug
          Components: C++, Python
    Affects Versions: 0.4.0
            Reporter: Wes McKinney


This succeeds on a 3.4 GB file, but fails on a 6GB file. I suspect the failure point is exactly
4GB but will investigate

{code}
In [9]: mm = pyarrow.memory_map('df_big.feather')
---------------------------------------------------------------------------
ArrowIOError                              Traceback (most recent call last)
<ipython-input-9-3160805e299d> in <module>()
----> 1 mm = pyarrow.memory_map('df_big.feather')

pyarrow\io.pxi in pyarrow.lib.memory_map (C:\bld\pyarrow_1495576136174\work\arrow-a8f8ba0cbcf5f596f042e90b7a208e7a0c3925b7\python\build\temp.win-amd64-3.6\Release\lib.cxx:39905)()

pyarrow\io.pxi in pyarrow.lib.MemoryMappedFile.open (C:\bld\pyarrow_1495576136174\work\arrow-a8f8ba0cbcf5f596f042e90b7a208e7a0c3925b7\python\build\temp.win-amd64-3.6\Release\lib.cxx:39709)()

pyarrow\error.pxi in pyarrow.lib.check_status (C:\bld\pyarrow_1495576136174\work\arrow-a8f8ba0cbcf5f596f042e90b7a208e7a0c3925b7\python\build\temp.win-amd64-3.6\Release\lib.cxx:6932)()

ArrowIOError: IOError: Memory mapping file failed, errno: 5
{code}



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

Mime
View raw message