commons-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Stefan Bodewig (JIRA)" <j...@apache.org>
Subject [jira] [Resolved] (COMPRESS-466) Opening of a very large zip file is extremely slow compared to java.util.zip.ZipFile
Date Mon, 08 Oct 2018 06:02:00 GMT

     [ https://issues.apache.org/jira/browse/COMPRESS-466?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Stefan Bodewig resolved COMPRESS-466.
-------------------------------------
       Resolution: Fixed
    Fix Version/s: 1.19

Thank you for testing.

It's easier to be "bold" when you are familiar with the code :)

> Opening of a very large zip file is extremely slow compared to java.util.zip.ZipFile
> ------------------------------------------------------------------------------------
>
>                 Key: COMPRESS-466
>                 URL: https://issues.apache.org/jira/browse/COMPRESS-466
>             Project: Commons Compress
>          Issue Type: Bug
>          Components: Compressors
>    Affects Versions: 1.18
>         Environment: Tested both on Linux and OSX 10.13.6.
>            Reporter: Jakob Sultan Ericsson
>            Priority: Major
>             Fix For: 1.19
>
>
> We have a quite large zip file 35 gb and try to open this with ZipFile. 
> {code:java}
>         try (ZipFile zf = new ZipFile(new File("35gb.zip"))) {
>             System.out.println("File opened..." + (System.currentTimeMillis() - start));
>         }
> {code}
> This code takes about 300 000 - 400 000 ms (5-6 minutes).
> If I run this with JDK-builtin java.util.zip.ZipFile, same code takes 300 ms (less than
a second). 
> I'm not totally sure what it is the problem but I did some debugging and basically all
time is spent in
> {code:java}
>     private void resolveLocalFileHeaderData(final Map<ZipArchiveEntry, NameAndComment>
entriesWithoutUTF8Flag)
> {code}
> Anything that can be done to improve this?



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Mime
View raw message