any23-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From HansBrende <...@git.apache.org>
Subject [GitHub] any23 issue #58: ANY23-324 Changed default html parser from NekoHTML to Jsou...
Date Tue, 23 Jan 2018 22:33:00 GMT
Github user HansBrende commented on the issue:

    https://github.com/apache/any23/pull/58
  
    @lewismc I wrote a quick little speed test. Not sure if this is the best way to do it,
but FWIW, here it is:
    
    ```
    public static void main(String[] args) throws IOException {
        String url = "https://en.wikipedia.org/wiki/List_of_compositions_by_Johann_Sebastian_Bach";
        String encoding = "utf-8";
        byte[] webpage = IOUtils.toString(new URL(url)).getBytes(encoding);
    
        TagSoupParsingConfiguration neko = TagSoupParser.legacyConfig();
        TagSoupParsingConfiguration jsoup = JsoupConfig.instance;
        long totalTimeNeko = 0, totalTimeJsoup = 0;
        for (int i = 0; i < 11000; i++) {
            ByteArrayInputStream input = new ByteArrayInputStream(webpage);
            boolean useNeko = i % 2 == 0;
            TagSoupParsingConfiguration config = useNeko ? neko : jsoup;
    
            long start = System.currentTimeMillis();
            config.parse(input, url, encoding);
            long duration = System.currentTimeMillis() - start;
    
            long timeToAdd = i < 1000 ? 0 : duration; //SKIP FIRST 1000 ITERATIONS
            if (useNeko) {
                totalTimeNeko += timeToAdd;
            } else {
                totalTimeJsoup += timeToAdd;
            }
    
            if (i % 100 == 0) {
                System.out.println(i);
            }
        }
    
        System.out.println("total time neko:  " + totalTimeNeko + " ms");
        System.out.println("total time jsoup: " + totalTimeJsoup + " ms");
    
    }
    ```
    
    RESULTS:
    
    <pre>
    total time neko:  488787 ms
    total time jsoup: 479211 ms
    </pre>



---

Mime
View raw message