accumulo-notifications mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Adam Fuchs (JIRA)" <>
Subject [jira] [Created] (ACCUMULO-3303) funky performance with large WAL
Date Wed, 05 Nov 2014 23:20:37 GMT
Adam Fuchs created ACCUMULO-3303:

             Summary: funky performance with large WAL
                 Key: ACCUMULO-3303
             Project: Accumulo
          Issue Type: Bug
          Components: logger, tserver
    Affects Versions: 1.6.1
            Reporter: Adam Fuchs

The tserver seems to get into a funky state when writing to a large write-ahead log. I ran
some continuous ingest tests varying tserver.walog.max.size in {512M, 1G, 2G, 4G, 8G} and
got some results that I have yet to understand. I was expecting to see the effects of walog
metadata management as described in ACCUMULO-2889, but I also found an additional behavior
of ingest slowing down for long periods when using a large walog size.

The cluster configuration was as follows:
Accumulo version: 1.6.2-SNAPSHOT (current head of origin/1.6)
Nodes: 4
Masters: 1
Slaves: 3
Cores per node: 24
Drives per node: 8x1TB data + 2 raided system
Memory per node: 64GB
table.file.compress.type=snappy (for ci table only)
Native maps enabled

This message was sent by Atlassian JIRA

View raw message