impala-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Juan <any...@gmail.com>
Subject Re: when will catalogd perform full GC
Date Fri, 17 Nov 2017 20:10:23 GMT
When will full GC be performed depends on GC config and GC strategy, not by
Catalog.
Do you use G1GC?

G1GC will try to avoid full GC.

On Sun, Nov 5, 2017 at 4:21 PM, Chan Chor Pang <chin-sh@indetail.co.jp>
wrote:

> Hello,
>
> a few months ago, i have a OOM from catalogd
> after that i monitor the heap usage and it seems that catalogd never
> perform full GC
> even when Old Generation usage is over 99%
>
> i can perform a full GC manually and after that the Old Generation usage
> will drop to 18%
> clearly there is lots of free space
>
> i dont understand why
>
> ---------------------------
> $sudo -u impala /usr/java/jdk1.8.0_74/bin/jmap -heap 76868
> Attaching to process ID 76868, please wait...
> Debugger attached successfully.
> Server compiler detected.
> JVM version is 25.74-b02
>
> using thread-local object allocation.
> Parallel GC with 48 thread(s)
>
> Heap Configuration:
>    MinHeapFreeRatio         = 0
>    MaxHeapFreeRatio         = 100
>    MaxHeapSize              = 34359738368 (32768.0MB)
>    NewSize                  = 11453071360 (10922.5MB)
>    MaxNewSize               = 11453071360 (10922.5MB)
>    OldSize                  = 22906667008 (21845.5MB)
>    NewRatio                 = 2
>    SurvivorRatio            = 8
>    MetaspaceSize            = 21807104 (20.796875MB)
>    CompressedClassSpaceSize = 1073741824 (1024.0MB)
>    MaxMetaspaceSize         = 17592186044415 MB
>    G1HeapRegionSize         = 0 (0.0MB)
>
> Heap Usage:
> PS Young Generation
> Eden Space:
>    capacity = 11389632512 (10862.0MB)
>    used     = 8377265840 (7989.18327331543MB)
>    free     = 3012366672 (2872.8167266845703MB)
>    73.55167808244734% used
> From Space:
>    capacity = 31981568 (30.5MB)
>    used     = 25886816 (24.687591552734375MB)
>    free     = 6094752 (5.812408447265625MB)
>    80.94292312371927% used
> To Space:
>    capacity = 31457280 (30.0MB)
>    used     = 0 (0.0MB)
>    free     = 31457280 (30.0MB)
>    0.0% used
> PS Old Generation
>    capacity = 22906667008 (21845.5MB)
>    used     = 22800444088 (21744.197929382324MB)
>    free     = 106222920 (101.30207061767578MB)
>    99.53627945976207% used
>
> 19085 interned Strings occupying 2356816 bytes.
>
> ---------------------------
> $ sudo -u impala /usr/java/jdk1.8.0_74/bin/jcmd 76868 GC.run
> 76868:
> Command executed successfully
>
> ---------------------------
> $ sudo -u impala /usr/java/jdk1.8.0_74/bin/jmap -heap 76868
> Attaching to process ID 76868, please wait...
> Debugger attached successfully.
> Server compiler detected.
> JVM version is 25.74-b02
>
> using thread-local object allocation.
> Parallel GC with 48 thread(s)
>
> Heap Configuration:
>    MinHeapFreeRatio         = 0
>    MaxHeapFreeRatio         = 100
>    MaxHeapSize              = 34359738368 (32768.0MB)
>    NewSize                  = 11453071360 (10922.5MB)
>    MaxNewSize               = 11453071360 (10922.5MB)
>    OldSize                  = 22906667008 (21845.5MB)
>    NewRatio                 = 2
>    SurvivorRatio            = 8
>    MetaspaceSize            = 21807104 (20.796875MB)
>    CompressedClassSpaceSize = 1073741824 (1024.0MB)
>    MaxMetaspaceSize         = 17592186044415 MB
>    G1HeapRegionSize         = 0 (0.0MB)
>
> Heap Usage:
> PS Young Generation
> Eden Space:
>    capacity = 11391205376 (10863.5MB)
>    used     = 1129420064 (1077.0989074707031MB)
>    free     = 10261785312 (9786.401092529297MB)
>    9.914842430806859% used
> From Space:
>    capacity = 30932992 (29.5MB)
>    used     = 0 (0.0MB)
>    free     = 30932992 (29.5MB)
>    0.0% used
> To Space:
>    capacity = 30932992 (29.5MB)
>    used     = 0 (0.0MB)
>    free     = 30932992 (29.5MB)
>    0.0% used
> PS Old Generation
>    capacity = 22906667008 (21845.5MB)
>    used     = 4267747272 (4070.0409622192383MB)
>    free     = 18638919736 (17775.45903778076MB)
>    18.631026812017296% used
>
> 19074 interned Strings occupying 2355872 bytes.
>

Mime
View raw message