Return-Path: X-Original-To: apmail-cassandra-user-archive@www.apache.org Delivered-To: apmail-cassandra-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 2EFAA18F72 for ; Wed, 2 Mar 2016 21:58:58 +0000 (UTC) Received: (qmail 21816 invoked by uid 500); 2 Mar 2016 21:58:55 -0000 Delivered-To: apmail-cassandra-user-archive@cassandra.apache.org Received: (qmail 21764 invoked by uid 500); 2 Mar 2016 21:58:55 -0000 Mailing-List: contact user-help@cassandra.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@cassandra.apache.org Delivered-To: mailing list user@cassandra.apache.org Received: (qmail 21754 invoked by uid 99); 2 Mar 2016 21:58:55 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd4-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 02 Mar 2016 21:58:55 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd4-us-west.apache.org (ASF Mail Server at spamd4-us-west.apache.org) with ESMTP id B2003C086C for ; Wed, 2 Mar 2016 21:58:54 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd4-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 1.28 X-Spam-Level: * X-Spam-Status: No, score=1.28 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, HEADER_FROM_DIFFERENT_DOMAINS=0.001, HTML_MESSAGE=2, RCVD_IN_DNSWL_LOW=-0.7, RCVD_IN_MSPIKE_H3=-0.01, RCVD_IN_MSPIKE_WL=-0.01, SPF_PASS=-0.001] autolearn=disabled Authentication-Results: spamd4-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=turnitin-com.20150623.gappssmtp.com Received: from mx1-lw-eu.apache.org ([10.40.0.8]) by localhost (spamd4-us-west.apache.org [10.40.0.11]) (amavisd-new, port 10024) with ESMTP id btu7_NQQqDHK for ; Wed, 2 Mar 2016 21:58:52 +0000 (UTC) Received: from mail-vk0-f54.google.com (mail-vk0-f54.google.com [209.85.213.54]) by mx1-lw-eu.apache.org (ASF Mail Server at mx1-lw-eu.apache.org) with ESMTPS id D95EC5F3F3 for ; Wed, 2 Mar 2016 21:58:51 +0000 (UTC) Received: by mail-vk0-f54.google.com with SMTP id k196so2998504vka.0 for ; Wed, 02 Mar 2016 13:58:51 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=turnitin-com.20150623.gappssmtp.com; s=20150623; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :cc; bh=/bddm41Y2Kf2wS92Ac2Xr7172dq9olbVBIzk+fIf2Bs=; b=WF7Q+BDUntx6EwizZxo1+U682sBjs8to4vE40bI90Jw5olKurlF4Dc2+W13gztNZxD j9ySg3CO4FSbW57aYnUHDSwR+tLVyn7mehRnkvzqhQStUZwkhd5ExV7nHecRoci3xJp8 0Cwf5unXFcKGyakEkNGxMbvYEbDTPmtUwA5rkNieVTS+Hr9Dmpcug4GRqy3xL1UuMHX/ fa+X9jt/QXy+WSlTGDOKP5TvB5ZY8bOyatIXlswOVruTygYsN183SuHINuzwtzJ5+l/E Ga4sCSDTGTT2TjBYXd1t7q4ixvf9gKz8tz0Wr24d/LQpE2U2zju5p+9jcI433EMh+m/F SGYQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to:cc; bh=/bddm41Y2Kf2wS92Ac2Xr7172dq9olbVBIzk+fIf2Bs=; b=hRdXLWQ+T2TwLYFrsXl73eo6XpZi8avl+A2sfl19cYZv/o5HWnz10qgOB8gaUk9QLa vOG6xnko4VdclZJfJVFVIl/FMuQ2L1q6xKWC3JTgmTbpDT4hBjVPDXQEoIrbNYi6Oq3U UQZUyLShv+veewCp7BKddDKd0zPyabJxQ55BEChJBUD3KaQrxFejTH0XQaaGDFXtS2SV QqbDsxruJvHdL5zXszP8GoMqLqrMmv94gVMIE296GV0hJBU1Dovu2R/97760Yzgon47I 7JDuAHJzCZU4asbdwsHX6M7oMmvhNUdqFRVjBxr8sEsa8dqC2UpFSN97Sxh6czxridyi rNzw== X-Gm-Message-State: AD7BkJIBrUkO44aYtEw0GuTxoMUcZuKXvXV9O0sde9mPqOKMfudkC4dTQj5b0tWydEvypODL/+t/smCG5QRtdJDM X-Received: by 10.31.157.67 with SMTP id g64mr21858550vke.79.1456955925214; Wed, 02 Mar 2016 13:58:45 -0800 (PST) MIME-Version: 1.0 Received: by 10.31.98.2 with HTTP; Wed, 2 Mar 2016 13:58:25 -0800 (PST) In-Reply-To: References: From: Dan Kinder Date: Wed, 2 Mar 2016 13:58:25 -0800 Message-ID: Subject: Re: MemtableReclaimMemory pending building up To: Dan Kinder Cc: user@cassandra.apache.org Content-Type: multipart/alternative; boundary=001a11414f78604c54052d17fc81 --001a11414f78604c54052d17fc81 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable Also should note: Cassandra 2.2.5, Centos 6.7 On Wed, Mar 2, 2016 at 1:34 PM, Dan Kinder wrote: > Hi y'all, > > I am writing to a cluster fairly fast and seeing this odd behavior happen= , > seemingly to single nodes at a time. The node starts to take more and mor= e > memory (instance has 48GB memory on G1GC). tpstats shows that > MemtableReclaimMemory Pending starts to grow first, then later > MutationStage builds up as well. By then most of the memory is being > consumed, GC is getting longer, node slows down and everything slows down > unless I kill the node. Also the number of Active MemtableReclaimMemory > threads seems to stay at 1. Also interestingly, neither CPU nor disk > utilization are pegged while this is going on; it's on jbod and there is > plenty of headroom there. (Note that there is a decent number of > compactions going on as well but that is expected on these nodes and this > particular one is catching up from a high volume of writes). > > Anyone have any theories on why this would be happening? > > > $ nodetool tpstats > Pool Name Active Pending Completed Blocked > All time blocked > MutationStage 192 715481 311327142 0 > 0 > ReadStage 7 0 9142871 0 > 0 > RequestResponseStage 1 0 690823199 0 > 0 > ReadRepairStage 0 0 2145627 0 > 0 > CounterMutationStage 0 0 0 0 > 0 > HintedHandoff 0 0 144 0 > 0 > MiscStage 0 0 0 0 > 0 > CompactionExecutor 12 24 41022 0 > 0 > MemtableReclaimMemory 1 102 4263 0 > 0 > PendingRangeCalculator 0 0 10 0 > 0 > GossipStage 0 0 148329 0 > 0 > MigrationStage 0 0 0 0 > 0 > MemtablePostFlush 0 0 5233 0 > 0 > ValidationExecutor 0 0 0 0 > 0 > Sampler 0 0 0 0 > 0 > MemtableFlushWriter 0 0 4270 0 > 0 > InternalResponseStage 0 0 16322698 0 > 0 > AntiEntropyStage 0 0 0 0 > 0 > CacheCleanupExecutor 0 0 0 0 > 0 > Native-Transport-Requests 25 0 547935519 0 > 2586907 > > Message type Dropped > READ 0 > RANGE_SLICE 0 > _TRACE 0 > MUTATION 287057 > COUNTER_MUTATION 0 > REQUEST_RESPONSE 0 > PAGED_RANGE 0 > READ_REPAIR 149 > > --=20 Dan Kinder Principal Software Engineer Turnitin =E2=80=93 www.turnitin.com dkinder@turnitin.com --001a11414f78604c54052d17fc81 Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: base64 PGRpdiBkaXI9Imx0ciI+QWxzbyBzaG91bGQgbm90ZTogQ2Fzc2FuZHJhIDIuMi41LCBDZW50b3Mg Ni43PC9kaXY+PGRpdiBjbGFzcz0iZ21haWxfZXh0cmEiPjxicj48ZGl2IGNsYXNzPSJnbWFpbF9x dW90ZSI+T24gV2VkLCBNYXIgMiwgMjAxNiBhdCAxOjM0IFBNLCBEYW4gS2luZGVyIDxzcGFuIGRp cj0ibHRyIj4mbHQ7PGEgaHJlZj0ibWFpbHRvOmRraW5kZXJAdHVybml0aW4uY29tIiB0YXJnZXQ9 Il9ibGFuayI+ZGtpbmRlckB0dXJuaXRpbi5jb208L2E+Jmd0Ozwvc3Bhbj4gd3JvdGU6PGJyPjxi bG9ja3F1b3RlIGNsYXNzPSJnbWFpbF9xdW90ZSIgc3R5bGU9Im1hcmdpbjowIDAgMCAuOGV4O2Jv cmRlci1sZWZ0OjFweCAjY2NjIHNvbGlkO3BhZGRpbmctbGVmdDoxZXgiPjxkaXYgZGlyPSJsdHIi PkhpIHkmIzM5O2FsbCw8YnIgY2xlYXI9ImFsbCI+PGRpdj48YnI+PC9kaXY+PGRpdj5JIGFtIHdy aXRpbmcgdG8gYSBjbHVzdGVyIGZhaXJseSBmYXN0IGFuZCBzZWVpbmcgdGhpcyBvZGQgYmVoYXZp b3IgaGFwcGVuLCBzZWVtaW5nbHkgdG8gc2luZ2xlIG5vZGVzIGF0IGEgdGltZS4gVGhlIG5vZGUg c3RhcnRzIHRvIHRha2UgbW9yZSBhbmQgbW9yZSBtZW1vcnkgKGluc3RhbmNlIGhhcyA0OEdCIG1l bW9yeSBvbiBHMUdDKS4gdHBzdGF0cyBzaG93cyB0aGE8Zm9udCBmYWNlPSJhcmlhbCwgaGVsdmV0 aWNhLCBzYW5zLXNlcmlmIj50IE1lbXRhYmxlUmVjbGFpbU1lbW9yeSBQZW5kaW5nIHN0YXJ0cyB0 byBncm93IGZpcnN0LCB0aGVuIGxhdGVyIE11dGF0aW9uU3RhZ2UgYnVpbGRzIHVwIGFzIHdlbGwu IEJ5IHRoZW4gbW9zdCBvZiB0aGUgbWVtb3J5IGlzIGJlaW5nIGNvbnN1bWVkLCBHQyBpcyBnZXR0 aW5nIGxvbmdlciwgbm9kZSBzbG93cyBkb3duIGFuZCBldmVyeXRoaW5nIHNsb3dzIGRvd24gdW5s ZXNzIEkga2lsbCB0aGUgbm9kZS4gQWxzbyB0aGUgbnVtYmVyIG9mIEFjdGl2ZcKgPC9mb250Pjxz cGFuIHN0eWxlPSJmb250LWZhbWlseTphcmlhbCxoZWx2ZXRpY2Esc2Fucy1zZXJpZiI+TWVtdGFi bGVSZWNsYWltTWVtb3J5IHRocmVhZHMgc2VlbXMgdG8gc3RheSBhdCAxLiBBbHNvIGludGVyZXN0 aW5nbHksIG5laXRoZXIgQ1BVIG5vciBkaXNrIHV0aWxpemF0aW9uIGFyZSBwZWdnZWQgd2hpbGUg dGhpcyBpcyBnb2luZyBvbjsgaXQmIzM5O3Mgb24gamJvZCBhbmQgdGhlcmUgaXMgcGxlbnR5IG9m IGhlYWRyb29tIHRoZXJlLiAoTm90ZSB0aGF0IHRoZXJlIGlzIGEgZGVjZW50IG51bWJlciBvZiBj b21wYWN0aW9ucyBnb2luZyBvbiBhcyB3ZWxsIGJ1dCB0aGF0IGlzIGV4cGVjdGVkIG9uIHRoZXNl IG5vZGVzIGFuZCB0aGlzIHBhcnRpY3VsYXIgb25lIGlzIGNhdGNoaW5nIHVwIGZyb20gYSBoaWdo IHZvbHVtZSBvZiB3cml0ZXMpLjwvc3Bhbj48L2Rpdj48ZGl2PjxzcGFuIHN0eWxlPSJmb250LWZh bWlseTphcmlhbCxoZWx2ZXRpY2Esc2Fucy1zZXJpZiI+PGJyPjwvc3Bhbj48L2Rpdj48ZGl2Pjxz cGFuIHN0eWxlPSJmb250LWZhbWlseTphcmlhbCxoZWx2ZXRpY2Esc2Fucy1zZXJpZiI+QW55b25l IGhhdmUgYW55IHRoZW9yaWVzIG9uIHdoeSB0aGlzIHdvdWxkIGJlIGhhcHBlbmluZz88L3NwYW4+ PC9kaXY+PGRpdj48YnI+PC9kaXY+PGRpdj48Zm9udCBmYWNlPSJtb25vc3BhY2UsIG1vbm9zcGFj ZSI+PGJyPjwvZm9udD48L2Rpdj48ZGl2PjxkaXY+PGZvbnQgZmFjZT0ibW9ub3NwYWNlLCBtb25v c3BhY2UiPiQgbm9kZXRvb2wgdHBzdGF0czwvZm9udD48L2Rpdj48ZGl2Pjxmb250IGZhY2U9Im1v bm9zcGFjZSwgbW9ub3NwYWNlIj5Qb29sIE5hbWUgwqAgwqAgwqAgwqAgwqAgwqAgwqAgwqAgwqAg wqBBY3RpdmUgwqAgUGVuZGluZyDCoCDCoCDCoENvbXBsZXRlZCDCoCBCbG9ja2VkIMKgQWxsIHRp bWUgYmxvY2tlZDwvZm9udD48L2Rpdj48ZGl2Pjxmb250IGZhY2U9Im1vbm9zcGFjZSwgbW9ub3Nw YWNlIj5NdXRhdGlvblN0YWdlIMKgIMKgIMKgIMKgIMKgIMKgIMKgIMKgIMKgIDE5MiDCoCDCoDcx NTQ4MSDCoCDCoCDCoDMxMTMyNzE0MiDCoCDCoCDCoCDCoCAwIMKgIMKgIMKgIMKgIMKgIMKgIMKg IMKgIDA8L2ZvbnQ+PC9kaXY+PGRpdj48Zm9udCBmYWNlPSJtb25vc3BhY2UsIG1vbm9zcGFjZSI+ UmVhZFN0YWdlIMKgIMKgIMKgIMKgIMKgIMKgIMKgIMKgIMKgIMKgIMKgIMKgIDcgwqAgwqAgwqAg wqAgMCDCoCDCoCDCoCDCoDkxNDI4NzEgwqAgwqAgwqAgwqAgMCDCoCDCoCDCoCDCoCDCoCDCoCDC oCDCoCAwPC9mb250PjwvZGl2PjxkaXY+PGZvbnQgZmFjZT0ibW9ub3NwYWNlLCBtb25vc3BhY2Ui PlJlcXVlc3RSZXNwb25zZVN0YWdlIMKgIMKgIMKgIMKgIMKgIMKgIMKgMSDCoCDCoCDCoCDCoCAw IMKgIMKgIMKgNjkwODIzMTk5IMKgIMKgIMKgIMKgIDAgwqAgwqAgwqAgwqAgwqAgwqAgwqAgwqAg MDwvZm9udD48L2Rpdj48ZGl2Pjxmb250IGZhY2U9Im1vbm9zcGFjZSwgbW9ub3NwYWNlIj5SZWFk UmVwYWlyU3RhZ2UgwqAgwqAgwqAgwqAgwqAgwqAgwqAgwqAgwqAgMCDCoCDCoCDCoCDCoCAwIMKg IMKgIMKgIMKgMjE0NTYyNyDCoCDCoCDCoCDCoCAwIMKgIMKgIMKgIMKgIMKgIMKgIMKgIMKgIDA8 L2ZvbnQ+PC9kaXY+PGRpdj48Zm9udCBmYWNlPSJtb25vc3BhY2UsIG1vbm9zcGFjZSI+Q291bnRl ck11dGF0aW9uU3RhZ2UgwqAgwqAgwqAgwqAgwqAgwqAgwqAwIMKgIMKgIMKgIMKgIDAgwqAgwqAg wqAgwqAgwqAgwqAgwqAwIMKgIMKgIMKgIMKgIDAgwqAgwqAgwqAgwqAgwqAgwqAgwqAgwqAgMDwv Zm9udD48L2Rpdj48ZGl2Pjxmb250IGZhY2U9Im1vbm9zcGFjZSwgbW9ub3NwYWNlIj5IaW50ZWRI YW5kb2ZmIMKgIMKgIMKgIMKgIMKgIMKgIMKgIMKgIMKgIMKgIDAgwqAgwqAgwqAgwqAgMCDCoCDC oCDCoCDCoCDCoCDCoDE0NCDCoCDCoCDCoCDCoCAwIMKgIMKgIMKgIMKgIMKgIMKgIMKgIMKgIDA8 L2ZvbnQ+PC9kaXY+PGRpdj48Zm9udCBmYWNlPSJtb25vc3BhY2UsIG1vbm9zcGFjZSI+TWlzY1N0 YWdlIMKgIMKgIMKgIMKgIMKgIMKgIMKgIMKgIMKgIMKgIMKgIMKgIDAgwqAgwqAgwqAgwqAgMCDC oCDCoCDCoCDCoCDCoCDCoCDCoDAgwqAgwqAgwqAgwqAgMCDCoCDCoCDCoCDCoCDCoCDCoCDCoCDC oCAwPC9mb250PjwvZGl2PjxkaXY+PGZvbnQgZmFjZT0ibW9ub3NwYWNlLCBtb25vc3BhY2UiPkNv bXBhY3Rpb25FeGVjdXRvciDCoCDCoCDCoCDCoCDCoCDCoCDCoCAxMiDCoCDCoCDCoCDCoDI0IMKg IMKgIMKgIMKgIMKgNDEwMjIgwqAgwqAgwqAgwqAgMCDCoCDCoCDCoCDCoCDCoCDCoCDCoCDCoCAw PC9mb250PjwvZGl2PjxkaXY+PGZvbnQgZmFjZT0ibW9ub3NwYWNlLCBtb25vc3BhY2UiPk1lbXRh YmxlUmVjbGFpbU1lbW9yeSDCoCDCoCDCoCDCoCDCoCDCoCAxIMKgIMKgIMKgIDEwMiDCoCDCoCDC oCDCoCDCoCA0MjYzIMKgIMKgIMKgIMKgIDAgwqAgwqAgwqAgwqAgwqAgwqAgwqAgwqAgMDwvZm9u dD48L2Rpdj48ZGl2Pjxmb250IGZhY2U9Im1vbm9zcGFjZSwgbW9ub3NwYWNlIj5QZW5kaW5nUmFu Z2VDYWxjdWxhdG9yIMKgIMKgIMKgIMKgIMKgIMKgMCDCoCDCoCDCoCDCoCAwIMKgIMKgIMKgIMKg IMKgIMKgIDEwIMKgIMKgIMKgIMKgIDAgwqAgwqAgwqAgwqAgwqAgwqAgwqAgwqAgMDwvZm9udD48 L2Rpdj48ZGl2Pjxmb250IGZhY2U9Im1vbm9zcGFjZSwgbW9ub3NwYWNlIj5Hb3NzaXBTdGFnZSDC oCDCoCDCoCDCoCDCoCDCoCDCoCDCoCDCoCDCoCDCoCAwIMKgIMKgIMKgIMKgIDAgwqAgwqAgwqAg wqAgMTQ4MzI5IMKgIMKgIMKgIMKgIDAgwqAgwqAgwqAgwqAgwqAgwqAgwqAgwqAgMDwvZm9udD48 L2Rpdj48ZGl2Pjxmb250IGZhY2U9Im1vbm9zcGFjZSwgbW9ub3NwYWNlIj5NaWdyYXRpb25TdGFn ZSDCoCDCoCDCoCDCoCDCoCDCoCDCoCDCoCDCoCDCoDAgwqAgwqAgwqAgwqAgMCDCoCDCoCDCoCDC oCDCoCDCoCDCoDAgwqAgwqAgwqAgwqAgMCDCoCDCoCDCoCDCoCDCoCDCoCDCoCDCoCAwPC9mb250 PjwvZGl2PjxkaXY+PGZvbnQgZmFjZT0ibW9ub3NwYWNlLCBtb25vc3BhY2UiPk1lbXRhYmxlUG9z dEZsdXNoIMKgIMKgIMKgIMKgIMKgIMKgIMKgIMKgIDAgwqAgwqAgwqAgwqAgMCDCoCDCoCDCoCDC oCDCoCA1MjMzIMKgIMKgIMKgIMKgIDAgwqAgwqAgwqAgwqAgwqAgwqAgwqAgwqAgMDwvZm9udD48 L2Rpdj48ZGl2Pjxmb250IGZhY2U9Im1vbm9zcGFjZSwgbW9ub3NwYWNlIj5WYWxpZGF0aW9uRXhl Y3V0b3IgwqAgwqAgwqAgwqAgwqAgwqAgwqAgwqAwIMKgIMKgIMKgIMKgIDAgwqAgwqAgwqAgwqAg wqAgwqAgwqAwIMKgIMKgIMKgIMKgIDAgwqAgwqAgwqAgwqAgwqAgwqAgwqAgwqAgMDwvZm9udD48 L2Rpdj48ZGl2Pjxmb250IGZhY2U9Im1vbm9zcGFjZSwgbW9ub3NwYWNlIj5TYW1wbGVyIMKgIMKg IMKgIMKgIMKgIMKgIMKgIMKgIMKgIMKgIMKgIMKgIMKgIDAgwqAgwqAgwqAgwqAgMCDCoCDCoCDC oCDCoCDCoCDCoCDCoDAgwqAgwqAgwqAgwqAgMCDCoCDCoCDCoCDCoCDCoCDCoCDCoCDCoCAwPC9m b250PjwvZGl2PjxkaXY+PGZvbnQgZmFjZT0ibW9ub3NwYWNlLCBtb25vc3BhY2UiPk1lbXRhYmxl Rmx1c2hXcml0ZXIgwqAgwqAgwqAgwqAgwqAgwqAgwqAgMCDCoCDCoCDCoCDCoCAwIMKgIMKgIMKg IMKgIMKgIDQyNzAgwqAgwqAgwqAgwqAgMCDCoCDCoCDCoCDCoCDCoCDCoCDCoCDCoCAwPC9mb250 PjwvZGl2PjxkaXY+PGZvbnQgZmFjZT0ibW9ub3NwYWNlLCBtb25vc3BhY2UiPkludGVybmFsUmVz cG9uc2VTdGFnZSDCoCDCoCDCoCDCoCDCoCDCoCAwIMKgIMKgIMKgIMKgIDAgwqAgwqAgwqAgMTYz MjI2OTggwqAgwqAgwqAgwqAgMCDCoCDCoCDCoCDCoCDCoCDCoCDCoCDCoCAwPC9mb250PjwvZGl2 PjxkaXY+PGZvbnQgZmFjZT0ibW9ub3NwYWNlLCBtb25vc3BhY2UiPkFudGlFbnRyb3B5U3RhZ2Ug wqAgwqAgwqAgwqAgwqAgwqAgwqAgwqAgwqAwIMKgIMKgIMKgIMKgIDAgwqAgwqAgwqAgwqAgwqAg wqAgwqAwIMKgIMKgIMKgIMKgIDAgwqAgwqAgwqAgwqAgwqAgwqAgwqAgwqAgMDwvZm9udD48L2Rp dj48ZGl2Pjxmb250IGZhY2U9Im1vbm9zcGFjZSwgbW9ub3NwYWNlIj5DYWNoZUNsZWFudXBFeGVj dXRvciDCoCDCoCDCoCDCoCDCoCDCoCDCoDAgwqAgwqAgwqAgwqAgMCDCoCDCoCDCoCDCoCDCoCDC oCDCoDAgwqAgwqAgwqAgwqAgMCDCoCDCoCDCoCDCoCDCoCDCoCDCoCDCoCAwPC9mb250PjwvZGl2 PjxkaXY+PGZvbnQgZmFjZT0ibW9ub3NwYWNlLCBtb25vc3BhY2UiPk5hdGl2ZS1UcmFuc3BvcnQt UmVxdWVzdHMgwqAgwqAgwqAgwqAyNSDCoCDCoCDCoCDCoCAwIMKgIMKgIMKgNTQ3OTM1NTE5IMKg IMKgIMKgIMKgIDAgwqAgwqAgwqAgwqAgwqAgMjU4NjkwNzwvZm9udD48L2Rpdj48ZGl2Pjxmb250 IGZhY2U9Im1vbm9zcGFjZSwgbW9ub3NwYWNlIj48YnI+PC9mb250PjwvZGl2PjxkaXY+PGZvbnQg ZmFjZT0ibW9ub3NwYWNlLCBtb25vc3BhY2UiPk1lc3NhZ2UgdHlwZSDCoCDCoCDCoCDCoCDCoCBE cm9wcGVkPC9mb250PjwvZGl2PjxkaXY+PGZvbnQgZmFjZT0ibW9ub3NwYWNlLCBtb25vc3BhY2Ui PlJFQUQgwqAgwqAgwqAgwqAgwqAgwqAgwqAgwqAgwqAgwqAgwqAgwqAgMDwvZm9udD48L2Rpdj48 ZGl2Pjxmb250IGZhY2U9Im1vbm9zcGFjZSwgbW9ub3NwYWNlIj5SQU5HRV9TTElDRSDCoCDCoCDC oCDCoCDCoCDCoCDCoCDCoCDCoDA8L2ZvbnQ+PC9kaXY+PGRpdj48Zm9udCBmYWNlPSJtb25vc3Bh Y2UsIG1vbm9zcGFjZSI+X1RSQUNFIMKgIMKgIMKgIMKgIMKgIMKgIMKgIMKgIMKgIMKgIMKgIDA8 L2ZvbnQ+PC9kaXY+PGRpdj48Zm9udCBmYWNlPSJtb25vc3BhY2UsIG1vbm9zcGFjZSI+TVVUQVRJ T04gwqAgwqAgwqAgwqAgwqAgwqAgwqAgwqAyODcwNTc8L2ZvbnQ+PC9kaXY+PGRpdj48Zm9udCBm YWNlPSJtb25vc3BhY2UsIG1vbm9zcGFjZSI+Q09VTlRFUl9NVVRBVElPTiDCoCDCoCDCoCDCoCDC oCDCoCAwPC9mb250PjwvZGl2PjxkaXY+PGZvbnQgZmFjZT0ibW9ub3NwYWNlLCBtb25vc3BhY2Ui PlJFUVVFU1RfUkVTUE9OU0UgwqAgwqAgwqAgwqAgwqAgwqAgMDwvZm9udD48L2Rpdj48ZGl2Pjxm b250IGZhY2U9Im1vbm9zcGFjZSwgbW9ub3NwYWNlIj5QQUdFRF9SQU5HRSDCoCDCoCDCoCDCoCDC oCDCoCDCoCDCoCDCoDA8L2ZvbnQ+PC9kaXY+PGRpdj48Zm9udCBmYWNlPSJtb25vc3BhY2UsIG1v bm9zcGFjZSI+UkVBRF9SRVBBSVIgwqAgwqAgwqAgwqAgwqAgwqAgwqAgwqAxNDk8L2ZvbnQ+PC9k aXY+PC9kaXY+PGRpdj48YnI+PC9kaXY+DQo8L2Rpdj4NCjwvYmxvY2txdW90ZT48L2Rpdj48YnI+ PGJyIGNsZWFyPSJhbGwiPjxkaXY+PGJyPjwvZGl2Pi0tIDxicj48ZGl2IGNsYXNzPSJnbWFpbF9z aWduYXR1cmUiPjxkaXYgZGlyPSJsdHIiPjxkaXY+PGRpdiBkaXI9Imx0ciI+RGFuIEtpbmRlcjxi cj5QcmluY2lwYWwgU29mdHdhcmUgRW5naW5lZXI8YnI+VHVybml0aW4g4oCTIDxhIGhyZWY9Imh0 dHA6Ly93d3cudHVybml0aW4uY29tIiB0YXJnZXQ9Il9ibGFuayI+d3d3LnR1cm5pdGluLmNvbTwv YT48YnI+PGEgaHJlZj0ibWFpbHRvOmRraW5kZXJAdHVybml0aW4uY29tIiB0YXJnZXQ9Il9ibGFu ayI+ZGtpbmRlckB0dXJuaXRpbi5jb208L2E+PGJyPjwvZGl2PjwvZGl2PjwvZGl2PjwvZGl2Pg0K PC9kaXY+DQo= --001a11414f78604c54052d17fc81--