From users-return-50618-archive-asf-public=cust-asf.ponee.io@activemq.apache.org Sun Oct 28 18:18:05 2018 Return-Path: X-Original-To: archive-asf-public@cust-asf.ponee.io Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by mx-eu-01.ponee.io (Postfix) with SMTP id 273C2180671 for ; Sun, 28 Oct 2018 18:18:04 +0100 (CET) Received: (qmail 76010 invoked by uid 500); 28 Oct 2018 17:18:04 -0000 Mailing-List: contact users-help@activemq.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: users@activemq.apache.org Delivered-To: mailing list users@activemq.apache.org Received: (qmail 75999 invoked by uid 99); 28 Oct 2018 17:18:03 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd3-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Sun, 28 Oct 2018 17:18:03 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd3-us-west.apache.org (ASF Mail Server at spamd3-us-west.apache.org) with ESMTP id D93A818E39B for ; Sun, 28 Oct 2018 17:18:02 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd3-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 3.736 X-Spam-Level: *** X-Spam-Status: No, score=3.736 tagged_above=-999 required=6.31 tests=[DKIM_ADSP_CUSTOM_MED=0.001, FREEMAIL_ENVFROM_END_DIGIT=0.25, NML_ADSP_CUSTOM_MED=1.2, SPF_HELO_PASS=-0.001, SPF_SOFTFAIL=0.972, URI_HEX=1.313, URI_TRY_3LD=0.001] autolearn=disabled Received: from mx1-lw-us.apache.org ([10.40.0.8]) by localhost (spamd3-us-west.apache.org [10.40.0.10]) (amavisd-new, port 10024) with ESMTP id n5fT_vnJ7Vl6 for ; Sun, 28 Oct 2018 17:18:01 +0000 (UTC) Received: from n4.nabble.com (n4.nabble.com [199.38.86.66]) by mx1-lw-us.apache.org (ASF Mail Server at mx1-lw-us.apache.org) with ESMTP id 6D3C55F366 for ; Sun, 28 Oct 2018 17:18:01 +0000 (UTC) Received: from n4.nabble.com (localhost [127.0.0.1]) by n4.nabble.com (Postfix) with ESMTP id 147C62972597 for ; Sun, 28 Oct 2018 12:18:01 -0500 (CDT) Date: Sun, 28 Oct 2018 12:18:01 -0500 (CDT) From: veaceslavdoina To: users@activemq.apache.org Message-ID: <1540747081040-0.post@n4.nabble.com> Subject: ActiveMQ and Artemis reliability - Messages lost MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: 7bit Hello everyone, As was recently mentioned [1], we started to analyze the currently used queue system. During the first iteration, we started to test reliability. Testing environment: AWS Hardware: | Producer | m5.large | 2vCPU / 8GiB | | Consumer | t3.medium | 2vCPU / 2GiB | Software: OS: CentOS Linux release 7.5.1804 Java: Oracle JDK SE 8 Update 191 ActiveMQ: ActiveMQ 5.15.6 Artemis: ActiveMQ Artemis 2.6.3 Client: JmsTools [2] Configuration: ActiveMQ stand-alone: 1. activemq.xml: added 'individualDeadLetterStrategy' 2. ACTIVEMQ_OPTS=-Xms512M -Xmx7G 3. Started as systemd service Artemis stand-alone: 1. artemis.profile: modified JAVA_ARGS to -Xms512M -Xmx7G 2. jolokia-access.xml: modified to * 3. Started as systemd service Methodology: 1. Run producer for 5 minutes on the queue. 2. Run consumer to consume all messages from the same queue. 3. Iterate 5 times. 4. Restart activemq or artemis service during producer/consumer work, depending on the test. Client: Producer: java -Xms512m -Xmx3G -jar AmqJmsProducer-1.8-jar-with-dependencies.jar -url failover:\(tcp://10.0.20.28:61616,tcp://10.0.20.28:61616\) \ -notran \ -log Logs \ -t 10 \ -duration 5 \ -id \ -type TEXT \ -queue Test Consumer: java -Xms512m -Xmx3G -jar AmqJmsConsumer-1.8-jar-with-dependencies.jar \ -url failover:\(tcp://10.0.20.28:61616,tcp://10.0.20.28:61616\) \ -log Logs \ -timeout 60000 \ -t 10 \ -verify \ -drain \ -queue Test Restarts: service=activemq #service=artemis while :; do interval=30 sudo systemctl restart $service sudo systemctl status $service | grep "Active:.*;" sleep $interval done > Note: Artemis service was restarted every 120 seconds and sometimes > restarts were stopped because of Artemis long start because of journal > checking. Results: Question: 1. Is there any configuration from the default ones which may permit us to achieve zero messages loss with ActiveMQ an Artemis? 2. If we assume that used tools may have issues/bugs, which one may we use for such type of tests? 3. Any advices. Thank you! Slava. Links: [1] - http://activemq.2283324.n4.nabble.com/ActiveMQ-5-x-reliability-and-ActiveMQ-Artemis-questions-tt4744108.html [2] - https://github.com/erik-wramner/JmsTools -- Sent from: http://activemq.2283324.n4.nabble.com/ActiveMQ-User-f2341805.html