From common-issues-return-204772-archive-asf-public=cust-asf.ponee.io@hadoop.apache.org Tue Sep 1 11:23:04 2020 Return-Path: X-Original-To: archive-asf-public@cust-asf.ponee.io Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mailroute1-lw-us.apache.org (mailroute1-lw-us.apache.org [207.244.88.153]) by mx-eu-01.ponee.io (Postfix) with ESMTPS id DBFB5180660 for ; Tue, 1 Sep 2020 13:23:03 +0200 (CEST) Received: from mail.apache.org (localhost [127.0.0.1]) by mailroute1-lw-us.apache.org (ASF Mail Server at mailroute1-lw-us.apache.org) with SMTP id 12EB2126F1D for ; Tue, 1 Sep 2020 11:23:03 +0000 (UTC) Received: (qmail 51934 invoked by uid 500); 1 Sep 2020 11:23:02 -0000 Mailing-List: contact common-issues-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Delivered-To: mailing list common-issues@hadoop.apache.org Received: (qmail 51900 invoked by uid 99); 1 Sep 2020 11:23:02 -0000 Received: from mailrelay1-us-west.apache.org (HELO mailrelay1-us-west.apache.org) (209.188.14.139) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 01 Sep 2020 11:23:02 +0000 Received: from jira-he-de.apache.org (static.172.67.40.188.clients.your-server.de [188.40.67.172]) by mailrelay1-us-west.apache.org (ASF Mail Server at mailrelay1-us-west.apache.org) with ESMTP id 701F545AA4 for ; Tue, 1 Sep 2020 11:23:01 +0000 (UTC) Received: from jira-he-de.apache.org (localhost.localdomain [127.0.0.1]) by jira-he-de.apache.org (ASF Mail Server at jira-he-de.apache.org) with ESMTP id 4FF5C7809A3 for ; Tue, 1 Sep 2020 11:23:00 +0000 (UTC) Date: Tue, 1 Sep 2020 11:23:00 +0000 (UTC) From: "ASF GitHub Bot (Jira)" To: common-issues@hadoop.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Work logged] (HADOOP-17229) Test failure as failed request body counted in byte received metric - ITestAbfsNetworkStatistics#testAbfsHttpResponseStatistics MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/HADOOP-17229?focusedWorklogId= =3D477146&page=3Dcom.atlassian.jira.plugin.system.issuetabpanels:worklog-ta= bpanel#worklog-477146 ] ASF GitHub Bot logged work on HADOOP-17229: ------------------------------------------- Author: ASF GitHub Bot Created on: 01/Sep/20 11:22 Start Date: 01/Sep/20 11:22 Worklog Time Spent: 10m=20 Work Description: mehakmeet opened a new pull request #2264: URL: https://github.com/apache/hadoop/pull/2264 After a response failure at the moment, there is an increment to the byt= es_received counter value which shouldn't increment. =20 Test-run: mvn -T 1C -Dparallel-tests=3Dabfs clean verify ``` [INFO] Results: [INFO] [INFO] Tests run: 87, Failures: 0, Errors: 0, Skipped: 0 ``` =20 ``` [INFO] Results: [INFO] [ERROR] Errors: [ERROR] ITestAzureBlobFileSystemCheckAccess.:82->setTestUserFs:1= 04 =C2=BB IllegalArgument [ERROR] ITestAzureBlobFileSystemCheckAccess.:82->setTestUserFs:1= 04 =C2=BB IllegalArgument [ERROR] ITestAzureBlobFileSystemCheckAccess.:82->setTestUserFs:1= 04 =C2=BB IllegalArgument [ERROR] ITestAzureBlobFileSystemCheckAccess.:82->setTestUserFs:1= 04 =C2=BB IllegalArgument [ERROR] ITestAzureBlobFileSystemCheckAccess.:82->setTestUserFs:1= 04 =C2=BB IllegalArgument [ERROR] ITestAzureBlobFileSystemCheckAccess.:82->setTestUserFs:1= 04 =C2=BB IllegalArgument [ERROR] ITestAzureBlobFileSystemCheckAccess.:82->setTestUserFs:1= 04 =C2=BB IllegalArgument [ERROR] ITestAzureBlobFileSystemCheckAccess.:82->setTestUserFs:1= 04 =C2=BB IllegalArgument [ERROR] ITestAzureBlobFileSystemCheckAccess.:82->setTestUserFs:1= 04 =C2=BB IllegalArgument [ERROR] ITestAzureBlobFileSystemCheckAccess.:82->setTestUserFs:1= 04 =C2=BB IllegalArgument [ERROR] ITestAzureBlobFileSystemCheckAccess.:82->setTestUserFs:1= 04 =C2=BB IllegalArgument [ERROR] ITestAzureBlobFileSystemCheckAccess.:82->setTestUserFs:1= 04 =C2=BB IllegalArgument [ERROR] ITestAzureBlobFileSystemDelete.testDeleteIdempotencyTriggerHtt= p404:223 =C2=BB NoSuchField [ERROR] ITestAzureBlobFileSystemRename.testRenameIdempotencyTriggerHtt= pNotFound:225->testRenameIdempotencyTriggerChecks:236 =C2=BB NoSuchField [INFO] [ERROR] Tests run: 452, Failures: 0, Errors: 14, Skipped: 61 ``` ``` [INFO] Results: [INFO] [WARNING] Tests run: 206, Failures: 0, Errors: 0, Skipped: 29 ``` Not really sure about these two failures ``` [ERROR] ITestAzureBlobFileSystemDelete.testDeleteIdempotencyTriggerHtt= p404:223 =C2=BB NoSuchField [ERROR] ITestAzureBlobFileSystemRename.testRenameIdempotencyTriggerHtt= pNotFound:225->testRenameIdempotencyTriggerChecks:236 =C2=BB NoSuchField ``` Others are already in a Jira: HADOOP-17203. ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: users@infra.apache.org Issue Time Tracking ------------------- Worklog Id: (was: 477146) Remaining Estimate: 0h Time Spent: 10m > Test failure as failed request body counted in byte received metric - ITe= stAbfsNetworkStatistics#testAbfsHttpResponseStatistics > -------------------------------------------------------------------------= ------------------------------------------------------ > > Key: HADOOP-17229 > URL: https://issues.apache.org/jira/browse/HADOOP-17229 > Project: Hadoop Common > Issue Type: Bug > Components: fs/azure, test > Affects Versions: 3.3.0 > Reporter: Sneha Vijayarajan > Assignee: Mehakmeet Singh > Priority: Major > Labels: abfsactive > Time Spent: 10m > Remaining Estimate: 0h > > Bytes received counter increments for every request response received.=C2= =A0 > [https://github.com/apache/hadoop/blob/d23cc9d85d887f01d72180bdf1af87dfde= e15c5a/hadoop-tools/hadoop-azure/src/main/java/org/apache/hadoop/fs/azurebf= s/services/AbfsRestOperation.java#L251] > This increments even for failed requests.=C2=A0 > Observed during testing done for HADOOP-17215. A request failed with 409 = Conflict contains response body as below: > {"error":\{"code":"PathAlreadyExists","message":"The specified path alrea= dy exists.\nRequestId:c3b2c55c-b01f-0061-7b31-7b6ee3000000\nTime:2020-08-25= T22:44:07.2356054Z"}} > The error body of 168 size is incremented in bytes_received counter.=C2= =A0 > This also breaks the testcase testAbfsHttpResponseStatistics.=C2=A0 > {code:java} > [ERROR] Tests run: 2, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 2= 2.746 s <<< FAILURE! - in org.apache.hadoop.fs.azurebfs.ITestAbfsNetworkSta= tistics[ERROR] Tests run: 2, Failures: 1, Errors: 0, Skipped: 0, Time elaps= ed: 22.746 s <<< FAILURE! - in org.apache.hadoop.fs.azurebfs.ITestAbfsNetwo= rkStatistics[ERROR] testAbfsHttpResponseStatistics(org.apache.hadoop.fs.azu= rebfs.ITestAbfsNetworkStatistics)=C2=A0 Time elapsed: 13.183 s=C2=A0 <<< FA= ILURE!java.lang.AssertionError: Mismatch in bytes_received expected:<143> b= ut was:<311> at org.junit.Assert.fail(Assert.java:88) at org.junit.Assert.f= ailNotEquals(Assert.java:834) at org.junit.Assert.assertEquals(Assert.java:= 645) at org.apache.hadoop.fs.azurebfs.AbstractAbfsIntegrationTest.assertAbf= sStatistics(AbstractAbfsIntegrationTest.java:445) at org.apache.hadoop.fs.a= zurebfs.ITestAbfsNetworkStatistics.testAbfsHttpResponseStatistics(ITestAbfs= NetworkStatistics.java:291) > {code} > [~mehakmeetSingh]=C2=A0- is the bytes_received counter increment for fail= ed requests an expected behaviour ? -- This message was sent by Atlassian Jira (v8.3.4#803005) --------------------------------------------------------------------- To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org For additional commands, e-mail: common-issues-help@hadoop.apache.org