Mailing-List: contact common-issues-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
Date: Wed, 16 Aug 2017 14:23:00 +0000 (UTC)
From: "Steve Loughran (JIRA)" <jira@apache.org>
To: common-issues@hadoop.apache.org
Message-ID: <JIRA.13081084.1497955168000.43837.1502893380451@Atlassian.JIRA>
In-Reply-To: <JIRA.13081084.1497955168000@Atlassian.JIRA>
References: <JIRA.13081084.1497955168000@Atlassian.JIRA> <JIRA.13081084.1497955168269@jira-lw-us.apache.org>
Subject: [jira] [Commented] (HADOOP-14553) Add (parallelized) integration
 tests to hadoop-azure
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: quoted-printable
archived-at: Wed, 16 Aug 2017 14:23:17 -0000


    [ https://issues.apache.org/jira/browse/HADOOP-14553?page=3Dcom.atlassi=
an.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=3D16=
128856#comment-16128856 ]=20

Steve Loughran commented on HADOOP-14553:
-----------------------------------------

Test time overall; 13:07, with half the time coming from the not-yet-parall=
elised test suites

Results :

Tests run: 319, Failures: 0, Errors: 0, Skipped: 98

[INFO]=20
[INFO] --- maven-failsafe-plugin:2.17:integration-test (sequential-integrat=
ion-tests) @ hadoop-azure ---
[INFO] Failsafe report directory: /Users/stevel/Projects/hadoop-trunk/hadoo=
p-tools/hadoop-azure/target/failsafe-reports

{code}
Running org.apache.hadoop.fs.azure.ITestBlobDataValidation
Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.982 sec -=
 in org.apache.hadoop.fs.azure.ITestBlobDataValidation
Running org.apache.hadoop.fs.azure.ITestBlockBlobInputStream
Tests run: 21, Failures: 0, Errors: 0, Skipped: 21, Time elapsed: 0.989 sec=
 - in org.apache.hadoop.fs.azure.ITestBlockBlobInputStream
Running org.apache.hadoop.fs.azure.ITestFileSystemOperationsExceptionHandli=
ngMultiThreaded
Tests run: 12, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 22.407 sec=
 - in org.apache.hadoop.fs.azure.ITestFileSystemOperationsExceptionHandling=
MultiThreaded
Running org.apache.hadoop.fs.azure.ITestFileSystemOperationsWithThreads
Tests run: 19, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 228.507 se=
c - in org.apache.hadoop.fs.azure.ITestFileSystemOperationsWithThreads
Running org.apache.hadoop.fs.azure.ITestNativeAzureFileSystemAuthorizationW=
ithOwner
Tests run: 27, Failures: 0, Errors: 0, Skipped: 27, Time elapsed: 3.862 sec=
 - in org.apache.hadoop.fs.azure.ITestNativeAzureFileSystemAuthorizationWit=
hOwner
Running org.apache.hadoop.fs.azure.ITestNativeAzureFileSystemConcurrencyLiv=
e
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.435 sec -=
 in org.apache.hadoop.fs.azure.ITestNativeAzureFileSystemConcurrencyLive
Running org.apache.hadoop.fs.azure.ITestNativeAzureFileSystemLive
Tests run: 51, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 274.746 se=
c - in org.apache.hadoop.fs.azure.ITestNativeAzureFileSystemLive
Running org.apache.hadoop.fs.azure.ITestOutOfBandAzureBlobOperationsLive
Tests run: 9, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 6.224 sec -=
 in org.apache.hadoop.fs.azure.ITestOutOfBandAzureBlobOperationsLive
Running org.apache.hadoop.fs.azure.ITestWasbRemoteCallHelper
Tests run: 10, Failures: 0, Errors: 0, Skipped: 10, Time elapsed: 1.32 sec =
- in org.apache.hadoop.fs.azure.ITestWasbRemoteCallHelper

{code}

> Add (parallelized) integration tests to hadoop-azure
> ----------------------------------------------------
>
>                 Key: HADOOP-14553
>                 URL: https://issues.apache.org/jira/browse/HADOOP-14553
>             Project: Hadoop Common
>          Issue Type: Sub-task
>          Components: fs/azure
>    Affects Versions: 2.9.0
>            Reporter: Steve Loughran
>            Assignee: Steve Loughran
>         Attachments: HADOOP-14553-001.patch, HADOOP-14553-002.patch, HADO=
OP-14553-003.patch, HADOOP-14553-004.patch, HADOOP-14553-005.patch, HADOOP-=
14553-006.patch, HADOOP-14553-007.patch, HADOOP-14553-008.patch, HADOOP-145=
53-009.patch, HADOOP-14553-010.patch, HADOOP-14553-011.patch
>
>
> The Azure tests are slow to run as they are serialized, as they are all c=
alled Test* there's no clear differentiation from unit tests which Jenkins =
can run, and integration tests which it can't.
> Move the azure tests {{Test*}} to integration tests {{ITest*}}, paralleli=
ze (which includes having separate paths for every test suite). The code in=
 hadoop-aws's POM &c show what to do.
> *UPDATE August 4, 2017*:  Adding a list of requirements to clarify the ac=
ceptance criteria for this JIRA:
> # Parallelize test execution
> # Define test groups: i) UnitTests - self-contained, executed by Jenkins,=
 ii) IntegrationTests - requires Azure Storage account, executed by enginee=
rs prior to check-in, and if needed, iii)=09ScaleTests =E2=80=93 long runni=
ng performance and scalability tests.
> # Define configuration profiles to run tests with different settings.  Al=
lows an engineer to run =E2=80=9CIntegrationTests=E2=80=9D with fs.azure.se=
cure.mode =3D true and false.  Need to review settings to see what else wou=
ld benefit.
> # Maven commands to run b) and c).  Turns out it is not easy to do with M=
aven, so we might have to run it multiple times to run with different confi=
guration settings.
> # Document how to add and run tests and the process for contributing to A=
pache Hadoop.  Steve shared an example at https://github.com/apache/hadoop/=
blob/trunk/hadoop-tools/hadoop-aws/src/site/markdown/tools/hadoop-aws/testi=
ng.md=20
> # UnitTests should run in under 2 minutes and IntegrationTests should run=
 in under 15 minutes, even on slower network connections.  (These are rough=
 goals)
> # Ensure test data (containers/blobs/etc) is deleted.  Exceptions for lar=
ge persistent content used repeatedly to expedite test execution.=20


--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org