From dev-return-4152-archive-asf-public=cust-asf.ponee.io@hudi.apache.org Wed Jun 30 21:59:25 2021 Return-Path: X-Original-To: archive-asf-public@cust-asf.ponee.io Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mxout1-ec2-va.apache.org (mxout1-ec2-va.apache.org [3.227.148.255]) by mx-eu-01.ponee.io (Postfix) with ESMTPS id E58B918060E for ; Wed, 30 Jun 2021 23:59:24 +0200 (CEST) Received: from mail.apache.org (mailroute1-lw-us.apache.org [207.244.88.153]) by mxout1-ec2-va.apache.org (ASF Mail Server at mxout1-ec2-va.apache.org) with SMTP id EFA2E3FBF8 for ; Wed, 30 Jun 2021 21:59:23 +0000 (UTC) Received: (qmail 18360 invoked by uid 500); 30 Jun 2021 21:59:23 -0000 Mailing-List: contact dev-help@hudi.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@hudi.apache.org Delivered-To: mailing list dev@hudi.apache.org Received: (qmail 18348 invoked by uid 99); 30 Jun 2021 21:59:23 -0000 Received: from ec2-52-204-25-47.compute-1.amazonaws.com (HELO mailrelay1-ec2-va.apache.org) (52.204.25.47) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 30 Jun 2021 21:59:23 +0000 Received: from mail-pj1-f49.google.com (mail-pj1-f49.google.com [209.85.216.49]) by mailrelay1-ec2-va.apache.org (ASF Mail Server at mailrelay1-ec2-va.apache.org) with ESMTPSA id 533223E8DF for ; Wed, 30 Jun 2021 21:59:23 +0000 (UTC) Received: by mail-pj1-f49.google.com with SMTP id ie21so1031451pjb.0 for ; Wed, 30 Jun 2021 14:59:23 -0700 (PDT) X-Gm-Message-State: AOAM531SvGT2QIvw419sEMU8VM4tg0qhAquDT/T3g7Ue0ebSYrckd0fH M1eTpBOBMktiKTVAJGBt5iJKdbAPEXGle6JQ684= X-Google-Smtp-Source: ABdhPJy1oCFoYmXHXVMW8hqy0Y5XUpDx5Ps6/cRXm6dMITxzQbqu3wcjEd58F6fhVCx3enkuorX+BtGLbYF6FpDP/r8= X-Received: by 2002:a17:90a:c8b:: with SMTP id v11mr6262501pja.114.1625090362541; Wed, 30 Jun 2021 14:59:22 -0700 (PDT) MIME-Version: 1.0 References: In-Reply-To: From: Vinoth Chandar Date: Wed, 30 Jun 2021 14:59:11 -0700 X-Gmail-Original-Message-ID: Message-ID: Subject: Re: [HELP] unstable tests in the travis CI To: dev Content-Type: multipart/alternative; boundary="000000000000c989fd05c602d56d" --000000000000c989fd05c602d56d Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable Thanks Raymond. Will chat more on the JIRA. I am looking into some of these. I vote for stabilizing things before we land any involved PRs. On Sat, Jun 26, 2021 at 4:45 PM Raymond Xu wrote: > I did some backlog grooming; putting flaky tests by class in subtasks the= re > in > https://issues.apache.org/jira/browse/HUDI-1248 > > If you're working on any of those, please set the assignee. Let's > parallelize the efforts :) > > Also, the Azure CI builds for master/release versions can be found here > > https://dev.azure.com/apache-hudi-ci-org/apache-hudi-ci/_build?definition= Id=3D3&_a=3Dsummary > > Looks like some flakiness only happened in Travis CI. Let's also keep > observing how it goes in Azure. > > On Wed, Jun 23, 2021 at 12:48 PM Vinoth Chandar wrote= : > > > yes. CI is pretty flaky atm. There is a compiled list here > > https://issues.apache.org/jira/browse/HUDI-1248 > > > > Siva and I are looking into some of this and try and get everything bac= k > to > > normal again > > > > That schema evolution test, I have tried reproducing a few times, witho= ut > > luck. :/ > > > > On Wed, Jun 23, 2021 at 10:17 AM Prashant Wason > > > wrote: > > > > > Sure. I will take a look today. I wonder how the CI passed during the > > > merge. > > > > > > > > > On Wed, Jun 23, 2021 at 7:57 AM pzwpzw > .invalid> > > > wrote: > > > > > > > Hi @Prashant Wason, I found that after the [HUDI-1717]( commit hash= : > > > > 11e64b2db0ddf8f816561f8442b373de15a26d71) has merged yesterday=EF= =BC=8C the > > test > > > > case TestHoodieBackedMetadata#testOnlyValidPartitionsAdded will > always > > > > crash: > > > > > > > > org.apache.hudi.exception.HoodieMetadataException: Failed to retrie= ve > > > > files in partition > > > > > > > > > > /var/folders/my/841b2c052038ppns0csrf8g80000gn/T/junit3095347769583879437= /dataset/p1 > > > > from metadata > > > > > > > > at > > > > > > > > > > org.apache.hudi.metadata.BaseTableMetadata.getAllFilesInPartition(BaseTab= leMetadata.java:129) > > > > at > > > > > > > > > > org.apache.hudi.metadata.TestHoodieBackedMetadata.testOnlyValidPartitions= Added(TestHoodieBackedMetadata.java:210) > > > > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > > > > at > > > > > > > > > > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java= :62) > > > > at > > > > > > > > > > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorI= mpl.java:43) > > > > at java.lang.reflect.Method.invoke(Method.java:498) > > > > > > > > Can you take a look at this, Thanks~ > > > > > > > > > > > > > > > > 2021=E5=B9=B46=E6=9C=8823=E6=97=A5 =E4=B8=8B=E5=8D=881:49=EF=BC=8CD= anny Chan =E5=86=99=E9=81=93=EF=BC=9A > > > > > > > > Hi, fellows, there are two test cases in the travis CI that fails > very > > > > often, which blocks our coding too many times, please, if these tes= ts > > are > > > > not stable, can we disable them first ? > > > > They are annoying ~ > > > > > > > > > > > > TestHoodieBackedMetadata.testOnlyValidPartitionsAdded[1] > > > > HoodieSparkSqlWriterSuite: schema evolution for ... [2] > > > > > > > > [1] https://travis-ci.com/github/apache/hudi/jobs/518067391 > > > > [2] https://travis-ci.com/github/apache/hudi/jobs/518067393 > > > > > > > > Best, > > > > Danny Chan > > > > > > > > > > > > > > --000000000000c989fd05c602d56d--