From dev-return-22287-archive-asf-public=cust-asf.ponee.io@atlas.apache.org Mon Apr 9 21:58:20 2018 Return-Path: X-Original-To: archive-asf-public@cust-asf.ponee.io Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by mx-eu-01.ponee.io (Postfix) with SMTP id E0BBF180645 for ; Mon, 9 Apr 2018 21:58:19 +0200 (CEST) Received: (qmail 17787 invoked by uid 500); 9 Apr 2018 19:58:19 -0000 Mailing-List: contact dev-help@atlas.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@atlas.apache.org Delivered-To: mailing list dev@atlas.apache.org Delivered-To: moderator for dev@atlas.apache.org Received: (qmail 60116 invoked by uid 99); 9 Apr 2018 18:59:46 -0000 X-Virus-Scanned: Debian amavisd-new at spamd3-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 3.982 X-Spam-Level: *** X-Spam-Status: No, score=3.982 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, HTML_MESSAGE=2, KAM_BADIPHTTP=2, KAM_SHORT=0.001, RCVD_IN_DNSWL_NONE=-0.0001, RCVD_IN_MSPIKE_H3=-0.01, RCVD_IN_MSPIKE_WL=-0.01, WEIRD_PORT=0.001] autolearn=disabled Authentication-Results: spamd3-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=padovani-org.20150623.gappssmtp.com DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=padovani-org.20150623.gappssmtp.com; s=20150623; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :cc; bh=zHuLOFYgCn9l3vy14WVDnZpi9nP3nPGhapG0itpvRDc=; b=LbmkbvWi3+RFQI4f1ymhS7G/JZwNlbQ0eqYqytsphdN5b8MSaf9j0uc7mGZATXXjY1 wOF2lqp5uCpxmpmOULBY+Vrzy/tHbKYyCb9MlyHwMzBhxC92WuIJZ0spJoJfHuckiL1L 3FQ+y2pROe0nEfn0W03KaB1MoyTSzYH7QwXMMprrWbsRwYJb+ojVIw4QffjIfLNayz4h Jd/fA1TL3q1L/ZdnZpCljMLrQSWRp+/OwjX2kVdtiEf8da+S79fZqJGgGd5FagGA7euf x4NBCs/eFzvOkASvENTl98e6p1oNXxi1LCq02zNmvfez2h//biWCmaAq0/uP5tbTuJ6T ehtQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to:cc; bh=zHuLOFYgCn9l3vy14WVDnZpi9nP3nPGhapG0itpvRDc=; b=fdAXjuBWbMNrP7kvjxQNsbNpEOskn10Jho7riU4vjO8jJHjgl/e0loZb8MobL05zk1 59NCtJDigH++FeKSoPiUL1B2p4NHRRRnW+bFSjHCdpzRgOQLAt3f8agYe+80wk4trTu8 YFfII2XTp+KgeOMbgZDLvwVcXTi8LQknsk9VFceUXpDnaOxIUMKlPPqr+7+Y4QD8WAy0 N1hHf8sVgpS6Ru4Pg83XuzxPFVgkdhybZ3qqtAgf0VpXbnfgah2qnDoiZ9p7kbdX0i9L Iq5siy7A+Sg9XuDYcx2i3xZFdqQ2aZP9q1vBPrCSPEpQuZmX8PGcKw506kfVhkBti/TK iwkg== X-Gm-Message-State: ALQs6tBrvnIGw7rGP5RE3njn4WR2uiG0g+qvfWgZmmMQREOfMGT6HIts nOA7ZQnmzMfKxZbD/osiSrAUUuK3yImQFIgxUDYOag== X-Google-Smtp-Source: AIpwx486ETlV9lI6yKVYdBomoZFAjMHV8q2QLNEwX48OvyRjCNKuabMaE1nf+OHkWFtyImkrjmdgG9+QuE/jIOHI+eI= X-Received: by 10.200.42.37 with SMTP id k34mr55194345qtk.101.1523300382951; Mon, 09 Apr 2018 11:59:42 -0700 (PDT) MIME-Version: 1.0 In-Reply-To: References: <53918F9A-9FF8-4DB2-9362-1DAA4CB9FB83@hortonworks.com> From: Pierre Padovani Date: Mon, 9 Apr 2018 13:59:42 -0500 Message-ID: Subject: Re: Atlas Startup Failure with HBase Backend To: Ashutosh Mestry , nixon.rodrigues@freestoneinfotech.com Cc: "dev@atlas.apache.org" Content-Type: multipart/alternative; boundary="001a113962aa3662cc05696f028e" --001a113962aa3662cc05696f028e Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable I believe this may be environmental... this test works locally for me: Running org.apache.atlas.repository.audit.InMemoryAuditRepositoryTest Running org.apache.atlas.repository.audit.CassandraAuditRepositoryTest Running org.apache.atlas.repository.userprofile.UserProfileServiceTest Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 5.346 sec - in org.apache.atlas.repository.impexp.TypeAttributeDifferenceTest Running org.apache.atlas.repository.migration.RelationshipMappingTest Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.689 sec - in org.apache.atlas.repository.audit.InMemoryAuditRepositoryTest Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 6.748 sec - in org.apache.atlas.repository.impexp.ImportTransformsTest Running org.apache.atlas.repository.migration.HiveParititionTest Running org.apache.atlas.repository.migration.HiveStocksTest Running org.apache.atlas.repository.store.graph.v1.AtlasEntityStoreV1Test Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 28.732 sec - in org.apache.atlas.repository.audit.CassandraAuditRepositoryTest The class 'CassandraAuditRepositoryTest' has a hard coded sleep in place to allow the embedded Cassandra to startup. It is very likely that the box this is being run on is slow enough to cause the tests to fail. The quickest way to unblock this, would be to increase the sleep from 1 second to a greater value, say 5 seconds. I would recommend we do this to unblock the integration tests short term. Longer term, I'll change the test case to attempt to ping the Cassandra server during the setup method for a few times, and either exit with an error if it could not startup within a period of time, or after a certain number of tries. I created: https://issues.apache.org/jira/browse/ATLAS-254= 7 to track this issue. Pierre > On Mon, Apr 9, 2018 at 1:18 PM, Nixon Rodrigues < > nixon.rodrigues@freestoneinfotech.com> wrote: > >> Ashutosh, Pierre, >> >> Can you review below unit testcase, its failing in precommit jenkins job= . >> >> Tests run: 7, Failures: 1, Errors: 0, Skipped: 6, Time elapsed: 17.872 s= ec >> <<< FAILURE! - in org.apache.atlas.repository.au >> dit.CassandraAuditRepositoryTest >> setup(org.apache.atlas.repository.audit.CassandraAuditRepositoryTest) >> Time >> elapsed: 17.709 sec <<< FAILURE! >> org.apache.atlas.AtlasException: com.datastax.driver.core.excep >> tions.NoHostAvailableException: All host(s) tried for query failed >> (tried: >> localhost/127.0.0.1:9042(com.datastax.driver.core. >> exceptions.TransportException: >> [localhost/127.0.0.1:9042] Cannot connect)) >> at com.datastax.driver.core.ControlConnection.reconnectInternal >> (ControlConnection.java:233) >> at com.datastax.driver.core.ControlConnection.connect(ControlCo >> nnection.java:79) >> at com.datastax.driver.core.Cluster$Manager.init(Cluster. >> java:1483) >> at com.datastax.driver.core.Cluster.init(Cluster.java:159) >> at com.datastax.driver.core.Cluster.connectAsync(Cluster. >> java:330) >> at com.datastax.driver.core.Cluster.connectAsync(Cluster. >> java:305) >> at com.datastax.driver.core.Cluster.connect(Cluster.java:247) >> at org.apache.atlas.repository.audit.CassandraBasedAuditReposit >> ory.createSession(CassandraBasedAuditRepository.java:217) >> at org.apache.atlas.repository.audit.CassandraBasedAuditReposit >> ory.startInternal(CassandraBasedAuditRepository.java:208) >> at org.apache.atlas.repository.audit.CassandraBasedAuditReposit >> ory.start(CassandraBasedAuditRepository.java:196) >> at org.apache.atlas.repository.audit.CassandraAuditRepositoryTe >> st.setup(CassandraAuditRepositoryTest.java:48) >> >> On Mon, Apr 9, 2018, 11:40 PM Pierre Padovani >> wrote: >> >> > Hi Ashtosh, >> > >> > Good catch! This looks good to me. >> > >> > Thanks! >> > >> > Pierre >> > >> > On Mon, Apr 9, 2018 at 12:48 PM, Ashutosh Mestry < >> amestry@hortonworks.com> >> > wrote: >> > >> > > Hi >> > > >> > > >> > > >> > > Thanks for adding Cassandra support to Atlas. With this update, Atla= s >> > > fails on startup when used with *HBase* backend. >> > > >> > > >> > > >> > > Attached is the patch that addresses the problem. I verified it in a= n >> > > environment with *HBase* backend. I was not able to verify it with >> > > Cassandra as backend. Can you please review and let me know if the >> change >> > > is OK? Other things look fine, I think. >> > > >> > > >> > > >> > > Best regards, >> > > >> > > >> > > >> > > *~ ashutosh* >> > > >> > > *Ashutosh Mestry* * . Staff Software >> Engineer . >> > > Hortonworks, Inc. . +1-310-988 0670 <%2B1-310-988%200670>* >> > > >> > > ....... >> > > >> > > *No hurry, no pause. =E2=80=93 Tim Ferriss, Life Hacker, Author* >> > > >> > > >> > > >> > >> >> --001a113962aa3662cc05696f028e--