Return-Path: X-Original-To: apmail-spark-dev-archive@minotaur.apache.org Delivered-To: apmail-spark-dev-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id BECC818492 for ; Fri, 4 Mar 2016 15:07:13 +0000 (UTC) Received: (qmail 92474 invoked by uid 500); 4 Mar 2016 15:07:11 -0000 Delivered-To: apmail-spark-dev-archive@spark.apache.org Received: (qmail 92348 invoked by uid 500); 4 Mar 2016 15:07:11 -0000 Mailing-List: contact dev-help@spark.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Delivered-To: mailing list dev@spark.apache.org Received: (qmail 92337 invoked by uid 99); 4 Mar 2016 15:07:11 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd3-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 04 Mar 2016 15:07:11 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd3-us-west.apache.org (ASF Mail Server at spamd3-us-west.apache.org) with ESMTP id 6C0951806AD for ; Fri, 4 Mar 2016 15:07:10 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd3-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: -0.721 X-Spam-Level: X-Spam-Status: No, score=-0.721 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, RCVD_IN_DNSWL_LOW=-0.7, RCVD_IN_MSPIKE_H3=-0.01, RCVD_IN_MSPIKE_WL=-0.01, SPF_PASS=-0.001] autolearn=disabled Authentication-Results: spamd3-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=cloudera-com.20150623.gappssmtp.com Received: from mx1-lw-eu.apache.org ([10.40.0.8]) by localhost (spamd3-us-west.apache.org [10.40.0.10]) (amavisd-new, port 10024) with ESMTP id AZppnyp3qfwc for ; Fri, 4 Mar 2016 15:07:06 +0000 (UTC) Received: from mail-wm0-f41.google.com (mail-wm0-f41.google.com [74.125.82.41]) by mx1-lw-eu.apache.org (ASF Mail Server at mx1-lw-eu.apache.org) with ESMTPS id 6BABC5F3F4 for ; Fri, 4 Mar 2016 15:07:06 +0000 (UTC) Received: by mail-wm0-f41.google.com with SMTP id l68so32661795wml.1 for ; Fri, 04 Mar 2016 07:07:06 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=cloudera-com.20150623.gappssmtp.com; s=20150623; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :cc; bh=lHdVQY5GneIsCEo6SgKOaiocgjqAhdyDaWjuFO4mtU0=; b=AUgmjL0byCexJxcTw+rqBfPXmqo/b+LHKMFIR2fCyvVH2V2QAd5mj81eGCPJcTwADn FpVaL8dWiKs372njg8zoZMf7mGxKKVvdalQQGkHC59QqBmHNtQvVaxvXJrsisWrKPBlM 3mcoYi4FVEZdRkTJBS30VFvUmVz5SeGwZ+WCNafE2TjxcBAKEPVS9LBrKeD6uFyJNjC9 zqwd6dLmPQbhP9n9qlEsfbIpUPBO0EjUM7Jqo8BRXbAmZlfLCUip8zqk5JjVowonU5va X++O/1MBUC2pEiNKu+w08VBW3ucvPWiJ+fmCRukf7X6ojawgCENFvaHAnQNOolYYsRMU iiIg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to:cc; bh=lHdVQY5GneIsCEo6SgKOaiocgjqAhdyDaWjuFO4mtU0=; b=EJWrKVq448XwUOUqUB2TqfGDrSGnHg75lRfgJnbzU4iEXIvIxytGn22Y5pqcGoRbDA oGzOjH3nmXVbotOoARAny2gugVh/ya5vVi+sCfrCieHFhqnAc9P4Dgl5t/kFt6iK+xN+ nYWkjPOkGYaZ2Pu1GVZDD7ElxgupAa/1dk9aQics/YVOZ8c9KxvuwoGBLRG37FyC9i8K Gr/4vnf2o3d1NGZeifdyf0S9oX4FHYJQhC5r/8Tcjimw2VN9fLo+5bafNFXFvW6iP6Kt ABbmuzMMtYYZX0hzeDb/PkEgy4S5H7W7AqiECLNjGNFk1kCvV4uJKwG+ErhkzW3bsFNn mUtQ== X-Gm-Message-State: AD7BkJIW40CfopI5mb5eeRD1nsyO8uWpX12AkOJdlnjPBOovdbrzbizJ1JA5PL+GDbzhrzVaCb984uTf9TOqCEUi X-Received: by 10.194.227.1 with SMTP id rw1mr9256637wjc.62.1457104026077; Fri, 04 Mar 2016 07:07:06 -0800 (PST) MIME-Version: 1.0 Received: by 10.28.223.86 with HTTP; Fri, 4 Mar 2016 07:06:46 -0800 (PST) In-Reply-To: References: From: Sean Owen Date: Fri, 4 Mar 2016 15:06:46 +0000 Message-ID: Subject: Re: Set up a Coverity scan for Spark To: Ted Yu Cc: dev Content-Type: text/plain; charset=UTF-8 Hi Ted, I've already marked them. You should be able to see the ones marked "Fix Required" if you click through to the defects. Most are just bad form and probably have no impact. The few that looked reasonably important were: - using platform char encoding, not UTF-8 - Incorrect notify/wait - volatile count with non-atomic update - bad equals/hashCode On Fri, Mar 4, 2016 at 2:52 PM, Ted Yu wrote: > Last time I checked there wasn't high impact defects. > > Mind pointing out the defects you think should be fixed ? > > Thanks > > On Fri, Mar 4, 2016 at 4:35 AM, Sean Owen wrote: >> >> Yeah, it's not going to help with Scala, but it can at least find >> stuff in the Java code. I'm not suggesting anyone run it regularly, >> but one run to catch some bugs is useful. >> >> I've already triaged ~70 issues there just in the Java code, of which >> a handful are important. >> >> On Fri, Mar 4, 2016 at 12:18 PM, Ted Yu wrote: >> > Since majority of code is written in Scala which is not analyzed by >> > Coverity, the efficacy of the tool seems limited. >> > >> >> On Mar 4, 2016, at 2:34 AM, Sean Owen wrote: >> >> >> >> >> >> https://scan.coverity.com/projects/apache-spark-2f9d080d-401d-47bc-9dd1-7956c411fbb4?tab=overview >> >> >> >> This has to be run manually, and is Java-only, but the inspection >> >> results are pretty good. Anyone should be able to browse them, and let >> >> me know if anyone would like more access. >> >> Most are false-positives, but it's found some reasonable little bugs. >> >> >> >> When my stack of things to do clears I'll try to address them, but I >> >> bring it up as an FYI for anyone interested in static analysis. >> >> >> >> --------------------------------------------------------------------- >> >> To unsubscribe, e-mail: dev-unsubscribe@spark.apache.org >> >> For additional commands, e-mail: dev-help@spark.apache.org >> >> > > --------------------------------------------------------------------- To unsubscribe, e-mail: dev-unsubscribe@spark.apache.org For additional commands, e-mail: dev-help@spark.apache.org