Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id A24DE200D24 for ; Tue, 10 Oct 2017 01:59:05 +0200 (CEST) Received: by cust-asf.ponee.io (Postfix) id A0C561609E0; Mon, 9 Oct 2017 23:59:05 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id E630F1609CE for ; Tue, 10 Oct 2017 01:59:04 +0200 (CEST) Received: (qmail 94575 invoked by uid 500); 9 Oct 2017 23:59:03 -0000 Mailing-List: contact dev-help@lucene.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@lucene.apache.org Delivered-To: mailing list dev@lucene.apache.org Received: (qmail 94565 invoked by uid 99); 9 Oct 2017 23:59:03 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd1-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 09 Oct 2017 23:59:03 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd1-us-west.apache.org (ASF Mail Server at spamd1-us-west.apache.org) with ESMTP id CB3A1D6EEC for ; Mon, 9 Oct 2017 23:59:02 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd1-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: -99.202 X-Spam-Level: X-Spam-Status: No, score=-99.202 tagged_above=-999 required=6.31 tests=[KAM_ASCII_DIVIDERS=0.8, RP_MATCHES_RCVD=-0.001, SPF_PASS=-0.001, USER_IN_WHITELIST=-100] autolearn=disabled Received: from mx1-lw-eu.apache.org ([10.40.0.8]) by localhost (spamd1-us-west.apache.org [10.40.0.7]) (amavisd-new, port 10024) with ESMTP id DRaZsEOtyGk1 for ; Mon, 9 Oct 2017 23:59:01 +0000 (UTC) Received: from mailrelay1-us-west.apache.org (mailrelay1-us-west.apache.org [209.188.14.139]) by mx1-lw-eu.apache.org (ASF Mail Server at mx1-lw-eu.apache.org) with ESMTP id 2D82A60D31 for ; Mon, 9 Oct 2017 23:59:01 +0000 (UTC) Received: from jira-lw-us.apache.org (unknown [207.244.88.139]) by mailrelay1-us-west.apache.org (ASF Mail Server at mailrelay1-us-west.apache.org) with ESMTP id 537FFE0EEF for ; Mon, 9 Oct 2017 23:59:00 +0000 (UTC) Received: from jira-lw-us.apache.org (localhost [127.0.0.1]) by jira-lw-us.apache.org (ASF Mail Server at jira-lw-us.apache.org) with ESMTP id 0D3442417D for ; Mon, 9 Oct 2017 23:59:00 +0000 (UTC) Date: Mon, 9 Oct 2017 23:59:00 +0000 (UTC) From: "ASF subversion and git services (JIRA)" To: dev@lucene.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Commented] (SOLR-10651) Streaming Expressions statistical functions library MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 archived-at: Mon, 09 Oct 2017 23:59:05 -0000 [ https://issues.apache.org/jira/browse/SOLR-10651?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16197907#comment-16197907 ] ASF subversion and git services commented on SOLR-10651: -------------------------------------------------------- Commit 3f7eef9d4bf07b64b04ec48719ec0df77f6d1051 in lucene-solr's branch refs/heads/branch_7_1 from [~joel.bernstein] [ https://git-wip-us.apache.org/repos/asf?p=lucene-solr.git;h=3f7eef9 ] SOLR-10651: binomialCoefficient Stream Evaluator to CHANGES.txt > Streaming Expressions statistical functions library > --------------------------------------------------- > > Key: SOLR-10651 > URL: https://issues.apache.org/jira/browse/SOLR-10651 > Project: Solr > Issue Type: New Feature > Security Level: Public(Default Security Level. Issues are Public) > Components: streaming expressions > Reporter: Joel Bernstein > > This is a ticket for organizing the new statistical programming features of Streaming Expressions. It's also a place for the community to discuss what functions are needed to support statistical programming. > Basic Syntax: > {code} > let(a = timeseries(...), > b = timeseries(...), > c = col(a, count(*)), > d = col(b, count(*)), > r = regress(c, d), > tuple(p = predict(r, 50))) > {code} > The expression above is doing the following: > 1) The let expression is setting variables (a, b, c, d, r). > 2) Variables *a* and *b* are the output of timeseries() Streaming Expressions. These will be stored in memory as lists of Tuples containing the time series results. > 3) Variables *c* and *d* are set using the *col* evaluator. The col evaluator extracts a column of numbers from a list of tuples. In the example *col* is extracting the count\(*\) field from the two time series result sets. > 4) Variable *r* is the output from the *regress* evaluator. The regress evaluator performs a simple regression analysis on two columns of numbers. > 5) Once the variables are set, a single Streaming Expression is run by the *let* expression. In the example the *tuple* expression is run. The tuple expression outputs a single Tuple with name/value pairs. Any Streaming Expression can be run by the *let* expression so this can be a complex program. The streaming expression run by *let* has access to all the variables defined earlier. > 6) The tuple expression in the example has one name / value pair. The name *p* is set to the output of the *predict* evaluator. The predict evaluator is predicting the value of a dependent variable based on the independent variable 50. The regression result stored in variable *r* is used to make the prediction. > 7) The output of this expression will be a single tuple with the value of the predict function in the *p* field. > The growing list of issues linked to this ticket are the array manipulation and statistical functions that will form the basis of the stats library. The vast majority of these functions are backed by algorithms in Apache Commons Math. Other machine learning and math libraries will follow. -- This message was sent by Atlassian JIRA (v6.4.14#64029) --------------------------------------------------------------------- To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org For additional commands, e-mail: dev-help@lucene.apache.org