Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id 11197200D0A for ; Wed, 20 Sep 2017 04:07:07 +0200 (CEST) Received: by cust-asf.ponee.io (Postfix) id 0F5ED1609E0; Wed, 20 Sep 2017 02:07:07 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id 2D9E41609DD for ; Wed, 20 Sep 2017 04:07:06 +0200 (CEST) Received: (qmail 82088 invoked by uid 500); 20 Sep 2017 02:07:04 -0000 Mailing-List: contact solr-user-help@lucene.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: solr-user@lucene.apache.org Delivered-To: mailing list solr-user@lucene.apache.org Received: (qmail 81633 invoked by uid 99); 20 Sep 2017 02:07:04 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd2-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 20 Sep 2017 02:07:04 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd2-us-west.apache.org (ASF Mail Server at spamd2-us-west.apache.org) with ESMTP id 902E21A4A9B for ; Wed, 20 Sep 2017 02:07:03 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd2-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 4.579 X-Spam-Level: **** X-Spam-Status: No, score=4.579 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, HTML_MESSAGE=2, KAM_LINEPADDING=1.2, KAM_LIVE=1, RCVD_IN_DNSWL_NONE=-0.0001, RCVD_IN_MSPIKE_H3=-0.01, RCVD_IN_MSPIKE_WL=-0.01, RCVD_IN_SORBS_SPAM=0.5, SPF_PASS=-0.001] autolearn=disabled Authentication-Results: spamd2-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com Received: from mx1-lw-eu.apache.org ([10.40.0.8]) by localhost (spamd2-us-west.apache.org [10.40.0.9]) (amavisd-new, port 10024) with ESMTP id v7DCM6KlKzmX for ; Wed, 20 Sep 2017 02:06:59 +0000 (UTC) Received: from mail-lf0-f50.google.com (mail-lf0-f50.google.com [209.85.215.50]) by mx1-lw-eu.apache.org (ASF Mail Server at mx1-lw-eu.apache.org) with ESMTPS id 640335F640 for ; Wed, 20 Sep 2017 02:06:59 +0000 (UTC) Received: by mail-lf0-f50.google.com with SMTP id m199so1315246lfe.3 for ; Tue, 19 Sep 2017 19:06:59 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:in-reply-to:references:from:date:message-id:subject:to; bh=zGrgJUHwiVAaba+xo/PdHsNN2KhiXNZPAws5LbV1a20=; b=jX64cGJJCrV4Rw6nrNHcGI3XLd2xQFsWEMl6rVvu7fzn/vP+MidzpAYAyFTqfzExtx f2jKzjOVjTyoRahQn2s2uCiDrqCRqxadkGRCrHs+CNKQtK/DmdyRoW+dJJCIST2U7md5 WhABnfCm/cs4+C3DP4E5I38KjLFNI2zOxirOsvfgnm2Xe2bcnFTnxch8tEItz43MtOKb FSc0YfWKUDdGHEQWk+r+kMuozYr1/F8V58Se9arN3fCsOhitslTi02+H740fkmvrtwEM A71TeQD4up6eRhJFhE8swWt0ySjz64qMWu5N2p/q6uFKNc+DNFkEfyRBNaFZBQUcC6vr oBXw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to; bh=zGrgJUHwiVAaba+xo/PdHsNN2KhiXNZPAws5LbV1a20=; b=UfgoL6EVQe1ufPTbANvpVmEgT/NmsyMHaHoBBF+km13zZhrPws0bkeFl0/CnZXQDNR CH+o0pJ3Nlf9FimBa1mZyJXxe+zcM8csnB6nJg3jlfNm3WvHUiiNOFHSfa9YrbzSc1ux MmzpKQieYUSfuVenuRJPO6E/3fN8ym6I/4Q3loDDptJkQWodpyjbC39mXjWMqj/+1Bky R1Rvi9wZElzR/7GxVGm1YyfVMTro7DDJgkNeJaT1Ml24zSsxXL30UiKJ+iAfw8EGO8WO 7IuQFP7NMd7BK3KitlWaOwZ5xsfb6Z9RN4IQEmuoFpHCRQuS0WC8VRfkTV/TFKQS4qu2 th6w== X-Gm-Message-State: AHPjjUhY7nuHnGphQR9bR9dNQk2TCKfos3/XL5BEdLaMcZP0hKPJ0uEr ieP5Kt6KclKeppusTY3jX+qz4QYBhXyUXlszSnE= X-Google-Smtp-Source: AOwi7QD9bIcozeuwjJzHwY8KystbWVOrqATf/MEp9vzpxPRQMg+Ezv3UX4RPVrr0uLaYrGK+bR7tpe4AX3APkz+hOjU= X-Received: by 10.25.160.137 with SMTP id j131mr172997lfe.218.1505873218631; Tue, 19 Sep 2017 19:06:58 -0700 (PDT) MIME-Version: 1.0 Received: by 10.46.88.19 with HTTP; Tue, 19 Sep 2017 19:06:58 -0700 (PDT) In-Reply-To: References: From: Joel Bernstein Date: Tue, 19 Sep 2017 22:06:58 -0400 Message-ID: Subject: Re: Solr Streaming Question To: solr-user@lucene.apache.org Content-Type: multipart/alternative; boundary="001a11410ba045fb450559956e95" archived-at: Wed, 20 Sep 2017 02:07:07 -0000 --001a11410ba045fb450559956e95 Content-Type: text/plain; charset="UTF-8" Also random() will work with any type of field. Only the /export handler limits the field list to docValues. Each time you call random() it will give you a different random sample. Joel Bernstein http://joelsolr.blogspot.com/ On Tue, Sep 19, 2017 at 10:04 PM, Joel Bernstein wrote: > Try this construct: > > update(list(random(...), random(...), random(...))) > > > > > > > > Joel Bernstein > http://joelsolr.blogspot.com/ > > On Tue, Sep 19, 2017 at 9:02 PM, Susheel Kumar > wrote: > >> You can follow the sectionCreating an Alert With the Topic Streaming >> Expression" at http://joelsolr.blogspot.com/ and use random function for >> getting random records and schedule using daemon function to retrieve >> periodically etc. >> >> Thanks, >> Susheel >> >> >> >> On Tue, Sep 19, 2017 at 4:56 PM, Erick Erickson >> wrote: >> >> > Webster: >> > >> > I think you're looking for UpdateStream. Unfortunately the fix version >> > wasn't entered so you'll have to look at your particular version but >> > going strictly from the dates it appears in 6.0. >> > >> > David: >> > >> > Stored is irrelevant. Streaming only works with docValues="true" >> > fields and moves the docValues content over. >> > >> > Best, >> > Erick >> > >> > On Tue, Sep 19, 2017 at 12:39 PM, David Hastings >> > wrote: >> > > I am also curious about this, specifically about indexed/non stored >> > fields. >> > > >> > > On Tue, Sep 19, 2017 at 3:33 PM, Webster Homer < >> webster.homer@sial.com> >> > > wrote: >> > > >> > >> Is it possible to use the streaming API to stream documents from a >> > >> collection and load them into a new collection? I was thinking that >> this >> > >> would be a great way to get a random sample of data from our main >> > >> collections to developer machines. Making it a random sample would be >> > >> useful as well. This looks feasible, but I've only scratched the >> > surface of >> > >> streaming Solr >> > >> >> > >> Thanks >> > >> >> > >> -- >> > >> >> > >> >> > >> This message and any attachment are confidential and may be >> privileged >> > or >> > >> otherwise protected from disclosure. If you are not the intended >> > recipient, >> > >> you must not copy this message or attachment or disclose the >> contents to >> > >> any other person. If you have received this transmission in error, >> > please >> > >> notify the sender immediately and delete the message and any >> attachment >> > >> from your system. Merck KGaA, Darmstadt, Germany and any of its >> > >> subsidiaries do not accept liability for any omissions or errors in >> this >> > >> message which may arise as a result of E-Mail-transmission or for >> > damages >> > >> resulting from any unauthorized changes of the content of this >> message >> > and >> > >> any attachment thereto. Merck KGaA, Darmstadt, Germany and any of its >> > >> subsidiaries do not guarantee that this message is free of viruses >> and >> > does >> > >> not accept liability for any damages caused by any virus transmitted >> > >> therewith. >> > >> >> > >> Click http://www.emdgroup.com/disclaimer to access the German, >> French, >> > >> Spanish and Portuguese versions of this disclaimer. >> > >> >> > >> > > --001a11410ba045fb450559956e95--