Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id DB2B52009F3 for ; Fri, 20 May 2016 14:20:20 +0200 (CEST) Received: by cust-asf.ponee.io (Postfix) id D9C23160A0E; Fri, 20 May 2016 12:20:20 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id 2E5691609AF for ; Fri, 20 May 2016 14:20:20 +0200 (CEST) Received: (qmail 4700 invoked by uid 500); 20 May 2016 12:20:19 -0000 Mailing-List: contact user-help@manifoldcf.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@manifoldcf.apache.org Delivered-To: mailing list user@manifoldcf.apache.org Received: (qmail 4690 invoked by uid 99); 20 May 2016 12:20:19 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd2-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 20 May 2016 12:20:19 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd2-us-west.apache.org (ASF Mail Server at spamd2-us-west.apache.org) with ESMTP id EA6CC1A1122 for ; Fri, 20 May 2016 12:20:18 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd2-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: -0.721 X-Spam-Level: X-Spam-Status: No, score=-0.721 tagged_above=-999 required=6.31 tests=[RCVD_IN_DNSWL_LOW=-0.7, RCVD_IN_MSPIKE_H3=-0.01, RCVD_IN_MSPIKE_WL=-0.01, SPF_PASS=-0.001] autolearn=disabled Received: from mx1-lw-us.apache.org ([10.40.0.8]) by localhost (spamd2-us-west.apache.org [10.40.0.9]) (amavisd-new, port 10024) with ESMTP id T9N82KhH3lEb for ; Fri, 20 May 2016 12:20:16 +0000 (UTC) Received: from 3.mo6.mail-out.ovh.net (3.mo6.mail-out.ovh.net [178.33.253.26]) by mx1-lw-us.apache.org (ASF Mail Server at mx1-lw-us.apache.org) with ESMTPS id 1F2A65F298 for ; Fri, 20 May 2016 12:20:15 +0000 (UTC) Received: from player738.ha.ovh.net (b7.ovh.net [213.186.33.57]) by mo6.mail-out.ovh.net (Postfix) with ESMTP id BC020FFCE87 for ; Fri, 20 May 2016 14:20:08 +0200 (CEST) Received: from [192.168.0.74] (35-144-190-109.dsl.ovh.fr [109.190.144.35]) (Authenticated sender: julien.massiera@francelabs.com) by player738.ha.ovh.net (Postfix) with ESMTPSA id 736632CD for ; Fri, 20 May 2016 14:20:08 +0200 (CEST) From: Julien Massiera Subject: Re: Multiple output documents from one input document in transformation connector To: user@manifoldcf.apache.org References: <5672733999105090945@unknownmsgid> Message-ID: <573F00F0.7060806@francelabs.com> Date: Fri, 20 May 2016 14:20:00 +0200 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:38.0) Gecko/20100101 Thunderbird/38.7.2 MIME-Version: 1.0 In-Reply-To: <5672733999105090945@unknownmsgid> Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: 7bit X-Ovh-Tracer-Id: 69805796223535352 X-VR-SPAMSTATE: OK X-VR-SPAMSCORE: 0 X-VR-SPAMCAUSE: gggruggvucftvghtrhhoucdtuddrfeekledrfeeggdeglecutefuodetggdotefrodftvfcurfhrohhfihhlvgemucfqggfjnecuuegrihhlohhuthemuceftddtnecu archived-at: Fri, 20 May 2016 12:20:21 -0000 Thanks for the answer Karl. So I tried and have created a TransformationConnector, extending the BaseTransformationConnector and overriding the addOrReplaceWithException method. In this method I have two calls to activities.sendDocument(), one for the incoming document and another for a fresh new one (not a duplicate of the first). The problem is that when it comes to the second call, the following exception is thrown : "java.lang.IllegalStateException: Document cannot have multiple dispositions". It seems like a transformation connector can only output 1 doc but no more. Am I missing something ? Julien On 19/05/2016 21:14, Karl Wright wrote: > This sounds like it would work. > Karl > > Sent from my Windows Phone > From: Julien Massiera > Sent: 5/19/2016 12:44 PM > To:user@manifoldcf.apache.org > Subject: Multiple output documents from one input document in > transformation connector > Hi ManifoldCF community, > > here is my problem : I would like to crawl '.pst' documents with > ManifoldCF and index each email within them into a Solr instance. > I'm thinking to crawl the '.pst' files with a FileSystem repository > connection and then use my custom Transformation connection to extract > the emails and send them for Solr ingestion through the activities object. > > Is my approach correct ? or do I need to consider another solution ? > > Thanks for your help. > > Julien Massiera