Return-Path: X-Original-To: apmail-manifoldcf-commits-archive@www.apache.org Delivered-To: apmail-manifoldcf-commits-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 4825010972 for ; Mon, 5 Jan 2015 19:47:59 +0000 (UTC) Received: (qmail 14681 invoked by uid 500); 5 Jan 2015 19:48:00 -0000 Delivered-To: apmail-manifoldcf-commits-archive@manifoldcf.apache.org Received: (qmail 14631 invoked by uid 500); 5 Jan 2015 19:48:00 -0000 Mailing-List: contact commits-help@manifoldcf.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@manifoldcf.apache.org Delivered-To: mailing list commits@manifoldcf.apache.org Received: (qmail 14621 invoked by uid 99); 5 Jan 2015 19:48:00 -0000 Received: from eris.apache.org (HELO hades.apache.org) (140.211.11.105) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 05 Jan 2015 19:48:00 +0000 Received: from hades.apache.org (localhost [127.0.0.1]) by hades.apache.org (ASF Mail Server at hades.apache.org) with ESMTP id A7630AC0043; Mon, 5 Jan 2015 19:47:56 +0000 (UTC) Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Subject: svn commit: r1649628 - in /manifoldcf/trunk: ./ site/src/documentation/content/xdocs/en_US/ site/src/documentation/resources/images/en_US/ Date: Mon, 05 Jan 2015 19:47:54 -0000 To: commits@manifoldcf.apache.org From: kwright@apache.org X-Mailer: svnmailer-1.0.9 Message-Id: <20150105194758.A7630AC0043@hades.apache.org> Author: kwright Date: Mon Jan 5 19:47:54 2015 New Revision: 1649628 URL: http://svn.apache.org/r1649628 Log: Fix for CONNECTORS-1136. Added: manifoldcf/trunk/site/src/documentation/resources/images/en_US/metadataadjuster-job-expressions-metadata.PNG (with props) Removed: manifoldcf/trunk/site/src/documentation/resources/images/en_US/metadataadjuster-job-add-metadata.PNG manifoldcf/trunk/site/src/documentation/resources/images/en_US/metadataadjuster-job-move-metadata.PNG Modified: manifoldcf/trunk/CHANGES.txt manifoldcf/trunk/site/src/documentation/content/xdocs/en_US/end-user-documentation.xml Modified: manifoldcf/trunk/CHANGES.txt URL: http://svn.apache.org/viewvc/manifoldcf/trunk/CHANGES.txt?rev=1649628&r1=1649627&r2=1649628&view=diff ============================================================================== --- manifoldcf/trunk/CHANGES.txt (original) +++ manifoldcf/trunk/CHANGES.txt Mon Jan 5 19:47:54 2015 @@ -3,6 +3,10 @@ $Id$ ======================= 2.1-dev ===================== +CONNECTORS-1136: Update the user documentation to account for +changes in the metadata adjuster transformer. +(Karl Wright) + CONNECTORS-1134: Revamp metadata adjuster transformer to handle arbitrary combination expressions across multiple fields. This replaces the "move" and "add" paradigm with a more general Modified: manifoldcf/trunk/site/src/documentation/content/xdocs/en_US/end-user-documentation.xml URL: http://svn.apache.org/viewvc/manifoldcf/trunk/site/src/documentation/content/xdocs/en_US/end-user-documentation.xml?rev=1649628&r1=1649627&r2=1649628&view=diff ============================================================================== --- manifoldcf/trunk/site/src/documentation/content/xdocs/en_US/end-user-documentation.xml (original) +++ manifoldcf/trunk/site/src/documentation/content/xdocs/en_US/end-user-documentation.xml Mon Jan 5 19:47:54 2015 @@ -994,27 +994,31 @@ curl -XGET http://localhost:9200/index/_
Metadata Adjuster -

The Metadata Adjuster transformation filter optionally changes the name of incoming metadata, and then optionally adds additional metadata values. +

The Metadata Adjuster transformation filter reorganizes and concatenates metadata based on rules that you provide. This can be very helpful in many contexts. For example, you might use the Metadata Adjuster to label all documents from a particular job with a particular tag in an index. Or, you might need to map metadata from (say) SharePoint's schema to your final output connection type's schema. The Metadata Adjuster permits you to handle both of the scenarios.

As with all document transformers, more than one Metadata Adjuster transformation filter can be used in a single pipeline. This may be useful if other document transformers (such as the Tika Content Extractor, below) change the metadata of the document being processed.

The Metadata Adjuster transformation connection type does not require anything other than standard configuration information.

-

The Metadata Adjuster transformation connection type contributes two tabs to a job definition. These are "Move metadata" and "Add metadata" - tabs. The "Move metadata" tab looks like this:

+

The Metadata Adjuster transformation connection type contributes one tab to a job definition. This is the "Metadata expressions" tab. + The "Metadata expressions" tab looks like this:



-
+


-

Enter a input metadata name, and a target metadata name, and click the "Add" button to add the mapping to the list. Uncheck the "Keep all metadata" +

On the left, you must supply the target metadata name. You may then choose among two possibilities: either you choose to request that this metadata + field be removed from the target document, or you can choose to specify a rule that would provide a value for that target metadata item. You can + provide more than one rule for the same metadata item, by simply adding additional lines to the table with the same target metadata name. But if you specify + a rule to remove the metadata field from the document, that selection overrides all others.

+

Metadata rules are just strings, which may have field specifications within them. For example, the rule value "hello" will generate a single-valued metadata + field with the value "hello". The rule "hello ${there}", on the other hand, will generate a value for each value in the incoming field named "there". If the incoming + field had the values "a", "b", and "c", then the rule would generate a three-valued field with values "hello a", "hello b", and "hello c". If more than one incoming + field is specified, then a combinatoric combination of the field values will be produced.

+

Enter a parameter name, and either select to remove the value or provide an expression. If you chose to supply an expression, enter the expression in the box. + Then, click the "Add" button.

+

When your expressions have been edited, you can uncheck the "Keep all metadata" checkbox in order to prevent unspecified metadata fields from being passed through. Uncheck the "Remove empty metadata values" checkbox if you want to index empty metadata values.

-

The "Add metadata" tab looks like this:

-

-
-

-

Enter a parameter name and a value, and then click the "Add" button to add the new metadata field and value to the list. You may add more than - one value with the same field name.

Added: manifoldcf/trunk/site/src/documentation/resources/images/en_US/metadataadjuster-job-expressions-metadata.PNG URL: http://svn.apache.org/viewvc/manifoldcf/trunk/site/src/documentation/resources/images/en_US/metadataadjuster-job-expressions-metadata.PNG?rev=1649628&view=auto ============================================================================== Binary file - no diff available. Propchange: manifoldcf/trunk/site/src/documentation/resources/images/en_US/metadataadjuster-job-expressions-metadata.PNG ------------------------------------------------------------------------------ svn:mime-type = application/octet-stream