From dev-return-17857-archive-asf-public=cust-asf.ponee.io@manifoldcf.apache.org Wed Mar 14 20:15:58 2018 Return-Path: X-Original-To: archive-asf-public@cust-asf.ponee.io Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by mx-eu-01.ponee.io (Postfix) with SMTP id ADB8B180654 for ; Wed, 14 Mar 2018 20:15:57 +0100 (CET) Received: (qmail 79151 invoked by uid 500); 14 Mar 2018 19:15:56 -0000 Mailing-List: contact dev-help@manifoldcf.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@manifoldcf.apache.org Delivered-To: mailing list dev@manifoldcf.apache.org Received: (qmail 79129 invoked by uid 99); 14 Mar 2018 19:15:55 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd2-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 14 Mar 2018 19:15:55 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd2-us-west.apache.org (ASF Mail Server at spamd2-us-west.apache.org) with ESMTP id 5BA091A024F for ; Wed, 14 Mar 2018 19:15:55 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd2-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 1.879 X-Spam-Level: * X-Spam-Status: No, score=1.879 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, HTML_MESSAGE=2, RCVD_IN_DNSWL_NONE=-0.0001, RCVD_IN_MSPIKE_H3=-0.01, RCVD_IN_MSPIKE_WL=-0.01, SPF_PASS=-0.001] autolearn=disabled Authentication-Results: spamd2-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com Received: from mx1-lw-eu.apache.org ([10.40.0.8]) by localhost (spamd2-us-west.apache.org [10.40.0.9]) (amavisd-new, port 10024) with ESMTP id yG_ZEfdSWqJR for ; Wed, 14 Mar 2018 19:15:53 +0000 (UTC) Received: from mail-ot0-f179.google.com (mail-ot0-f179.google.com [74.125.82.179]) by mx1-lw-eu.apache.org (ASF Mail Server at mx1-lw-eu.apache.org) with ESMTPS id 3B9E15F178 for ; Wed, 14 Mar 2018 19:15:52 +0000 (UTC) Received: by mail-ot0-f179.google.com with SMTP id 79-v6so4376681oth.11 for ; Wed, 14 Mar 2018 12:15:52 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :cc; bh=j9a/ruEgi9vnsQL5H1cRFQAWl5nl3nACJKvqmhyhpyc=; b=Vxm0F54VufL34uNlKzf9LxSeupGOxTYniKFiKrjAWkyrQOckkbIdAUudnInc3QCLma boYEsA0XQEiix78f9ME5uVvWXHBYq1QC5uUUjRB6qcwBSBHpgDsLYdbgoXiia7JJ0diR 5Aw+6WoK4WiiQo3PIHNKTtd5GFBglyHnRyKuvM0quDEpjcehQY3oi/CzB6KvZ+OA+jRv kAlc91lxfY+CrKjUDu1VfcmTTIQ0V8EA9Nw1kF/rXXtPGLM/++P1CHOkB7n7LnGQFoqP yMbX6Us1uFN59Ilfobk9Picy7gxhc0cjZdqN7j7dazu0QUWXwamG8tP6OkEkvFSf1wNL Oybg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to:cc; bh=j9a/ruEgi9vnsQL5H1cRFQAWl5nl3nACJKvqmhyhpyc=; b=Cfi1z6QLva5CyXTfOQbUOwFSRtkXEd8CgF6o3iPvB+Nd/pyRqP79YCAUn5rAh6ERbT DizuiAvzeEoG/mvilcwSVGRGMCMT/znYzsfT5/i/qoKIfdVmeBFSAifqwSy++9HY2cJ+ lvrtKlN/uEyUi5kzbMbRJWkPO7sloLgPHkUBmz+gKqRzrkYvu/mo5U5jRQ5adfvI2paR fPVYqow/Pj4T0jQuqv0yu2zBgIbJAkeGNrGqFuTLv4+4fEdpTbY65GXdccSqZ+ToQzDj aRYMXxOEVviztCPQ08GsI7SzZSF0ayuURF4BBYw5OLTHYtGfsHaT6MBwhwZyOsoJKaIZ Ll0A== X-Gm-Message-State: AElRT7GjxM2BzakR/eUT9Ty/5c/+I8EXMrKWcEJQz0akGlZ77cuyD/EA HLOml+emCDb3OflzULVpLN1D6avVryo8Fx8kc9PRzw== X-Google-Smtp-Source: AG47ELsi/d6EF3bF59LAfeE3SEGd3DkgxsiFpJd4QnPWYIuTNQRPz7WdXcI3di1TzKA61wLFPwB7wUmJ8SziNw0PVPw= X-Received: by 10.157.86.186 with SMTP id o55mr287873oth.94.1521054950559; Wed, 14 Mar 2018 12:15:50 -0700 (PDT) MIME-Version: 1.0 Received: by 10.74.110.208 with HTTP; Wed, 14 Mar 2018 12:15:50 -0700 (PDT) In-Reply-To: References: From: Irindu Nugawela Date: Thu, 15 Mar 2018 00:45:50 +0530 Message-ID: Subject: Re: GSOC 2018: MongoDB Output Connector To: dev@manifoldcf.apache.org Cc: Piergiorgio Lucidi Content-Type: multipart/alternative; boundary="94eb2c0e71fc0327bd0567643474" --94eb2c0e71fc0327bd0567643474 Content-Type: text/plain; charset="UTF-8" Hi All, I was able to successfully build ManifoldCF with IntelliJ Idea as well. I have gone through MongoDB - Java and identified the MongoDB parameters as follows 1. MongoCredential by a useraname and a password 2. MongoDatabase 3. collection I am planning to have a single username and a password for a Manifold-MongoDB connection I have identified the operations that we are going to support as 1. Inserting documents 2. Querying documents 3. Updating documents 4. Deleting documents 5. Indexing documents based on a particular field I have also studied the document format we are going to store available here which MongoDB accepts in BSON format, I have identified the following fields 1. binaryFieldData 2. binaryLength 3. fileName 4. contentMimeType 5. createdDate 6. modifiedDate 7. indexingDate 8. originalSize of a Repository Document that I am going to convert to BSON format to write to MongoDB Please tell me am I on the correct path, and correct me if I am wrong On 27 February 2018 at 15:42, Piergiorgio Lucidi wrote: > Hi Irindu, > > > > 2018-02-25 13:53 GMT+01:00 Irindu Nugawela : > > > Hi All, > > I am currently to working on the $subject. I have some issues that I > need > > to clarify. > > First of all, why did we choose Mongo DB as an output target? My first > > thought of the project was that it was about writing a repository > connector > > for MongoDB because MongoDB is a database programme. ( I am aware of its > > NoSQL > > architecture and its indexing capabilities ). But it is not a search > engine > > per se. > > > > We want to extend the scenario of ManifoldCF and we would like to add > content migration capability. > Imagine to have a tool that helps you not only for the indexing process but > also in migrating contents. > > In this way you could migrate contents from a content repository to another > one, for example you could migrate contents from Alfresco to MongoDB. > > > > > > Then what are the expected operations other than document addition and > > deletion? (what activities should be supported?) > > > > The excepted operation are the same but related to migrate contents and not > related only to manage the indexing process. > > > > > > What capabilities of MongoDB you have already identified that you expect > to > > be useful for us. (what capabilities of MongoDB you have identified as > > useful That you've decided to write an Output connector for it.) > > > > Currently we only have a repository connector for GridFS that allow us to > read binaries from MongoDB. > We also want to store contents against a MongoDB instance, in this way we > can migrate contents on MongoDB from any repository with metadata and > binaries. > > I think it could be very cool :) > > In the enterprise context is very critical to migrate contents / documents > from different kind of repositories and typically it is the first step for > a digital transformation project where a company is trying to orchestrate > different silos in a smart way. > > Please let me know if you need more informations. > Thanks. > > Cheers, > PJ > > > > > > I have been through the ManifoldCF Architecture with DaddyWri > > /manifoldcfinaction Chapter1. > > > > -- > > Thanks and Regards, > > Irindu Nugawela, > > Computer Engineering Undergraduate, > > Faculty of Engineering University of Peradeniya > > > > > source=link&utm_campaign=sig-email&utm_content=webmail&utm_term=icon> > > Virus-free. > > www.avast.com > > > source=link&utm_campaign=sig-email&utm_content=webmail&utm_term=link> > > <#DAB4FAD8-2DD7-40BB-A1B8-4E2AA1F9FDF2> > > > > > > -- > Piergiorgio Lucidi > https://www.open4dev.com > -- Thanks and Regards, Irindu Nugawela, Computer Engineering Undergraduate, Faculty of Engineering University of Peradeniya --94eb2c0e71fc0327bd0567643474--