Return-Path: X-Original-To: apmail-chemistry-dev-archive@www.apache.org Delivered-To: apmail-chemistry-dev-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 8A9B517A24 for ; Wed, 25 Mar 2015 15:07:32 +0000 (UTC) Received: (qmail 46902 invoked by uid 500); 25 Mar 2015 15:07:32 -0000 Delivered-To: apmail-chemistry-dev-archive@chemistry.apache.org Received: (qmail 46845 invoked by uid 500); 25 Mar 2015 15:07:32 -0000 Mailing-List: contact dev-help@chemistry.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@chemistry.apache.org Delivered-To: mailing list dev@chemistry.apache.org Received: (qmail 46833 invoked by uid 99); 25 Mar 2015 15:07:32 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 25 Mar 2015 15:07:32 +0000 X-ASF-Spam-Status: No, hits=1.5 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of costerwi@gmail.com designates 209.85.160.180 as permitted sender) Received: from [209.85.160.180] (HELO mail-yk0-f180.google.com) (209.85.160.180) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 25 Mar 2015 15:07:07 +0000 Received: by ykfs63 with SMTP id s63so14121503ykf.2 for ; Wed, 25 Mar 2015 08:06:20 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type; bh=MiDMiRcMMcj3+zT/5KB6gM9rIKgm0I2Nb2qVasRhdeE=; b=Z68/zPu2XTKsqBLBj/0AuuxV9kYXuzyl1ZfTA75HH4he/fpz2Um2663xp/TI+vGVaC /zGYULYNILlofeca3khAX75wre/YUXyXe5B32TJeuwwocgyA+TGJ4IQISbkbuXgiT2dK 9pK3kwEmqFj1QYa7cmMaey63rJdMi4/FKCiiDfJjv34IRV0rXg/QbP1gYZfOSm4vkn9O 3BERb+qyzLpFLi4o4wVI4ortk23x341m2Da/Oxdg+2hohIA1fM5Sm3ZvIDw9AaaeqFx6 Q4Oyx7ivq4a0X1HvEVT5iB6FlETazu+SrYZUqn8pkIASxl1YmxzdEmA92ZzNGz/b6dYU 61tg== MIME-Version: 1.0 X-Received: by 10.170.120.213 with SMTP id m204mr12093697ykb.30.1427295980486; Wed, 25 Mar 2015 08:06:20 -0700 (PDT) Received: by 10.170.181.73 with HTTP; Wed, 25 Mar 2015 08:06:20 -0700 (PDT) In-Reply-To: References: Date: Wed, 25 Mar 2015 11:06:20 -0400 Message-ID: Subject: Re: Python CMISlib 0.5.1 with large documents From: Carl Osterwisch To: dev@chemistry.apache.org Content-Type: multipart/alternative; boundary=001a1137bf8ee8190b05121e3d45 X-Virus-Checked: Checked by ClamAV on apache.org --001a1137bf8ee8190b05121e3d45 Content-Type: text/plain; charset=UTF-8 Thanks for the reply. I just added this as CMIS-904 . On Wed, Mar 25, 2015 at 10:26 AM, Jeff Potts wrote: > One thing that would help would be if the library implemented the > appendContentStream method available in CMIS 1.1. Unfortunately, it is not > in 0.6. > > Would you mind opening a Jira for this? > > Jeff > > On Wed, Mar 25, 2015 at 8:51 AM, Carl Osterwisch > wrote: > > > I'm getting a memory error when I call Folder.createDocument(), passing a > > contentFile of 120MB. Smaller files are uploading without trouble. > > > > Are there any tricks to stream the document so it doesn't need to consume > > as much memory? Does the unreleased CMISlib 0.6 address this issue? > > > > Thanks for any suggestions! > > -Carl > > > > File > > "C:\Anaconda\lib\site-packages\cmislib-0.5.1-py2.7.egg\cmislib\model.py", > > line 2756, in createDocument > > contentEncoding) > > File > > "C:\Anaconda\lib\site-packages\cmislib-0.5.1-py2.7.egg\cmislib\model.py", > > line 1185, in createDocument > > result = self._cmisClient.post(postUrl.encode('utf-8'), > > xmlDoc.toxml(encodin > > g='utf-8'), ATOM_XML_ENTRY_TYPE) > > File "C:\Anaconda\lib\xml\dom\minidom.py", line 46, in toxml > > return self.toprettyxml("", "", encoding) > > File "C:\Anaconda\lib\xml\dom\minidom.py", line 58, in toprettyxml > > self.writexml(writer, "", indent, newl, encoding) > > File "C:\Anaconda\lib\xml\dom\minidom.py", line 1749, in writexml > > node.writexml(writer, indent, addindent, newl) > > File "C:\Anaconda\lib\xml\dom\minidom.py", line 814, in writexml > > node.writexml(writer, indent+addindent, addindent, newl) > > File "C:\Anaconda\lib\xml\dom\minidom.py", line 814, in writexml > > node.writexml(writer, indent+addindent, addindent, newl) > > File "C:\Anaconda\lib\xml\dom\minidom.py", line 810, in writexml > > self.childNodes[0].writexml(writer, '', '', '') > > File "C:\Anaconda\lib\xml\dom\minidom.py", line 1038, in writexml > > _write_data(writer, "%s%s%s" % (indent, self.data, newl)) > > File "C:\Anaconda\lib\xml\dom\minidom.py", line 298, in _write_data > > writer.write(data) > > File "C:\Anaconda\lib\codecs.py", line 351, in write > > data, consumed = self.encode(object, self.errors) > > MemoryError > > > --001a1137bf8ee8190b05121e3d45--