Mailing-List: contact users-help@cxf.apache.org; run by ezmlm
Precedence: bulk
Reply-To: users@cxf.apache.org
Received-SPF: pass (athena.apache.org: domain of sberyozkin@gmail.com
 designates 209.85.214.41 as permitted sender)
DomainKey-Signature: a=rsa-sha1; c=nofws;
        d=gmail.com; s=gamma;
        h=mime-version:in-reply-to:references:date:message-id:subject:from:to
         :content-type;
        b=kY4A3z+20MgaJBlYj0C4y7B2EoVLFvtJrxOCaQ3fOTK2GIanbaL7h47bOxTmsBQREF
         NC0rJ+8C1Kx8O9JfDLkVkmzApKjldaGlDH00Ea0oQkCXO8+YBTjBFwuXJ0a11xzDynxF
         jhZB1L2EV+v4lmLNGqDj1sfk0pkgfkRth7b74=
MIME-Version: 1.0
In-Reply-To: <001f01cbb94c$415dcaf0$c41960d0$@com>
References: <001501cbb7c7$9a359990$cea0ccb0$@com>
	<AANLkTimW1jKEjG9pBeFOUiFsy6JbPpY0S6F+gEEtZaLX@mail.gmail.com>
	<002001cbb7cc$d688ebe0$839ac3a0$@com>
	<AANLkTi=40V7-rbhksvFDVno=xp=zsZwS_-vaartzajtc@mail.gmail.com>
	<002401cbb7d8$6b03ef30$410bcd90$@com>
	<AANLkTik8WdXP=0V+GndWbGpNN8wzOdSvxxrwWesuZW0i@mail.gmail.com>
	<002201cbb88c$3ba6f200$b2f4d600$@com>
	<AANLkTi=bxBPvVcKFR4=YK98ECE2cpcfpSUAn6uHOvCaB@mail.gmail.com>
	<001f01cbb94c$415dcaf0$c41960d0$@com>
Date: Sun, 23 Jan 2011 18:49:31 +0000
Message-ID: <AANLkTi=84UT0eDF=25vPVtbvQiCcALLM18uPdOkKR3ig@mail.gmail.com>
Subject: Re: JAX-RS Attachments size limit and temp folder
From: Sergey Beryozkin <sberyozkin@gmail.com>
To: users@cxf.apache.org
Content-Type: multipart/alternative; boundary=001636c5ac69941768049a87f1d7

--001636c5ac69941768049a87f1d7
Content-Type: text/plain; charset=ISO-8859-1
Content-Transfer-Encoding: quoted-printable

Hi Ivan

sorry for a delay

On Fri, Jan 21, 2011 at 9:19 AM, Ivan Vitoria Sanchez <ivitoria@grupoica.co=
m
> wrote:

> Hi Sergey,
>
> Could you tell me where i can find some example about how StaxSource work=
s?
> I'm not sure how can i use it in conjunction with JAXB...
>
> Me neither :-), Actually, I can see JAXBSource now exists :

http://download.oracle.com/javase/6/docs/api/javax/xml/bind/util/JAXBSource=
.html

However I'm not sure if returning a JAXBSource will make writing large
pieces of data more efficient.


> Anyway, let me know as soon as you optimize the SourceProvider :)
>

I will :-)

Cheers, Sergey

>
> Ivan
>
> -----Mensaje original-----
> De: Sergey Beryozkin [mailto:sberyozkin@gmail.com]
> Enviado el: jueves, 20 de enero de 2011 12:24
> Para: users@cxf.apache.org
> Asunto: Re: JAX-RS Attachments size limit and temp folder
>
> Hi Ivan
>
> On Thu, Jan 20, 2011 at 10:24 AM, Ivan Vitoria Sanchez <
> ivitoria@grupoica.com> wrote:
>
> > Hi Segey,
> >
> > Please see my comments below
> >
> > (I really appreciate your effort)
> >
> > Ivan
> >
>
>
> >
> > > Does it mean that i can not use these jax-rs properties to get a
> > generated
> > > JAXB XML with a Base64-encoded file via GET request?
> >
> >
> > You may need to experiment with different options here.
> >
> > 1. If you return a JAXB bean with the DataHandler then it looks like it
> can
> > definitely be XOP-packaged.
> > Just set an "mtom-enabled" JAX-RS property to "true" and have
> > @Produces("multipart/related").
> > Or is the consumer not capable of reading multiparts, is it a browser ?
> >
> > - Well, the client, which i'm developing too, is a Windows Mobile
> > application, so I think XOP isn't supported out-of-the-box by Compact
> > Framework 3.5 and I should develop a custom parser...
> >
> >
> I see...
>
>
> > 2. Return the big XML wrapped in the JAXP Source - it probably won't ma=
ke
> a
> > difference right now; Dan explained to me that the JAX-WS
> Provider<Source>
> > is optimized on the write side, so I will look into it and enhance the
> > JAX-RS SourceProvider accordingly.
> >
> > - isn't this like my scene? (do you remember the CXF-3022 bug?). what
> kind
> > of improvement would it be if you enhance the JAX-RS SourceProvider?
> >
> > In order to have the SourceProvider involved the method will need to ha=
ve
> a
> Source return type.
> I do not know right now. As far as I recall that if JAXP Source is return=
ed
> (as opposed to say StreamSource or DOMSource) then the JAX-WS runtime can
> opt for using a CXF StaxSource which makes it easier to stream, so the
> SourceProvider can do something similar. You may just want to experiment
> and
> explicitly return the CXF StaxSource,
>
> new StaxSource(StaxUtils.createXMLStreamReader(xmlInputStream));
>
>
> > 3. Return a link to the XML file on the disk and delegate to the
> underlying
> > container to serve the file to the consumer, you can configure the
> > CXFServlet to delegate to the default servlet for doing it...
> >
> > - I'm not sure if this is a good solution for me
> >
> > 4. Return several links to individual XML sections (kept in memory or o=
n
> > the
> > disk) - this could be one of the most efficient options for writing the
> > large attachments
> >
> > - Are you talking about splitting up a Base64 Encoded XML attachment?
> >
> >
> 3 and 4 are attempts to come with some alternative options. It all depend=
s
> on what sort of experience is provided to the users. I'm not sure right n=
ow
> what I'd do if I were to return a 50MB file. But I'd try to avoid writing
> it
> directly to the output stream representing the response to the current
> invocation. What those XML data represent, the list of records ? For
> example, I'd consider returning a fist section of the xml with the
> attribute
> containing a link to the next one, so that you can display the current
> records and offer the option to browse to the next section. If this xml
> blob
> is not splittable then may be I'd consider using a
> RequestDispatcherProvider
> to redirect to the container which can be more optimized to serve large
> files.
>
> But I'll definitely look into optimizing the SourceProvider...
>
> cheers, Sergey
>
> > I'd really like to
> > > customize both input and output folders/sizes of attachments extracte=
d
> > > from/attached to XML messages.
> > >
> > >
> > My understanding that at the moment it's only possible to do it on the
> > input
> > (assuming it is XOP in your case or 'plain' attachments).
> >
> > Let me know how it goes please
> > Cheers, Sergey
> >
> >
> > I've added the system properties and I've checked from code. However, t=
he
> > > temporal folder is still the same
> > >
> > >
> >
> >
>
> (C:\Users\ICA\.netbeans\6.9\apache-tomcat-6.0.26_base\temp\cxf-tmp-418517=
\co
> > > s970506463177488784tmp) and the size of the XML message is 15 MB!
> > >
> > > Thanks!
> > >
> > >
> > > -----Mensaje original-----
> > > De: Sergey Beryozkin [mailto:sberyozkin@gmail.com]
> > > Enviado el: mi=E9rcoles, 19 de enero de 2011 13:09
> > > Para: users@cxf.apache.org
> > > Asunto: Re: JAX-RS Attachments size limit and temp folder
> > >
> > > Hi Ivan
> > >
> > > Please see comments below:
> > >
> > > On Wed, Jan 19, 2011 at 11:34 AM, Ivan Vitoria Sanchez <
> > > ivitoria@grupoica.com> wrote:
> > >
> > > > Hi Sergey,
> > > >
> > > > I'm not using XOP and yes, the properties 'attachment-directory' an=
d
> > > > 'attachment-memory-threshold' don't seem to have any effect. I've
> also
> > > > tried
> > > > adding the VM options but the result is the same.
> > > >
> > > > Following you can find the Spring configuration and log output:
> > > >
> > > > <jaxrs:server id=3D"genericServer"
> > > > modelRef=3D"classpath:/WEB-INF/model/GenericModel.xml" abstract=3D"=
true">
> > > >        <jaxrs:features>
> > > >            <cxf:logging/>
> > > >        </jaxrs:features>
> > > >        <jaxrs:inInterceptors>
> > > >            <ref bean=3D"gzipInInterceptor" />
> > > >        </jaxrs:inInterceptors>
> > > >        <jaxrs:outInterceptors>
> > > >            <ref bean=3D"gzipOutInterceptor" />
> > > >        </jaxrs:outInterceptors>
> > > >        <jaxrs:properties>
> > > >            <entry key=3D"attachment-directory" value=3D"/temp/mobil=
ity"/>
> > > >            <!-- 400K-->
> > > >            <entry key=3D"attachment-memory-threshold" value=3D"4096=
00"/>
> > > >        </jaxrs:properties>
> > > >    </jaxrs:server>
> > > >
> > > >
> > > >    <bean id=3D"attachmentServer" parent=3D"genericServer">
> > > >        <property name=3D"modelRef"
> > > > value=3D"classpath:/WEB-INF/model/AttachmentModel.xml" />
> > > >        <property name=3D"address" value=3D"/attachments" />
> > > >        <property name=3D"serviceBeans">
> > > >            <!-- Service Bean omitted -->
> > > >        </property>
> > > >    </bean>
> > > >
> > > > ---------------
> > > > Response-Code: 200
> > > > Content-Type: application/octet-stream
> > > > Headers: {Date=3D[Wed, 19 Jan 2011 10:20:55 GMT],
> > Content-Encoding=3D[gzip],
> > > > Vary=3D[Accept-Encoding]}
> > > > Messages: Outbound Message (saved to tmp file):
> > > > Filename:
> > > >
> > > >
> > >
> > >
> >
> >
>
> C:\Users\ICA\.netbeans\6.9\apache-tomcat-6.0.26_base\temp\cxf-tmp-872111\=
cos
> > > > 4854851171655688610tmp
> > > > (message truncated to 102400 bytes)
> > > >
> > > > Payload: omitted
> > > >
> > > >
> > > >
> > > AFAIK, These properties, "attachment-directory" and
> > > "attachment-memory-threshold", are affecting reading the attachments
> > only.
> > > But it looks like you'd like them affecting writing the attachments ?
> > >
> > > Try setting the following system properties :
> > >
> > > -Dorg.apache.cxf.io.CachedOutputStream.Threshold=3DsomeValue
> > > and
> > > -Dorg.apache.cxf.io.CachedOutputStream.OutputDirectory=3D/temp/mobili=
ty
> > >
> > > There must be the way to set these properties as jaxrs:properties too=
,
> > just
> > > do not have an access to the code right now
> > >
> > > Let me know please if it helps
> > > Cheers, Sergey
> > >
> > >
> > > > Ivan
> > > >
> > > >
> > > >
> > > > -----Mensaje original-----
> > > > De: Sergey Beryozkin [mailto:sberyozkin@gmail.com]
> > > > Enviado el: mi=E9rcoles, 19 de enero de 2011 12:06
> > > > Para: users@cxf.apache.org
> > > > Asunto: Re: JAX-RS Attachments size limit and temp folder
> > > >
> > > > Hi
> > > >
> > > > On Wed, Jan 19, 2011 at 10:56 AM, Ivan Vitoria Sanchez <
> > > > ivitoria@grupoica.com> wrote:
> > > >
> > > > > Hi everyone,
> > > > >
> > > > >
> > > > >
> > > > > I'm developing a JAX-RS server (CXF 2.3.1) which performs both GE=
T
> > and
> > > > POST
> > > > > operations with DataHandler attachments within a bean, and it wor=
ks
> > > fine
> > > > > (I'm not sending Multiparts). However, I could not set neither th=
e
> > temp
> > > > > folder used as buffer nor the max size of the attachments as
> > explained
> > > in
> > > > > http://cxf.apache.org/docs/jax-rs-multiparts.html ("Reading Large
> > > > > Attachments" section).
> > > > >
> > > > >
> > > > Are you using XOP ? Also, when you say you can not set, do you mean
> the
> > > > properties you set have no effect ?
> > > >
> > > > thanks, Sergey
> > > >
> > > >
> > > > >
> > > > >
> > > > > Does it not work because it only applies to Multipart messages? I=
f
> > so,
> > > > how
> > > > > can i do it?
> > > > >
> > > > >
> > > > >
> > > > > Thanks in advance!
> > > > >
> > > > >
> > > > >
> > > > > Ivan
> > > > >
> > > > >
> > > > >
> > > > >
> > > > >
> > > > >
> > > > >
> > > > >
> > > >
> > >
> >
>

--001636c5ac69941768049a87f1d7--