Mailing-List: contact users-help@nifi.apache.org; run by ezmlm
Precedence: bulk
Reply-To: users@nifi.apache.org
MIME-Version: 1.0
In-Reply-To: <CD403EB8F44BF7458B661179DBD76F925F3224F8@chapdt3chm05.ad.tiaa-cref.org>
References: <CD403EB8F44BF7458B661179DBD76F925F3224F8@chapdt3chm05.ad.tiaa-cref.org>
From: Aldrin Piri <aldrinpiri@gmail.com>
Date: Wed, 21 Sep 2016 10:47:22 -0400
Message-ID: <CADT6bVuC7oFrzd4Mst6F1atx6rEvumn3THYfskeGLDw4odyamw@mail.gmail.com>
Subject: Re: Idea needed to get XL from SharePoint using NiFi
To: users@nifi.apache.org
Content-Type: multipart/alternative; boundary=001a113ee944d09464053d05a156
archived-at: Wed, 21 Sep 2016 14:48:12 -0000

--001a113ee944d09464053d05a156
Content-Type: text/plain; charset=UTF-8

Hi Ram,

Accomplishing this task would require some effort beyond those items
currently bundled with NiFi.

I am not well versed in Sharepoint internals, but it seems like there is an
available REST API [1] that would allow you to access files and folders
[2].  Depending on the nuances of authentication, InvokeHTTP may be a
reasonable solution to both query an endpoint and serve as a means for
finding additional information to get specific files and folders.  Doing
some quick searching on top of that, it appears there are a few libraries
available that may facilitate acquiring files from Sharepoint which could
be used in a custom processor to streamline the process.

Once you are able to access Sharepoint and gather the documents of
interest, some transform would be needed from the xls(x) format to CSV.  I
have a vague recollection of someone in the community working with Apache
POI [3] to facilitate this process but cannot seem to find the reference
with some searching.  This would also require custom processor development.

The suite of ExecuteProcess, ExecuteStreamCommand, ExecuteScript,
InvokeScripted processors may provide some additional avenues for
exploration if you currently have applications that accomplish some of this
presently or have comfort working with JVM-friendly scripting languages.

The final steps of saving to disk and/or loading a database are supported
and should cover your needs beyond the data capture and transformation.

[1] https://msdn.microsoft.com/EN-US/library/office/fp142380.aspx
[2] https://msdn.microsoft.com/en-us/library/office/dn292553.aspx
[3] http://poi.apache.org/

On Mon, Sep 19, 2016 at 4:58 PM, Nathamuni, Ramanujam <RNathamuni@tiaa.org>
wrote:

> Hello:
>
>
>
> I need to get the XL files on windows SharePoint 2013  and store as CSV
> file or load into database? Please give me the things to try out?
>
>
>
> Thanks,
>
> Ram
>
>
> *************************************************************************
> This e-mail may contain confidential or privileged information.
> If you are not the intended recipient, please notify the sender
> immediately and then delete it.
>
> TIAA
> *************************************************************************
>

--001a113ee944d09464053d05a156
Content-Type: text/html; charset=UTF-8
Content-Transfer-Encoding: quoted-printable

<div dir=3D"ltr">Hi Ram,<div><br></div><div>Accomplishing this task would r=
equire some effort beyond those items currently bundled with NiFi.</div><di=
v><div><br></div><div>I am not well versed in Sharepoint internals, but it =
seems like there is an available REST API [1] that would allow you to acces=
s files and folders [2].=C2=A0 Depending on the nuances of authentication, =
InvokeHTTP may be a reasonable solution to both query an endpoint and serve=
 as a means for finding additional information to get specific files and fo=
lders.=C2=A0 Doing some quick searching on top of that, it appears there ar=
e a few libraries available that may facilitate acquiring files from Sharep=
oint which could be used in a custom processor to streamline the process.</=
div><div><br></div><div>Once you are able to access Sharepoint and gather t=
he documents of interest, some transform would be needed from the xls(x) fo=
rmat to CSV.=C2=A0 I have a vague recollection of someone in the community =
working with Apache POI [3] to facilitate this process but cannot seem to f=
ind the reference with some searching.=C2=A0 This would also require custom=
 processor development.</div><div><br></div><div>The suite of ExecuteProces=
s, ExecuteStreamCommand, ExecuteScript, InvokeScripted processors may provi=
de some additional avenues for exploration if you currently have applicatio=
ns that accomplish some of this presently or have comfort working with JVM-=
friendly scripting languages.=C2=A0</div><div><br></div><div>The final step=
s of saving to disk and/or loading a database are supported and should cove=
r your needs beyond the data capture and transformation.</div><div><br></di=
v><div>[1]=C2=A0<a href=3D"https://msdn.microsoft.com/EN-US/library/office/=
fp142380.aspx" target=3D"_blank">https://msdn.microsoft.com<wbr>/EN-US/libr=
ary/office/fp142380<wbr>.aspx</a></div><div>[2]=C2=A0<a href=3D"https://msd=
n.microsoft.com/en-us/library/office/dn292553.aspx" target=3D"_blank">https=
://msdn.microsoft.com<wbr>/en-us/library/office/dn292553<wbr>.aspx</a></div=
></div><div>[3]=C2=A0<a href=3D"http://poi.apache.org/">http://poi.apache.o=
rg/</a></div></div><div class=3D"gmail_extra"><br><div class=3D"gmail_quote=
">On Mon, Sep 19, 2016 at 4:58 PM, Nathamuni, Ramanujam <span dir=3D"ltr">&=
lt;<a href=3D"mailto:RNathamuni@tiaa.org" target=3D"_blank">RNathamuni@tiaa=
.org</a>&gt;</span> wrote:<br><blockquote class=3D"gmail_quote" style=3D"ma=
rgin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">


<div lang=3D"EN-US" link=3D"blue" vlink=3D"purple" style=3D"word-wrap:break=
-word">
<div>
<p class=3D"MsoNormal"><span style=3D"font-size:11.0pt;font-family:&quot;Ca=
libri&quot;,&quot;sans-serif&quot;;color:#1f497d">Hello:<u></u><u></u></spa=
n></p>
<p class=3D"MsoNormal"><span style=3D"font-size:11.0pt;font-family:&quot;Ca=
libri&quot;,&quot;sans-serif&quot;;color:#1f497d"><u></u>=C2=A0<u></u></spa=
n></p>
<p class=3D"MsoNormal"><span style=3D"font-size:11.0pt;font-family:&quot;Ca=
libri&quot;,&quot;sans-serif&quot;;color:#1f497d">I need to get the XL file=
s on windows SharePoint 2013 =C2=A0and store as CSV file or load into datab=
ase? Please give me the things to try out?=C2=A0
<u></u><u></u></span></p>
<p class=3D"MsoNormal"><span style=3D"font-size:11.0pt;font-family:&quot;Ca=
libri&quot;,&quot;sans-serif&quot;;color:#1f497d"><u></u>=C2=A0<u></u></spa=
n></p>
<p class=3D"MsoNormal"><span style=3D"font-size:11.0pt;font-family:&quot;Ca=
libri&quot;,&quot;sans-serif&quot;;color:#1f497d">Thanks,<u></u><u></u></sp=
an></p>
<p class=3D"MsoNormal"><span style=3D"font-size:11.0pt;font-family:&quot;Ca=
libri&quot;,&quot;sans-serif&quot;;color:#1f497d">Ram
<u></u><u></u></span></p>
</div>
<p><br>
******************************<wbr>******************************<wbr>*****=
********<br>
This e-mail may contain confidential or privileged information.<br>
If you are not the intended recipient, please notify the sender immediately=
 and then delete it.</p>

<p>TIAA<br>
******************************<wbr>******************************<wbr>*****=
********</p></div>

</blockquote></div><br></div>

--001a113ee944d09464053d05a156--