Mailing-List: contact users-help@nifi.apache.org; run by ezmlm
Precedence: bulk
Reply-To: users@nifi.apache.org
Message-ID: <57683b00.8fa4370a.129c7.7ff6@mx.google.com>
MIME-Version: 1.0
To: Simon Elliston Ball <simon@simonellistonball.com>,
	"users@nifi.apache.org" <users@nifi.apache.org>
Cc: Lee Laim <lee.laim@gmail.com>
From: Sven Davison <svendavison@gmail.com>
Subject: RE: GetHTTP->ExtractText (Regex/User problem?)
Date: Mon, 20 Jun 2016 14:50:42 -0400
Importance: normal
In-Reply-To: <52FDFCFA-3280-41EC-AD8D-CAADD5417748@simonellistonball.com>
References: <576818e2.4694370a.d1f69.5602@mx.google.com>
 <CAOBPTL8fYGVQEmK5-YLGdhuczZ99eUve3stH44jTXJ04W5-EFQ@mail.gmail.com>
 <57682b53.422ded0a.13171.ffff8279@mx.google.com>
 <52FDFCFA-3280-41EC-AD8D-CAADD5417748@simonellistonball.com>
Content-Type: multipart/alternative;
	boundary="_4F1A6BC2-7E44-4CA5-A806-475558841B0D_"
archived-at: Mon, 20 Jun 2016 18:50:49 -0000

--_4F1A6BC2-7E44-4CA5-A806-475558841B0D_
Content-Transfer-Encoding: quoted-printable
Content-Type: text/plain; charset="utf-8"

Awsome. It=E2=80=99s coming along and the overhead it might have is worth t=
he stress free setup. NICE!

Now I want to take the content of it and put it into a variable so it=E2=80=
=99s easier for me to understand how to use it. I=E2=80=99m TRYING to get t=
he variable (joke) filled with the content of the tag. I can put it out to =
a file just fine, but trying to avoid a bunch of FileI/O overhead.


http://prntscr.com/bisfy9


-Sven

Sent from Mail for Windows 10

From: Simon Elliston Ball
Sent: Monday, June 20, 2016 1:52 PM
To: users@nifi.apache.org
Cc: Lee Laim
Subject: Re: GetHTTP->ExtractText (Regex/User problem?)

http://stackoverflow.com/questions/1732348/regex-match-open-tags-except-xht=
ml-self-contained-tags/1732454#1732454=C2=A0is something of a classic on th=
is subject.=C2=A0

I would recommend using the ExtractXPath/XQuery or GetHTMLElement =C2=A0htt=
ps://nifi.apache.org/docs/nifi-docs/components/org.apache.nifi.GetHTMLEleme=
nt/index.html=C2=A0these may be a little heavier on the processing, but wil=
l certainly save you a lot of problems with parsing. This lets you use css =
selectors against html, which is more intuitive and robust to parse HTML.

Simon

On 20 Jun 2016, at 18:43, Sven Davison <svendavison@gmail.com> wrote:

I had tried that but got a NULL value result. =C2=A0Is there a setting w/in=
 the extractor that I need to change too?
=C2=A0
=C2=A0
=C2=A0
-Sven
Sent from=C2=A0Mail=C2=A0for Windows 10
=C2=A0
From:=C2=A0Lee Laim
Sent:=C2=A0Monday, June 20, 2016 12:56 PM
To:=C2=A0users@nifi.apache.org
Subject:=C2=A0Re: GetHTTP->ExtractText (Regex/User problem?)
=C2=A0
Hi Sven,=C2=A0
=C2=A0
give this a try:
=C2=A0
<div class=3D=E2=80=9Dcontent=E2=80=9D>(.*?)<\/div>
=C2=A0
=C2=A0
=C2=A0
On Mon, Jun 20, 2016 at 10:25 AM, Sven Davison <svendavison@gmail.com> wrot=
e:
I have looked at the example for extracting text. I seen the example pulls =
the content between the <title> tags. I=E2=80=99ve changed it to pull from =
the <h3> tags w/o problem. The problem I=E2=80=99m having is pulling form s=
omething a bit more specific. I=E2=80=99m sure the problem is with my under=
standing/usage of REGEX.
=C2=A0
I=E2=80=99m trying to pull the content from this example.
=C2=A0
<div class=3D=E2=80=9Dcontent=E2=80=9D>this is the content I want to pull</=
div>
=C2=A0
Any help would be super awesome. I=E2=80=99ve been banging my head for a bi=
t here.
=C2=A0
=C2=A0
=C2=A0
-Sven
=C2=A0
Sent from=C2=A0Mail=C2=A0for Windows 10


--_4F1A6BC2-7E44-4CA5-A806-475558841B0D_
Content-Transfer-Encoding: quoted-printable
Content-Type: text/html; charset="utf-8"

<html xmlns:o=3D"urn:schemas-microsoft-com:office:office" xmlns:w=3D"urn:sc=
hemas-microsoft-com:office:word" xmlns:m=3D"http://schemas.microsoft.com/of=
fice/2004/12/omml" xmlns=3D"http://www.w3.org/TR/REC-html40"><head><meta ht=
tp-equiv=3DContent-Type content=3D"text/html; charset=3Dutf-8"><meta name=
=3DGenerator content=3D"Microsoft Word 15 (filtered medium)"><style><!--
/* Font Definitions */
@font-face
	{font-family:"Cambria Math";
	panose-1:2 4 5 3 5 4 6 3 2 4;}
@font-face
	{font-family:Calibri;
	panose-1:2 15 5 2 2 2 4 3 2 4;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
	{margin:0in;
	margin-bottom:.0001pt;
	font-size:11.0pt;
	font-family:"Calibri",sans-serif;}
a:link, span.MsoHyperlink
	{mso-style-priority:99;
	color:blue;
	text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
	{mso-style-priority:99;
	color:#954F72;
	text-decoration:underline;}
span.apple-converted-space
	{mso-style-name:apple-converted-space;}
.MsoChpDefault
	{mso-style-type:export-only;}
@page WordSection1
	{size:8.5in 11.0in;
	margin:1.0in 1.0in 1.0in 1.0in;}
div.WordSection1
	{page:WordSection1;}
--></style></head><body lang=3DEN-US link=3Dblue vlink=3D"#954F72"><div cla=
ss=3DWordSection1><p class=3DMsoNormal>Awsome. It=E2=80=99s coming along an=
d the overhead it might have is worth the stress free setup. NICE!</p><p cl=
ass=3DMsoNormal><o:p>&nbsp;</o:p></p><p class=3DMsoNormal>Now I want to tak=
e the content of it and put it into a variable so it=E2=80=99s easier for m=
e to understand how to use it. I=E2=80=99m TRYING to get the variable (joke=
) filled with the content of the tag. I can put it out to a file just fine,=
 but trying to avoid a bunch of FileI/O overhead.</p><p class=3DMsoNormal><=
o:p>&nbsp;</o:p></p><p class=3DMsoNormal><o:p>&nbsp;</o:p></p><p class=3DMs=
oNormal><a href=3D"http://prntscr.com/bisfy9">http://prntscr.com/bisfy9</a>=
</p><p class=3DMsoNormal><o:p>&nbsp;</o:p></p><p class=3DMsoNormal><o:p>&nb=
sp;</o:p></p><p class=3DMsoNormal>-Sven</p><p class=3DMsoNormal><o:p>&nbsp;=
</o:p></p><p class=3DMsoNormal>Sent from <a href=3D"https://go.microsoft.co=
m/fwlink/?LinkId=3D550986">Mail</a> for Windows 10</p><p class=3DMsoNormal>=
<span style=3D'font-size:12.0pt;font-family:"Times New Roman",serif'><o:p>&=
nbsp;</o:p></span></p><div style=3D'mso-element:para-border-div;border:none=
;border-top:solid #E1E1E1 1.0pt;padding:3.0pt 0in 0in 0in'><p class=3DMsoNo=
rmal style=3D'border:none;padding:0in'><b>From: </b><a href=3D"mailto:simon=
@simonellistonball.com">Simon Elliston Ball</a><br><b>Sent: </b>Monday, Jun=
e 20, 2016 1:52 PM<br><b>To: </b><a href=3D"mailto:users@nifi.apache.org">u=
sers@nifi.apache.org</a><br><b>Cc: </b><a href=3D"mailto:lee.laim@gmail.com=
">Lee Laim</a><br><b>Subject: </b>Re: GetHTTP-&gt;ExtractText (Regex/User p=
roblem?)</p></div><p class=3DMsoNormal><span style=3D'font-size:12.0pt;font=
-family:"Times New Roman",serif'><o:p>&nbsp;</o:p></span></p><p class=3DMso=
Normal><span style=3D'font-size:12.0pt;font-family:"Times New Roman",serif'=
><a href=3D"http://stackoverflow.com/questions/1732348/regex-match-open-tag=
s-except-xhtml-self-contained-tags/1732454#1732454">http://stackoverflow.co=
m/questions/1732348/regex-match-open-tags-except-xhtml-self-contained-tags/=
1732454#1732454</a>&nbsp;is something of a classic on this subject.&nbsp;</=
span><span style=3D'font-size:12.0pt;font-family:"Times New Roman",serif'><=
o:p></o:p></span></p><div><p class=3DMsoNormal><span style=3D'font-size:12.=
0pt;font-family:"Times New Roman",serif'><o:p>&nbsp;</o:p></span></p></div>=
<div><p class=3DMsoNormal><span style=3D'font-size:12.0pt;font-family:"Time=
s New Roman",serif'>I would recommend using the ExtractXPath/XQuery or GetH=
TMLElement &nbsp;<a href=3D"https://nifi.apache.org/docs/nifi-docs/componen=
ts/org.apache.nifi.GetHTMLElement/index.html">https://nifi.apache.org/docs/=
nifi-docs/components/org.apache.nifi.GetHTMLElement/index.html</a>&nbsp;the=
se may be a little heavier on the processing, but will certainly save you a=
 lot of problems with parsing. This lets you use css selectors against html=
, which is more intuitive and robust to parse HTML.<o:p></o:p></span></p><d=
iv><div><p class=3DMsoNormal><span style=3D'font-size:12.0pt;font-family:"T=
imes New Roman",serif'><o:p>&nbsp;</o:p></span></p></div><div><p class=3DMs=
oNormal><span style=3D'font-size:12.0pt;font-family:"Times New Roman",serif=
'>Simon<o:p></o:p></span></p></div><p class=3DMsoNormal><span style=3D'font=
-size:12.0pt;font-family:"Times New Roman",serif'><o:p>&nbsp;</o:p></span><=
/p><div><blockquote style=3D'margin-top:5.0pt;margin-bottom:5.0pt'><div><p =
class=3DMsoNormal><span style=3D'font-size:12.0pt;font-family:"Times New Ro=
man",serif'>On 20 Jun 2016, at 18:43, Sven Davison &lt;<a href=3D"mailto:sv=
endavison@gmail.com">svendavison@gmail.com</a>&gt; wrote:<o:p></o:p></span>=
</p></div><p class=3DMsoNormal><span style=3D'font-size:12.0pt;font-family:=
"Times New Roman",serif'><o:p>&nbsp;</o:p></span></p><div><div><p class=3DM=
soNormal>I had tried that but got a NULL value result. &nbsp;Is there a set=
ting w/in the extractor that I need to change too?<o:p></o:p></p></div><div=
><p class=3DMsoNormal>&nbsp;<o:p></o:p></p></div><div><p class=3DMsoNormal>=
&nbsp;<o:p></o:p></p></div><div><p class=3DMsoNormal>&nbsp;<o:p></o:p></p><=
/div><div><p class=3DMsoNormal>-Sven<o:p></o:p></p></div><div><p class=3DMs=
oNormal>Sent from<span class=3Dapple-converted-space>&nbsp;</span><a href=
=3D"https://go.microsoft.com/fwlink/?LinkId=3D550986"><span style=3D'color:=
#954F72'>Mail</span></a><span class=3Dapple-converted-space>&nbsp;</span>fo=
r Windows 10<o:p></o:p></p></div><div><p class=3DMsoNormal><span style=3D'f=
ont-size:12.0pt;font-family:"Times New Roman",serif'>&nbsp;</span><o:p></o:=
p></p></div><div style=3D'border:none;border-top:solid #E1E1E1 1.0pt;paddin=
g:3.0pt 0in 0in 0in'><div><p class=3DMsoNormal><b>From:<span class=3Dapple-=
converted-space>&nbsp;</span></b><a href=3D"mailto:lee.laim@gmail.com"><spa=
n style=3D'color:#954F72'>Lee Laim</span></a><br><b>Sent:<span class=3Dappl=
e-converted-space>&nbsp;</span></b>Monday, June 20, 2016 12:56 PM<br><b>To:=
<span class=3Dapple-converted-space>&nbsp;</span></b><a href=3D"mailto:user=
s@nifi.apache.org"><span style=3D'color:#954F72'>users@nifi.apache.org</spa=
n></a><br><b>Subject:<span class=3Dapple-converted-space>&nbsp;</span></b>R=
e: GetHTTP-&gt;ExtractText (Regex/User problem?)<o:p></o:p></p></div></div>=
<div><p class=3DMsoNormal><span style=3D'font-size:12.0pt;font-family:"Time=
s New Roman",serif'>&nbsp;</span><o:p></o:p></p></div><div><div><div><p cla=
ss=3DMsoNormal><span style=3D'font-size:12.0pt;font-family:"Times New Roman=
",serif'>Hi Sven,&nbsp;</span><o:p></o:p></p></div></div><div><div><p class=
=3DMsoNormal><span style=3D'font-size:12.0pt;font-family:"Times New Roman",=
serif'>&nbsp;</span><o:p></o:p></p></div></div><div><div><p class=3DMsoNorm=
al><span style=3D'font-size:12.0pt;font-family:"Times New Roman",serif'>giv=
e this a try:</span><o:p></o:p></p></div></div><div><div><p class=3DMsoNorm=
al><span style=3D'font-size:12.0pt;font-family:"Times New Roman",serif'>&nb=
sp;</span><o:p></o:p></p></div></div><div><p class=3DMsoNormal><span style=
=3D'font-size:12.0pt;font-family:"Courier New"'>&lt;div class=3D=E2=80=9Dco=
ntent=E2=80=9D&gt;(.*?)&lt;\/div&gt;</span><o:p></o:p></p></div><div><div><=
p class=3DMsoNormal><span style=3D'font-size:12.0pt;font-family:"Times New =
Roman",serif'>&nbsp;</span><o:p></o:p></p></div></div><div><div><p class=3D=
MsoNormal><span style=3D'font-size:12.0pt;font-family:"Times New Roman",ser=
if'>&nbsp;</span><o:p></o:p></p></div></div></div><div><div><p class=3DMsoN=
ormal><span style=3D'font-size:12.0pt;font-family:"Times New Roman",serif'>=
&nbsp;</span><o:p></o:p></p></div><div><div><p class=3DMsoNormal><span styl=
e=3D'font-size:12.0pt;font-family:"Times New Roman",serif'>On Mon, Jun 20, =
2016 at 10:25 AM, Sven Davison &lt;<a href=3D"mailto:svendavison@gmail.com"=
 target=3D"_blank"><span style=3D'color:#954F72'>svendavison@gmail.com</spa=
n></a>&gt; wrote:</span><o:p></o:p></p></div><blockquote style=3D'border:no=
ne;border-left:solid #CCCCCC 1.0pt;padding:0in 0in 0in 6.0pt;margin-left:4.=
8pt;margin-top:5.0pt;margin-right:0in;margin-bottom:5.0pt'><div><div><div><=
p class=3DMsoNormal>I have looked at the example for extracting text. I see=
n the example pulls the content between the &lt;title&gt; tags. I=E2=80=99v=
e changed it to pull from the &lt;h3&gt; tags w/o problem. The problem I=E2=
=80=99m having is pulling form something a bit more specific. I=E2=80=99m s=
ure the problem is with my understanding/usage of REGEX.<o:p></o:p></p></di=
v><p class=3DMsoNormal>&nbsp;</p><div><p class=3DMsoNormal>I=E2=80=99m tryi=
ng to pull the content from this example.<o:p></o:p></p></div><p class=3DMs=
oNormal>&nbsp;</p><div><p class=3DMsoNormal><b>&lt;div class=3D=E2=80=9Dcon=
tent=E2=80=9D&gt;this is the content I want to pull&lt;/div&gt;</b><o:p></o=
:p></p></div><p class=3DMsoNormal>&nbsp;</p><div><p class=3DMsoNormal>Any h=
elp would be super awesome. I=E2=80=99ve been banging my head for a bit her=
e.<o:p></o:p></p></div><p class=3DMsoNormal>&nbsp;</p><p class=3DMsoNormal>=
&nbsp;</p><p class=3DMsoNormal>&nbsp;</p><div><p class=3DMsoNormal>-Sven<o:=
p></o:p></p></div><p class=3DMsoNormal>&nbsp;</p><div><p class=3DMsoNormal>=
Sent from<span class=3Dapple-converted-space>&nbsp;</span><a href=3D"https:=
//go.microsoft.com/fwlink/?LinkId=3D550986" target=3D"_blank"><span style=
=3D'color:#954F72'>Mail</span></a><span class=3Dapple-converted-space>&nbsp=
;</span>for Windows 10<o:p></o:p></p></div></div></div></blockquote></div><=
/div></div></blockquote></div></div></div><p class=3DMsoNormal><span style=
=3D'font-size:12.0pt;font-family:"Times New Roman",serif'><o:p>&nbsp;</o:p>=
</span></p><p class=3DMsoNormal><o:p>&nbsp;</o:p></p></div></body></html>=

--_4F1A6BC2-7E44-4CA5-A806-475558841B0D_--