Mailing-List: contact user-help@commons.apache.org; run by ezmlm
Precedence: bulk
Reply-To: "Commons Users List" <user@commons.apache.org>
Received-SPF: pass (athena.apache.org: domain of sebbaz@gmail.com designates
 72.14.220.157 as permitted sender)
DomainKey-Signature: a=rsa-sha1; c=nofws;
        d=gmail.com; s=gamma;
        h=mime-version:in-reply-to:references:date:message-id:subject:from:to
         :content-type:content-transfer-encoding;
        b=CTfkdeT9dKU667nECuWNkqdAAy3tKpPoBfqoY1HvokC6siAsuvec6hV3v+rwbPvfdM
         sGJH1LXawfFsECJBmaV6+cpP5FVTkQ7zvkCKjcH9GozrsbjTlOKYCQhZVscEcGGLCAIZ
         R09yRVQRa6AbC7WTc+VUvIwWwpBAqzOy92gUY=
MIME-Version: 1.0
In-Reply-To: <269a5c30904150539rc3bc48fw364252b8bf7d9996@mail.gmail.com>
References: <269a5c30904150539rc3bc48fw364252b8bf7d9996@mail.gmail.com>
Date: Wed, 15 Apr 2009 15:32:05 +0100
Message-ID: <25aac9fc0904150732q2ba4726fo3dda8ba35a2f9ce5@mail.gmail.com>
Subject: Re: StrTokenizer not handling quotes correctly?
From: sebb <sebbaz@gmail.com>
To: Commons Users List <user@commons.apache.org>
Content-Type: text/plain; charset=ISO-8859-1
Content-Transfer-Encoding: 7bit

On 15/04/2009, Jacek Furmankiewicz <jacek99@gmail.com> wrote:
> I am trying to use StrTokenizer for some parsing and I am probably not using
>  it correctly.
>
>  Let's say I have this string:
>
>  11"a,b"11,22"c,d"22"
>
>  I would like to split it by the comma ",", but ignoring any commas embedded
>  in quotes. I try this:
>
>         String test = "11\"a,b\"11,22\"c,d\"22";
>         StrTokenizer str = new StrTokenizer(test,',','"');
>         String[] tokens = str.getTokenArray();
>
>         for(String t: tokens) {
>             System.out.println(t);
>         }
>
>  and expect to have two strings print out:
>
>  11"a,b"11
>  22"c,d"22
>
>  but instead I get 4 :
>
>  11"a
>  b"11
>  22"c
>  d"22
>
>  It seems the tokenizer is splitting on the comma, even if it is embedded in
>  quotes.

Quotes are only allowed in quoted strings. From the Javadoc:

"Each token may be surrounded by quotes. The quote matcher specifies
the quote character(s). A quote may be escaped within a quoted section
by duplicating itself. "

>  I tried different options on the StrTokenizer, but not been able to get it
>  to work correctly.
>
>  Any idea as to what am I doing wrong? Using latest version 2.4.

The input needs to look like this:

"11""a,b""11","22""c,d""22""

>  Thanks, Jacek
>

---------------------------------------------------------------------
To unsubscribe, e-mail: user-unsubscribe@commons.apache.org
For additional commands, e-mail: user-help@commons.apache.org