Mailing-List: contact users-help@nifi.apache.org; run by ezmlm
Precedence: bulk
Reply-To: users@nifi.apache.org
MIME-Version: 1.0
In-Reply-To: <2b2f54db5eaa4d268c9e74b571c14ff9@SI-MBX1015.de.bosch.com>
References: <2b2f54db5eaa4d268c9e74b571c14ff9@SI-MBX1015.de.bosch.com>
Date: Sat, 30 Jan 2016 23:27:47 -0500
Message-ID: 
 <CALJK9a7bc6=++t=mAOXBm5bSO1O8865gy7yOJBrRzxhzLn4DNg@mail.gmail.com>
Subject: Re: Split header from CSV and use for JSON
From: Joe Witt <joe.witt@gmail.com>
To: users@nifi.apache.org
Content-Type: text/plain; charset=UTF-8
Content-Transfer-Encoding: quoted-printable

Ian

Makes sense.  Happy to help put together a template to see if we can
get you closer.  Working on some 050 release items at the moment but
will flag this to come back

Thanks
Joe

On Fri, Jan 29, 2016 at 8:43 AM, Hellstroem Christian (AE/PJ-ASC)
<Christian.Hellstroem@de.bosch.com> wrote:
> Hi,
>
>
>
> I=E2=80=99m just starting out with NiFi and I am ingesting a CSV file wit=
h headers.
> I would like to strip the header from each file and then use the header
> (with column names) to map each row to JSON, after which more processing =
is
> done. Right now I=E2=80=99m stuck on which processors to use and how to d=
o the
> settings.
>
>
>
> The CSV files are pretty much as follows:
>
>
>
> SOME GENERIC INFO
>
> COL1,COL2,COL3
>
> VAL11,VAL12,VAL13
>
> VAL21,VAL22,VAL23
>
> =E2=80=A6
>
>
>
> Basically I want to remove the first line with =E2=80=98some generic info=
=E2=80=99 that is
> different for each file, and I want the columns from line 2 to become fie=
lds
> in JSON, so that I end up with
>
>
>
> {
>
>   =E2=80=9CCOL1=E2=80=9D: =E2=80=9CVAL11=E2=80=9D,
>
>  =E2=80=9CCOL2=E2=80=9D : =E2=80=9DVAL12=E2=80=9D,
>
>  =E2=80=9CCOL3=E2=80=9D: =E2=80=9CVAL13=E2=80=9D
>
> }
>
>
>
> etc.
>
>
>
> I currently have a GetFile processor for the CSV file and an
> AttributesToJSON afterwards with default settings, so there is no manual
> mapping done anywhere. I checked out the CSV2JSON template by Hortonworks
> but that=E2=80=99s a very manual process and that would be extremely tedi=
ous as I
> have files with roughly a hundred columns.
>
>
>
> I=E2=80=99m really stuck and any pointers would be greatly appreciated.
>
>
>
> Also a content preview feature would be really helpful=E2=80=A6
>
>
>
> Cheers,
>
>
>
> Ian.