flume-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Vishwakarma, Chhaya" <Chhaya.Vishwaka...@Teradata.com>
Subject RE: Unicode data handling with flume
Date Fri, 15 May 2015 12:19:11 GMT
This option is not available with exec source

From: Marina [mailto:ppine7@yahoo.com]
Sent: Tuesday, May 12, 2015 5:56 PM
To: user@flume.apache.org
Subject: Re: Unicode data handling with flume

Did you try specifying encoding for your source, for example like this:
a1.sources.r1.inputCharset = ISO8859-1 << whatever charset you need>>
?

Marina

________________________________
From: "Vishwakarma, Chhaya" <Chhaya.Vishwakarma@Teradata.com<mailto:Chhaya.Vishwakarma@Teradata.com>>
To: "user@flume.apache.org<mailto:user@flume.apache.org>" <user@flume.apache.org<mailto:user@flume.apache.org>>
Sent: Tuesday, May 12, 2015 4:20 AM
Subject: Unicode data handling with flume

Hi all,
I'm trying to put a CSV file into HDFS using flume, file contains some unicode characters
also.
Once the file is there in HDFS I tried to view the content, but unable to see the records
properly.
File content
Name    age  sal    msg

Abc     21  1200    Lukè éxample àpple

Xyz     23  1400    er stîget ûf mit grôzer
Output in console
I did hdfs dfs -get /flume/events/csv/events.1234567
Below is the output
Name,age,sal,msg

Abc,21,1200,Luk��xample��pple

Xyz,23,1400,er st�get �f mit gr�zer
Does flume supports Unicode characters? If not how it can be handled?
Flume version is 1.4.0


Mime
View raw message