hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "vincent he (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HADOOP-14177) hadoop-build fails to handle non-english UTF-8 characters
Date Mon, 13 Mar 2017 14:24:41 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-14177?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15907550#comment-15907550
] 

vincent he commented on HADOOP-14177:
-------------------------------------

Thanks for your reply.
How about setting a default locale in start-build-env.sh like this?
for many developers may not know how to set a working locale in ubuntu:trusty

start-build-env.sh:
docker build -t "hadoop-build-${user_id}"   - UserSpecificDocker
…
…
RUN locale-gen en_US.UTF-8
ENV LANG='en_US.UTF-8' LANGUAGE='en_US:en' LC_ALL='en_US.UTF-8'
UserSpecificDocker


> hadoop-build fails to handle non-english UTF-8 characters 
> ----------------------------------------------------------
>
>                 Key: HADOOP-14177
>                 URL: https://issues.apache.org/jira/browse/HADOOP-14177
>             Project: Hadoop Common
>          Issue Type: Bug
>          Components: build
>            Reporter: vincent he
>            Priority: Minor
>         Attachments: HADOOP-14177.001.patch
>
>
> as this [link | http://askubuntu.com/questions/581458/how-to-configure-locales-to-unicode-in-a-docker-ubuntu-14-04-container]
shows, ubuntu:trusty which hadoop-build image build from does not specify any encoding, eg.
UTF-8. so not english characters will show incorrect and may fail the build.
> current:
> hewenxin@24a74cc3053b:~/hadoop$ ll zdh-hdfs-autotests/cases/
> total 284
> drwxr-xr-x 2 hewenxin users 4096 Mar 13 05:51 ./
> drwxr-xr-x 7 hewenxin users 4096 Mar 11 08:28 ../
> -rw-r--r-- 1 hewenxin users 3749 Mar  3 09:50 Y01.???????????????.robot
> -rw-r--r-- 1 hewenxin users 2060 Feb 27 05:20 Z00.????????????.robot
> -rw-r--r-- 1 hewenxin users 1102 Feb 27 05:20 Z00.????????????.robot.define
> -rw-r--r-- 1 hewenxin users 1308 Feb 27 08:46 Z01.??????????????????.robot
> -rw-r--r-- 1 hewenxin users 1365 Feb 27 05:20 Z02.HttpFS????????????.robot
> -rw-r--r-- 1 hewenxin users 1353 Feb 27 05:20 Z03.????????????????????????.robot
> -rw-r--r-- 1 hewenxin users 2928 Feb 27 08:46 Z04.???????????????.robot
> -rw-r--r-- 1 hewenxin users 1534 Mar  1 05:48 Z05.????????????.robot
> -rw-r--r-- 1 hewenxin users 1260 Feb 27 05:20 Z06.??????????????????.robot
> -rw-r--r-- 1 hewenxin users 1322 Feb 27 05:20 Z06.??????????????????.robot
> -rw-r--r-- 1 hewenxin users  198 Feb 27 05:20 Z07.balance?????????????????????.robot
> -rw-r--r-- 1 hewenxin users  915 Feb 27 05:20 Z08.hdfs???????????????????????????.robot
> -rw-r--r-- 1 hewenxin users  920 Mar  1 05:48 Z09.?????????JMX????????????.robot
> -rw-r--r-- 1 hewenxin users  198 Feb 27 05:20 Z10.hdfs??????????????????.robot
> -rw-r--r-- 1 hewenxin users  198 Feb 27 05:20 Z11.hdfs???????????????.robot
> -rw-r--r-- 1 hewenxin users  198 Feb 27 05:20 Z12.???????????????.robot
> -rw-r--r-- 1 hewenxin users  198 Feb 27 05:20 Z13.datanode????????????.robot
> -rw-r--r-- 1 hewenxin users  198 Feb 27 05:20 Z14.journal????????????.robot
> -rw-r--r-- 1 hewenxin users 1246 Mar  1 05:48 Z15.hdfs???????????????????????????.robot
> -rw-r--r-- 1 hewenxin users  169 Feb 27 05:20 Z16.?????????????????????????????????.robot
> -rw-r--r-- 1 hewenxin users  169 Feb 27 05:20 Z17.JMX????????????????????????.robot
> -rw-r--r-- 1 hewenxin users  169 Feb 27 05:20 Z18.??????krb????????????????????????.robot
> -rw-r--r-- 1 hewenxin users  198 Feb 27 05:20 Z99.hdfs???????????????.robot
> after modified:
> hewenxin@836ade384c62:~/hadoop$ ll zdh-hdfs-autotests/cases/
> total 284
> drwxr-xr-x 2 hewenxin users 4096 Mar 13 05:51 ./
> drwxr-xr-x 7 hewenxin users 4096 Mar 11 08:28 ../
> -rw-r--r-- 1 hewenxin users 3749 Mar  3 09:50 Y01.磁盘热插拔.robot
> -rw-r--r-- 1 hewenxin users 2060 Feb 27 05:20 Z00.心跳上报.robot
> -rw-r--r-- 1 hewenxin users 1102 Feb 27 05:20 Z00.心跳上报.robot.define
> -rw-r--r-- 1 hewenxin users 1308 Feb 27 08:46 Z01.基本功能冒烟.robot
> -rw-r--r-- 1 hewenxin users 1365 Feb 27 05:20 Z02.HttpFS功能测试.robot
> -rw-r--r-- 1 hewenxin users 1353 Feb 27 05:20 Z03.日志级别动态调整.robot
> -rw-r--r-- 1 hewenxin users 2928 Feb 27 08:46 Z04.多线程拷贝.robot
> -rw-r--r-- 1 hewenxin users 1534 Mar  1 05:48 Z05.指标上报.robot
> -rw-r--r-- 1 hewenxin users 1260 Feb 27 05:20 Z06.容灾功能测试.robot
> -rw-r--r-- 1 hewenxin users 1322 Feb 27 05:20 Z06.快照功能测试.robot
> -rw-r--r-- 1 hewenxin users  198 Feb 27 05:20 Z07.balance速率可调节优化.robot
> -rw-r--r-- 1 hewenxin users  915 Feb 27 05:20 Z08.hdfs智能配置最大坏盘数.robot
> -rw-r--r-- 1 hewenxin users  920 Mar  1 05:48 Z09.元数据JMX上报测试.robot
> -rw-r--r-- 1 hewenxin users  198 Feb 27 05:20 Z10.hdfs的白名单功能.robot
> -rw-r--r-- 1 hewenxin users  198 Feb 27 05:20 Z11.hdfs故障域功能.robot
> -rw-r--r-- 1 hewenxin users  198 Feb 27 05:20 Z12.磁盘热插拔.robot
> -rw-r--r-- 1 hewenxin users  198 Feb 27 05:20 Z13.datanode的缩扩容.robot
> -rw-r--r-- 1 hewenxin users  198 Feb 27 05:20 Z14.journal的缩扩容.robot
> -rw-r--r-- 1 hewenxin users 1246 Mar  1 05:48 Z15.hdfs进程内存使用百分比.robot
> -rw-r--r-- 1 hewenxin users  169 Feb 27 05:20 Z16.审计日志支持自定义列表.robot
> -rw-r--r-- 1 hewenxin users  169 Feb 27 05:20 Z17.JMX上报版本构建时间.robot
> -rw-r--r-- 1 hewenxin users  169 Feb 27 05:20 Z18.支持krb下控制台浏览文件.robot
> -rw-r--r-- 1 hewenxin users  198 Feb 27 05:20 Z99.hdfs客户端部署.robot



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org


Mime
View raw message