Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id 3BB3C200C45 for ; Mon, 13 Mar 2017 15:08:51 +0100 (CET) Received: by cust-asf.ponee.io (Postfix) id 3871A160B60; Mon, 13 Mar 2017 14:08:51 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id 6303E160B6C for ; Mon, 13 Mar 2017 15:08:50 +0100 (CET) Received: (qmail 53416 invoked by uid 500); 13 Mar 2017 14:08:46 -0000 Mailing-List: contact common-issues-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Delivered-To: mailing list common-issues@hadoop.apache.org Received: (qmail 53279 invoked by uid 99); 13 Mar 2017 14:08:45 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd4-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 13 Mar 2017 14:08:45 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd4-us-west.apache.org (ASF Mail Server at spamd4-us-west.apache.org) with ESMTP id 148BBC05E0 for ; Mon, 13 Mar 2017 14:08:45 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd4-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 1.451 X-Spam-Level: * X-Spam-Status: No, score=1.451 tagged_above=-999 required=6.31 tests=[KAM_ASCII_DIVIDERS=0.8, RP_MATCHES_RCVD=-0.001, SPF_NEUTRAL=0.652] autolearn=disabled Received: from mx1-lw-us.apache.org ([10.40.0.8]) by localhost (spamd4-us-west.apache.org [10.40.0.11]) (amavisd-new, port 10024) with ESMTP id lRU8vjWYFmhE for ; Mon, 13 Mar 2017 14:08:43 +0000 (UTC) Received: from mailrelay1-us-west.apache.org (mailrelay1-us-west.apache.org [209.188.14.139]) by mx1-lw-us.apache.org (ASF Mail Server at mx1-lw-us.apache.org) with ESMTP id 7130361595 for ; Mon, 13 Mar 2017 14:08:43 +0000 (UTC) Received: from jira-lw-us.apache.org (unknown [207.244.88.139]) by mailrelay1-us-west.apache.org (ASF Mail Server at mailrelay1-us-west.apache.org) with ESMTP id 5B2CDE0534 for ; Mon, 13 Mar 2017 14:08:42 +0000 (UTC) Received: from jira-lw-us.apache.org (localhost [127.0.0.1]) by jira-lw-us.apache.org (ASF Mail Server at jira-lw-us.apache.org) with ESMTP id B7086243AE for ; Mon, 13 Mar 2017 14:08:41 +0000 (UTC) Date: Mon, 13 Mar 2017 14:08:41 +0000 (UTC) From: "Allen Wittenauer (JIRA)" To: common-issues@hadoop.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Commented] (HADOOP-14177) hadoop-build fails to handle non-english UTF-8 characters MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 archived-at: Mon, 13 Mar 2017 14:08:51 -0000 [ https://issues.apache.org/jira/browse/HADOOP-14177?page=3Dcom.atlassi= an.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=3D15= 907517#comment-15907517 ]=20 Allen Wittenauer commented on HADOOP-14177: ------------------------------------------- A locale isn't set in the Dockerfile so that users may set their own manual= ly after running start-build-env.sh. > hadoop-build fails to handle non-english UTF-8 characters=20 > ---------------------------------------------------------- > > Key: HADOOP-14177 > URL: https://issues.apache.org/jira/browse/HADOOP-14177 > Project: Hadoop Common > Issue Type: Bug > Components: build > Reporter: vincent he > Priority: Minor > Attachments: HADOOP-14177.001.patch > > > as this [link | http://askubuntu.com/questions/581458/how-to-configure-lo= cales-to-unicode-in-a-docker-ubuntu-14-04-container] shows, ubuntu:trusty w= hich hadoop-build image build from does not specify any encoding, eg. UTF-8= . so not english characters will show incorrect and may fail the build. > current: > hewenxin@24a74cc3053b:~/hadoop$ ll zdh-hdfs-autotests/cases/ > total 284 > drwxr-xr-x 2 hewenxin users 4096 Mar 13 05:51 ./ > drwxr-xr-x 7 hewenxin users 4096 Mar 11 08:28 ../ > -rw-r--r-- 1 hewenxin users 3749 Mar 3 09:50 Y01.???????????????.robot > -rw-r--r-- 1 hewenxin users 2060 Feb 27 05:20 Z00.????????????.robot > -rw-r--r-- 1 hewenxin users 1102 Feb 27 05:20 Z00.????????????.robot.defi= ne > -rw-r--r-- 1 hewenxin users 1308 Feb 27 08:46 Z01.??????????????????.robo= t > -rw-r--r-- 1 hewenxin users 1365 Feb 27 05:20 Z02.HttpFS????????????.robo= t > -rw-r--r-- 1 hewenxin users 1353 Feb 27 05:20 Z03.???????????????????????= ?.robot > -rw-r--r-- 1 hewenxin users 2928 Feb 27 08:46 Z04.???????????????.robot > -rw-r--r-- 1 hewenxin users 1534 Mar 1 05:48 Z05.????????????.robot > -rw-r--r-- 1 hewenxin users 1260 Feb 27 05:20 Z06.??????????????????.robo= t > -rw-r--r-- 1 hewenxin users 1322 Feb 27 05:20 Z06.??????????????????.robo= t > -rw-r--r-- 1 hewenxin users 198 Feb 27 05:20 Z07.balance????????????????= ?????.robot > -rw-r--r-- 1 hewenxin users 915 Feb 27 05:20 Z08.hdfs???????????????????= ????????.robot > -rw-r--r-- 1 hewenxin users 920 Mar 1 05:48 Z09.?????????JMX???????????= ?.robot > -rw-r--r-- 1 hewenxin users 198 Feb 27 05:20 Z10.hdfs??????????????????.= robot > -rw-r--r-- 1 hewenxin users 198 Feb 27 05:20 Z11.hdfs???????????????.rob= ot > -rw-r--r-- 1 hewenxin users 198 Feb 27 05:20 Z12.???????????????.robot > -rw-r--r-- 1 hewenxin users 198 Feb 27 05:20 Z13.datanode????????????.ro= bot > -rw-r--r-- 1 hewenxin users 198 Feb 27 05:20 Z14.journal????????????.rob= ot > -rw-r--r-- 1 hewenxin users 1246 Mar 1 05:48 Z15.hdfs???????????????????= ????????.robot > -rw-r--r-- 1 hewenxin users 169 Feb 27 05:20 Z16.???????????????????????= ??????????.robot > -rw-r--r-- 1 hewenxin users 169 Feb 27 05:20 Z17.JMX????????????????????= ????.robot > -rw-r--r-- 1 hewenxin users 169 Feb 27 05:20 Z18.??????krb??????????????= ??????????.robot > -rw-r--r-- 1 hewenxin users 198 Feb 27 05:20 Z99.hdfs???????????????.rob= ot > after modified: > hewenxin@836ade384c62:~/hadoop$ ll zdh-hdfs-autotests/cases/ > total 284 > drwxr-xr-x 2 hewenxin users 4096 Mar 13 05:51 ./ > drwxr-xr-x 7 hewenxin users 4096 Mar 11 08:28 ../ > -rw-r--r-- 1 hewenxin users 3749 Mar 3 09:50 Y01.=E7=A3=81=E7=9B=98=E7= =83=AD=E6=8F=92=E6=8B=94.robot > -rw-r--r-- 1 hewenxin users 2060 Feb 27 05:20 Z00.=E5=BF=83=E8=B7=B3=E4= =B8=8A=E6=8A=A5.robot > -rw-r--r-- 1 hewenxin users 1102 Feb 27 05:20 Z00.=E5=BF=83=E8=B7=B3=E4= =B8=8A=E6=8A=A5.robot.define > -rw-r--r-- 1 hewenxin users 1308 Feb 27 08:46 Z01.=E5=9F=BA=E6=9C=AC=E5= =8A=9F=E8=83=BD=E5=86=92=E7=83=9F.robot > -rw-r--r-- 1 hewenxin users 1365 Feb 27 05:20 Z02.HttpFS=E5=8A=9F=E8=83= =BD=E6=B5=8B=E8=AF=95.robot > -rw-r--r-- 1 hewenxin users 1353 Feb 27 05:20 Z03.=E6=97=A5=E5=BF=97=E7= =BA=A7=E5=88=AB=E5=8A=A8=E6=80=81=E8=B0=83=E6=95=B4.robot > -rw-r--r-- 1 hewenxin users 2928 Feb 27 08:46 Z04.=E5=A4=9A=E7=BA=BF=E7= =A8=8B=E6=8B=B7=E8=B4=9D.robot > -rw-r--r-- 1 hewenxin users 1534 Mar 1 05:48 Z05.=E6=8C=87=E6=A0=87=E4= =B8=8A=E6=8A=A5.robot > -rw-r--r-- 1 hewenxin users 1260 Feb 27 05:20 Z06.=E5=AE=B9=E7=81=BE=E5= =8A=9F=E8=83=BD=E6=B5=8B=E8=AF=95.robot > -rw-r--r-- 1 hewenxin users 1322 Feb 27 05:20 Z06.=E5=BF=AB=E7=85=A7=E5= =8A=9F=E8=83=BD=E6=B5=8B=E8=AF=95.robot > -rw-r--r-- 1 hewenxin users 198 Feb 27 05:20 Z07.balance=E9=80=9F=E7=8E= =87=E5=8F=AF=E8=B0=83=E8=8A=82=E4=BC=98=E5=8C=96.robot > -rw-r--r-- 1 hewenxin users 915 Feb 27 05:20 Z08.hdfs=E6=99=BA=E8=83=BD= =E9=85=8D=E7=BD=AE=E6=9C=80=E5=A4=A7=E5=9D=8F=E7=9B=98=E6=95=B0.robot > -rw-r--r-- 1 hewenxin users 920 Mar 1 05:48 Z09.=E5=85=83=E6=95=B0=E6= =8D=AEJMX=E4=B8=8A=E6=8A=A5=E6=B5=8B=E8=AF=95.robot > -rw-r--r-- 1 hewenxin users 198 Feb 27 05:20 Z10.hdfs=E7=9A=84=E7=99=BD= =E5=90=8D=E5=8D=95=E5=8A=9F=E8=83=BD.robot > -rw-r--r-- 1 hewenxin users 198 Feb 27 05:20 Z11.hdfs=E6=95=85=E9=9A=9C= =E5=9F=9F=E5=8A=9F=E8=83=BD.robot > -rw-r--r-- 1 hewenxin users 198 Feb 27 05:20 Z12.=E7=A3=81=E7=9B=98=E7= =83=AD=E6=8F=92=E6=8B=94.robot > -rw-r--r-- 1 hewenxin users 198 Feb 27 05:20 Z13.datanode=E7=9A=84=E7=BC= =A9=E6=89=A9=E5=AE=B9.robot > -rw-r--r-- 1 hewenxin users 198 Feb 27 05:20 Z14.journal=E7=9A=84=E7=BC= =A9=E6=89=A9=E5=AE=B9.robot > -rw-r--r-- 1 hewenxin users 1246 Mar 1 05:48 Z15.hdfs=E8=BF=9B=E7=A8=8B= =E5=86=85=E5=AD=98=E4=BD=BF=E7=94=A8=E7=99=BE=E5=88=86=E6=AF=94.robot > -rw-r--r-- 1 hewenxin users 169 Feb 27 05:20 Z16.=E5=AE=A1=E8=AE=A1=E6= =97=A5=E5=BF=97=E6=94=AF=E6=8C=81=E8=87=AA=E5=AE=9A=E4=B9=89=E5=88=97=E8=A1= =A8.robot > -rw-r--r-- 1 hewenxin users 169 Feb 27 05:20 Z17.JMX=E4=B8=8A=E6=8A=A5= =E7=89=88=E6=9C=AC=E6=9E=84=E5=BB=BA=E6=97=B6=E9=97=B4.robot > -rw-r--r-- 1 hewenxin users 169 Feb 27 05:20 Z18.=E6=94=AF=E6=8C=81krb= =E4=B8=8B=E6=8E=A7=E5=88=B6=E5=8F=B0=E6=B5=8F=E8=A7=88=E6=96=87=E4=BB=B6.ro= bot > -rw-r--r-- 1 hewenxin users 198 Feb 27 05:20 Z99.hdfs=E5=AE=A2=E6=88=B7= =E7=AB=AF=E9=83=A8=E7=BD=B2.robot -- This message was sent by Atlassian JIRA (v6.3.15#6346) --------------------------------------------------------------------- To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org For additional commands, e-mail: common-issues-help@hadoop.apache.org