hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Steve Loughran (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (YARN-2677) registry punycoding of usernames doesn't fix all usernames to be DNS-valid
Date Fri, 10 Oct 2014 19:45:36 GMT

    [ https://issues.apache.org/jira/browse/YARN-2677?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14167385#comment-14167385
] 

Steve Loughran commented on YARN-2677:
--------------------------------------

SLIDER-500 picked this up:
{code}
ServiceRecord{description='Slider Application Master'; external endpoints: {Endpoint{api='org.apache.slider.appmaster',
addressType='host/port', protocolType='hadoop/protobuf', addresses=[ [ "ts-oracle6-uns-accumulo-slider-1010-4.cs1cloud.internal"
"50767" ] ] }; Endpoint{api='org.apache.http.UI', addressType='uri', protocolType='webui',
addresses=[ [ "http://ts-oracle6-uns-accumulo-slider-1010-4.cs1cloud.internal:40805" ] ] };
Endpoint{api='org.apache.slider.management', addressType='uri', protocolType='REST', addresses=[
[ "http://ts-oracle6-uns-accumulo-slider-1010-4.cs1cloud.internal:40805/ws/v1/slider/mgmt"
] ] }; Endpoint{api='org.apache.slider.publisher', addressType='uri', protocolType='REST',
addresses=[ [ "http://ts-oracle6-uns-accumulo-slider-1010-4.cs1cloud.internal:40805/ws/v1/slider/publisher"
] ] }; Endpoint{api='org.apache.slider.registry', addressType='uri', protocolType='REST',
addresses=[ [ "http://ts-oracle6-uns-accumulo-slider-1010-4.cs1cloud.internal:40805/ws/v1/slider/registry"
] ] }; Endpoint{api='org.apache.slider.publisher.configurations', addressType='uri', protocolType='REST',
addresses=[ [ "http://ts-oracle6-uns-accumulo-slider-1010-4.cs1cloud.internal:40805/ws/v1/slider/publisher/slider"
] ] }; }; internal endpoints: {Endpoint{api='org.apache.slider.agents.secure', addressType='uri',
protocolType='REST', addresses=[ [ "https://ts-oracle6-uns-accumulo-slider-1010-4.cs1cloud.internal:55485/ws/v1/slider/agents"
] ] }; Endpoint{api='org.apache.slider.agents.oneway', addressType='uri', protocolType='REST',
addresses=[ [ "https://ts-oracle6-uns-accumulo-slider-1010-4.cs1cloud.internal:55688/ws/v1/slider/agents"
] ] }; }, attributes: {"yarn:persistence"="application" "yarn:id"="application_1412950151590_0009"
}}Exception: `/users/hrt_qa/services/org-apache-slider/test-slider-accumulo-continuous-ingest':
Invalid Path element "hrt_qa"14/10/10 15:44:53 ERROR main.ServiceLauncher: Exception: `/users/hrt_qa/services/org-apache-slider/test-slider-accumulo-continuous-ingest':
Invalid Path element "hrt_qa"org.apache.hadoop.registry.client.exceptions.InvalidPathnameException:
`/users/hrt_qa/services/org-apache-slider/test-slider-accumulo-continuous-ingest': Invalid
Path element "hrt_qa"
        at org.apache.hadoop.registry.client.binding.RegistryPathUtils.validateElementsAsDNS(RegistryPathUtils.java:78)
        at org.apache.hadoop.registry.client.impl.zk.RegistryOperationsService.validatePath(RegistryOperationsService.java:91)
        at org.apache.hadoop.registry.client.impl.zk.RegistryOperationsService.delete(RegistryOperationsService.java:151)
        at org.apache.slider.server.services.yarnregistry.YarnRegistryViewForProviders.putService(YarnRegistryViewForProviders.java:138)
        at org.apache.slider.server.appmaster.SliderAppMaster.registerServiceInstance(SliderAppMaster.java:1002)
        at org.apache.slider.server.appmaster.SliderAppMaster.createAndRunCluster(SliderAppMaster.java:846)
        at org.apache.slider.server.appmaster.SliderAppMaster.runService(SliderAppMaster.java:507)
        at org.apache.slider.core.main.ServiceLauncher.launchService(ServiceLauncher.java:186)
        at org.apache.slider.core.main.ServiceLauncher.launchServiceRobustly(ServiceLauncher.java:471)
        at org.apache.slider.core.main.ServiceLauncher.launchServiceAndExit(ServiceLauncher.java:401)
        at org.apache.slider.core.main.ServiceLauncher.serviceMain(ServiceLauncher.java:626)
        at org.apache.slider.server.appmaster.SliderAppMaster.main(SliderAppMaster.java:2124)14/10/10
15:44:53 INFO util.ExitUtil: Exiting with status 3214/10/10 15:44:53 INFO mortbay.log: Shutdown
hook executing14/10/10 15:44:53 INFO mortbay.log: Stopped SslSelectChannelConnector@0.0.0.0:5548514/10/10
15:44:53 INFO mortbay.log: Stopped SslSelectChannelConnector@0.0.0.0:55688
{code}

> registry punycoding of usernames doesn't fix all usernames to be DNS-valid
> --------------------------------------------------------------------------
>
>                 Key: YARN-2677
>                 URL: https://issues.apache.org/jira/browse/YARN-2677
>             Project: Hadoop YARN
>          Issue Type: Sub-task
>          Components: api, resourcemanager
>    Affects Versions: 2.6.0
>            Reporter: Steve Loughran
>            Assignee: Steve Loughran
>
> The registry has a restriction "DNS-valid names only" to retain the future option of
DNS exporting of the registry.
> to handle complex usernames, it punycodes the username first, using Java's {{java.net.IDN}}
class.
> This turns out to only map high unicode-> ASCII, and does nothing for ascii-but-invalid-hostname
chars, so stopping users with DNS-illegal names (e.g. with an underscore in them) from being
able to register



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message