hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Eric Yang (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (YARN-8365) Revisit the record type used by Registry DNS for upstream resolution
Date Fri, 25 May 2018 21:13:00 GMT

    [ https://issues.apache.org/jira/browse/YARN-8365?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16491273#comment-16491273
] 

Eric Yang commented on YARN-8365:
---------------------------------

[~shanekumpf@gmail.com] We have several options:

Option 1, default lookup to A CNAME PTR SOA MX only for remote lookup.
Option 2, lookup through the query type, and return the first found record:
A NS MD MF CNAME SOA MB MG MR NULL WKS PTR HINFO MINFO MX TXT
Option 3, lookup any and fall back to A NS MD MF CNAME SOA MB MG MR NULL WKS PTR HINFO MINFO
MX TXT

Option 1 reduces the lookup time, and option 3 is most compatible.

> Revisit the record type used by Registry DNS for upstream resolution
> --------------------------------------------------------------------
>
>                 Key: YARN-8365
>                 URL: https://issues.apache.org/jira/browse/YARN-8365
>             Project: Hadoop YARN
>          Issue Type: Bug
>          Components: yarn-native-services
>            Reporter: Shane Kumpf
>            Priority: Major
>
> YARN-7326 leveraged the ANY record type for upstream resolution, but some implementations
[don't support ANY|https://tools.ietf.org/html/draft-ietf-dnsop-refuse-any-06] due to the
potential for abuse, namely Cloudflare. Docker Hub leverages Cloudflare for image distribution,
so when Registry DNS is used as the sole resolver, docker image downloads are failing. 
> {code:java}
> [root@host ~]# docker run -u root -it centos bash
> Unable to find image 'centos:latest' locally
> latest: Pulling from library/centos
> 469cfcc7a4b3: Already exists
> docker: error pulling image configuration: Get https://production.cloudflare.docker.com/registry-v2/docker/registry/v2/blobs/sha256/e9/e934aafc22064b7322c0250f1e32e5ce93b2d19b356f4537f5864bd102e8531f/data?verify=1527265495-nG8jk%2Bya9qrdPVlXRKGMnOhSnV0%3D:
dial tcp: lookup production.cloudflare.docker.com on registry.dns.host:53: no such host.
> {code}
> {code:java}
> [root@host~]# nslookup production.cloudflare.docker.com registry.dns.host
> Server:		registry.dns.host
> Address:	registry.dns.host#53
> Non-authoritative answer:
> production.cloudflare.docker.com	hinfo = "ANY obsoleted" "See draft-ietf-dnsop-refuse-any"
> {code}



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org


Mime
View raw message