hadoop-hdfs-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Vrushali Channapattan <vrushal...@gmail.com>
Subject [DISCUSS] Merging YARN-5355 (Timeline Service v.2) to trunk
Date Wed, 16 Aug 2017 17:02:48 GMT
Hi All

I’d like to open a discussion for merging Timeline Service v.2 (YARN-5355)
to trunk in a few weeks.

We have previously completed one merge onto trunk [1] and Timeline Service
v2 has been part of Hadoop release 3.0.0-alpha1.

Since then, we have been working on extending the capabilities of Timeline
Service v2 in a feature branch [2]. There are a few related issues pending
that are being actively worked upon & tested. As soon as they are resolved,
we plan on starting a merge vote within the next 2 weeks. The goal is to
get this in for Hadoop3 beta.

We have paid close attention to ensure that once disabled Timeline Service
v.2 does not impact existing functionality when disabled (by default).

At a high level, following are the key features that have been implemented
since 3.0.0-alpha1:
- Security (via Kerberos Authentication & delegation tokens) at the writer
[YARN-3053]
- Timeline server usability improvements [timeline-server
<https://issues.apache.org/jira/browse/YARN-5715?jql=project%20%3D%20YARN%20AND%20fixVersion%20%3D%20YARN-5355%20AND%20component%20%3D%20timelineserver%20AND%20labels%20%21%3D%20atsv2-hbase%20ORDER%20BY%20updated%20ASC%2C%20priority%20DESC%2C%20created%20ASC>
]
- HBase specific improvements [atsv2-hbase
<https://issues.apache.org/jira/browse/YARN-6604?jql=project%20%3D%20YARN%20AND%20fixVersion%20%3D%20YARN-5355%20AND%20labels%20%3D%20atsv2-hbase%20ORDER%20BY%20updated%20DESC%2C%20affectedVersion%20DESC%2C%20priority%20DESC%2C%20created%20ASC>
]
- REST API additions & improvements [timeline-reader
<https://issues.apache.org/jira/browse/YARN-5739?jql=project%20%3D%20YARN%20AND%20fixVersion%20%3D%20YARN-5355%20AND%20component%20in%20%28timelineclient%2C%20timelinereader%29%20ORDER%20BY%20updated%20ASC%2C%20priority%20DESC%2C%20created%20ASC>
]
- Reader side simple authorization via whitelist [YARN-6820]

We would love to get your thoughts on these and more before we open a real
voting thread.

Special thanks to a team of folks who worked hard and contributed towards
this effort with patches, reviews and guidance: Rohith Sharma K S, Varun
Saxena, Haibo Chen, Sangjin Lee, Li Lu, Vinod Kumar Vavilapalli, Joep
Rottinghuis, Jason Lowe, Jian He, Robert Kanter, Micheal Stack.

Thanks!
Vrushali

[1] Merge to trunk: http://www.mail-archive.com/yarn-dev@hadoop.
apache.org/msg23897.html
[2] feature branch YARN-5355 commits: https://github.com/
apache/hadoop/commits/YARN-5355

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message