hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Todd Lipcon <t...@cloudera.com>
Subject Re: [ANNOUNCE] Intend to build a 0.20.205.1 candidate next Friday 11 Nov.
Date Fri, 11 Nov 2011 22:27:54 GMT
On Fri, Nov 11, 2011 at 1:41 PM, Nathan Roberts <nroberts@yahoo-inc.com> wrote:
> Hi Matt,
>
> I propose the following for consideration for 0.20.205.1:
>
> https://issues.apache.org/jira/browse/HADOOP-7816 Allow Hadoop warning suppression to
be specified in config
> + Improves workaround for a common usability complaint
>
> https://issues.apache.org/jira/browse/MAPREDUCE-2980- Fetch failures and other related
issues in Jetty 6.1.26.
> + The issues continues to be a source of significant operational pain
>

The jetty version proposed in that JIRA doesn't actually fix the
problem entirely. We've seen at least one more case of a spinning TT
in test clusters with the "6.1.26.1" version mentioned there. The
workaround we plan to use in CDH is MAPREDUCE-3184 (TT will monitor
itself for this condition and commit suicide when it finds it)

> https://issues.apache.org/jira/browse/HADOOP-7810 Move Hadoop archive to core from tools
> + Improves integration with pig and hcat that wish to use hadoop archives without having
to specifically callout the hadoop tools jar

This seems like an incompatible change - probably a bad idea for a dot
release of a dot release of a maintenance series....

>
> https://issues.apache.org/jira/browse/mapreduce-3118 Backport Gridmix and Rumen features
from trunk to Hadoop 20-Security
> + Originally slated  for 205.0 but missed original code freeze
> + Improves testability
>
> Thanks
> Nathan
>
> On 11/9/11 8:36 PM, "Matt Foley" <mfoley@hortonworks.com> wrote:
>
> Hi all,
> *So far, the following patches have been committed and accepted for
> inclusion in 0.20.205.1:*
>
>   *Key* *Assignee* *Reporter* *Summary*
> HADOOP-5124<https://issues.apache.org/jira/browse/HADOOP-5124> Hairong
> Kuang Hairong Kuang A few optimizations to FsNamesystem#RecentInvalidateSets
> HADOOP-6840 <https://issues.apache.org/jira/browse/HADOOP-6840> Jitendra
> Nath Pandey Nicolas Spiegelberg Support non-recursive create() in
> FileSystem & SequenceFile.Writer
> HADOOP-6886<https://issues.apache.org/jira/browse/HADOOP-6886>
> Unassigned Nicolas Spiegelberg LocalFileSystem Needs createNonRecursive API
> HADOOP-7664 <https://issues.apache.org/jira/browse/HADOOP-7664> Ravi
> Prakash Ravi
> Prakash o.a.h.conf.Configuration complains of overriding final parameter
> even if the value with which its attempting to override is the same.
> HADOOP-7711 <https://issues.apache.org/jira/browse/HADOOP-7711> Arpit
> Gupta Arpit
> Gupta hadoop-env.sh generated from templates has duplicate info
> HADOOP-7715<https://issues.apache.org/jira/browse/HADOOP-7715> Eric
> Yang Arpit Gupta see log4j Error when running mr jobs and certain dfs calls
> HADOOP-7728 <https://issues.apache.org/jira/browse/HADOOP-7728> Ramya
> Sunil Ramya
> Sunil hadoop-setup-conf.sh should be modified to enable task memory manager
> HADOOP-7740 <https://issues.apache.org/jira/browse/HADOOP-7740> Arpit
> Gupta Arpit
> Gupta security audit logger is not on by default, fix the log4j properties
> to enable the logger
> HADOOP-7765<https://issues.apache.org/jira/browse/HADOOP-7765> Eric
> Yang Eric Yang Debian package contain both system and tar ball layout
> HADOOP-7784 <https://issues.apache.org/jira/browse/HADOOP-7784> Eric Yang Arpit
> Gupta secure datanodes fail to come up stating jsvc not found
> HDFS-611<https://issues.apache.org/jira/browse/HDFS-611> Zheng
> Shao dhruba borthakur Heartbeats times from Datanodes increase when there
> are plenty of blocks to delete
> HDFS-617<https://issues.apache.org/jira/browse/HDFS-617> Kan
> Zhang Kan Zhang Support for non-recursive create() in HDFS
> HDFS-1257<https://issues.apache.org/jira/browse/HDFS-1257> Eric
> Payne Ramkumar Vadali Race condition on FSNamesystem#recentInvalidateSets
> introduced by HADOOP-5124
> HDFS-1943<https://issues.apache.org/jira/browse/HDFS-1943> Matt
> Foley Wei Yongjun fail to start datanode while start-dfs.sh is executed by
> root user  HDFS-2065 <https://issues.apache.org/jira/browse/HDFS-2065> Uma
> Maheswara Rao G Bharath Mundlapudi Fix NPE in DFSClient.getFileChecksum
> HDFS-2316 <https://issues.apache.org/jira/browse/HDFS-2316> Tsz Wo
> (Nicholas), SZE Tsz Wo (Nicholas), SZE webhdfs: a complete FileSystem
> implementation for accessing HDFS over HTTP [[and sub-tasks]]
> HDFS-2450<https://issues.apache.org/jira/browse/HDFS-2450> Daryn
> Sharp Rajit Saha Only complete hostname is supported to access data via
> hdfs://  MAPREDUCE-3374<https://issues.apache.org/jira/browse/MAPREDUCE-3374>
> Unassigned Roman Shaposhnik src/c++/task-controller/configure is not set
> executable in the tarball and that prevents task-controller from rebuilding
>
> *The following Jiras are targetted for 0.20.205.1, but have not yet been
> committed:*
>
>   *Key* *Assignee* *Reporter* *Summary*
> HADOOP-6453<https://issues.apache.org/jira/browse/HADOOP-6453> Matt
> Foley Chad Metcalf Hadoop wrapper script shouldn't ignore an existing
> JAVA_LIBRARY_PATH
> HADOOP-7732<https://issues.apache.org/jira/browse/HADOOP-7732>
> Unassigned Arpit Gupta hadoop java docs missing hdfs package
> HADOOP-7751<https://issues.apache.org/jira/browse/HADOOP-7751> Eric
> Yang Arpit Gupta rpm version is not being picked from the -Dversion option
> in 205  HADOOP-7804 <https://issues.apache.org/jira/browse/HADOOP-7804> Arpit
> Gupta Arpit Gupta enable hadoop config generator to set
> dfs.block.local-path-access.user to enable short circuit read
> HADOOP-7809<https://issues.apache.org/jira/browse/HADOOP-7809> Matt
> Foley Joydeep Sen Sarma Backport HADOOP-5839 to 0.20-security - fixes to
> ec2 scripts to allow remote job submission
> HDFS-2246<https://issues.apache.org/jira/browse/HDFS-2246>
> Unassigned Sanjay Radia Shortcut a local client reads to a Datanodes files
> directly  HDFS-2433 <https://issues.apache.org/jira/browse/HDFS-2433>
> Unassigned Robert Joseph Evans TestFileAppend4 fails intermittently
> MAPREDUCE-3343 <https://issues.apache.org/jira/browse/MAPREDUCE-3343>
> Unassigned Ahmed Radwan TaskTracker Out of Memory because of distributed
> cache
>
> *Please review the items you are interested in, and complete all items by
> Friday for the rc0 build.*
>
> Also, two unit tests are failing in the nightly builds.  They passed in
> Build #70 (Nov 4, 2011 12:47:00 AM GMT).
> Please take a look if you committed to 205 branch after that time:
>    org.apache.hadoop.streaming.TestUlimit.testCommandLine<https://builds.apache.org/view/G-L/view/Hadoop/job/Hadoop-0.20.205-Build/76/testReport/org.apache.hadoop.streaming/TestUlimit/testCommandLine/>
>
>    org.apache.hadoop.mapred.TestJvmReuse.testTaskLogs<https://builds.apache.org/view/G-L/view/Hadoop/job/Hadoop-0.20.205-Build/76/testReport/org.apache.hadoop.mapred/TestJvmReuse/testTaskLogs/>
>
>
> Thank you,
> --Matt (Release Manager)
>
>
> On Fri, Nov 4, 2011 at 5:56 PM, Matt Foley <mattf@apache.org> wrote:
>
>> Hi all,
>> I propose to make a 0.20.205.1 candidate soon, with the following sets of
>> patches:
>>
>>    - deficiencies in HBase support, pointed out by the HBase team and
>>    others
>>    - deficiencies in webhdfs support on secure clusters
>>    - a couple last-minute fixes submitted to branch-0.20-security-205
>>    that were too late to be included in 205.0
>>
>> If you would like other patches included, and you feel it is appropriate
>> to have them in 205.1 rather than waiting for 206.0, please declare them by
>> setting the "Target Versions" field in their Jiras, and they will receive
>> due consideration, assuming that the proposed patch is actually
>> contributed, tested, reviewed, approved, and committed
>> to branch-0.20-security-205 by the freeze date :-)
>>
>> I would like to make the rc0 candidate next Friday, so I propose to
>> declare 205.1 code freeze at noon, PST, Friday 11 Nov.  If this is a
>> problem for anyone, please let me know.
>>
>> Thank you, and best regards,
>> --Matt (Release Manager)
>>
>>
>>
>
>



-- 
Todd Lipcon
Software Engineer, Cloudera

Mime
View raw message