Reply-To: dev@tez.incubator.apache.org Delivered-To: mailing list commits@tez.incubator.apache.org Received: (qmail 20164 invoked by uid 99); 6 Nov 2013 22:32:36 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 06 Nov 2013 22:32:36 +0000 X-ASF-Spam-Status: No, hits=-2000.0 required=5.0 tests=ALL_TRUSTED X-Spam-Check-By: apache.org Received: from [140.211.11.4] (HELO eris.apache.org) (140.211.11.4) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 06 Nov 2013 22:32:28 +0000 Received: from eris.apache.org (localhost [127.0.0.1]) by eris.apache.org (Postfix) with ESMTP id A6E7E23888E7; Wed, 6 Nov 2013 22:32:05 +0000 (UTC) Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Subject: svn commit: r1539485 - in /incubator/tez/site: index.html install.html issue-tracking.html license.html mail-lists.html privacy-policy.html project-info.html talks.html team-list.html Date: Wed, 06 Nov 2013 22:32:05 -0000 To: commits@tez.incubator.apache.org From: hitesh@apache.org X-Mailer: svnmailer-1.0.9 Message-Id: <20131106223205.A6E7E23888E7@eris.apache.org> X-Virus-Checked: Checked by ClamAV on apache.org Author: hitesh Date: Wed Nov 6 22:32:04 2013 New Revision: 1539485 URL: http://svn.apache.org/r1539485 Log: Update docs to reflect addition of issues mailing list. Modified: incubator/tez/site/index.html incubator/tez/site/install.html incubator/tez/site/issue-tracking.html incubator/tez/site/license.html incubator/tez/site/mail-lists.html incubator/tez/site/privacy-policy.html incubator/tez/site/project-info.html incubator/tez/site/talks.html incubator/tez/site/team-list.html Modified: incubator/tez/site/index.html URL: http://svn.apache.org/viewvc/incubator/tez/site/index.html?rev=1539485&r1=1539484&r2=1539485&view=diff ============================================================================== --- incubator/tez/site/index.html (original) +++ incubator/tez/site/index.html Wed Nov 6 22:32:04 2013 @@ -1,15 +1,15 @@ - + - + Tez - @@ -145,7 +145,7 @@ -

Last Published: 2013-08-08

Last Published: 2013-11-06

Version: 0.2.0-SNAPSHOT

@@ -279,7 +279,27 @@

Introduction

The Apache Tez project is aimed at buildi ng an application framework which allows for a complex directed-acyclic-graph of tasks for processing data. It is currently built atop Apache Hadoop YARN

The 2 main design themes for Tez are:

Empowering end users by:
- Expressive dataflow definition APIs
- Flexible Input-Processor-Output runtime model
- Data type agnostic
- Simplifying deployment
Execution Performance
- Performance gains over Map Reduce
- Optimal resource management
- Plan reconfiguration at runtime
- Dynamic physical data flow decisions

By allowing projects like Apache Hive and Apache Pig to run a complex DAG of tasks, Tez can be used to process data, that earlier took multiple MR jobs, now in a single Tez job as shown below.

Flow for a Hive
or Pig Query on MapReduce

Disclaimer

Apache Tez is an effort currently undergoing incubation at The Apache Software Foundation (ASF) sponsored by the Apache Incubator PMC.

Introduction

The Apache Tez project is aimed at building an application framework which allows for a complex directed-acyclic-graph of tasks for processing data. It is currently built atop Apache Hadoop YARN

The 2 main design themes for Tez are:

Empowering end users by: +
- Expressive dataflow definition APIs
- Flexible Input-Processor-Output runtime model
- Data type agnostic
- Simplifying deployment
Execution Performance +
- Performance gains over Map Reduce
- Optimal resource management
- Plan reconfiguration at runtime
- Dynamic physical data flow decisions

By allowing projects like Apache Hive and Apache Pig to run a complex DAG of tasks, Tez can be used to process data, that earlier took multiple MR jobs, now in a single Tez job as shown below.

Disclaimer

Apache Tez is an effort currently undergoing incubation at The Apache Software Foundation (ASF) sponsored by the Apache Incubator PMC.

Modified: incubator/tez/site/install.html URL: http://svn.apache.org/viewvc/incubator/tez/site/install.html?rev=1539485&r1=1539484&r2=1539485&view=diff ============================================================================== --- incubator/tez/site/install.html (original) +++ incubator/tez/site/install.html Wed Nov 6 22:32:04 2013 @@ -1,15 +1,15 @@ - + - + Tez - @@ -145,7 +145,7 @@ -

Last Published: 2013-08-08

Last Published: 2013-11-06

Version: 0.2.0-SNAPSHOT

@@ -279,7 +279,27 @@

Install/Deploy Instructions

Deploy Apache Hadoop using either the 2.1.0-beta release or build the 3.0.0-SNAPSHOT from trunk.
- One thing to note though when compiling Tez is that you will need to change the value of the hadoop.version property in the top-level pom.xml to match the version of the hadoop branch being used.
Copy the tez jars and their dependencies into HDFS.
Configure tez-site.xml to set tez.lib.uris to point to the paths in HDFS containing the jars. Please note that the paths are not searched recursively so for basedir and basedir/lib/, you will need to configure the 2 paths as a comma-separated list.
Modify mapred-site.xml to change "mapreduce.framework.name" property from its default value of "yarn" to "yarn-tez"
Set HADOOP_CLASSPATH to have the following paths in it:
- TEZ_CONF_DIR - location of tez-site.xml
- TEZ_JARS and TEZ_JARS/libs - location of the tez jars and dependencies.
Submit a MR job as you normally would using something like:
```
$HADOOP_PREFIX/bin/hadoop jar hadoop-mapreduce-client-jobclient-VERSION-tests.jar sleep -mt 1 -rt 1 -m 1 -r 1
```
This will use the TEZ DAG ApplicationMaster to run the MR job. This can be verified by looking at the AM's logs from the YARN ResourceManager UI.
There is a basic example of using an MRR job in the tez-mapreduce-examples.jar. Refer to OrderedWordCount.java in the source code. To run this example:
```
$HADOOP_PREFIX/bin/hadoop jar tez-mapreduce-examples.jar orderedwordcount <input> <output>
```
This will use the TEZ DAG ApplicationMaster to run the ordered word count job. This job is similar to the word count example except that it also orders all words based on the frequency of occurrence.

Install/Deploy Instructions

Deploy Apache Hadoop using either the 2.1.0-beta release or build the 3.0.0-SNAPSHOT from trunk. +
- One thing to note though when compiling Tez is that you will need to change the value of the hadoop.version property in the top-level pom.xml to match the version of the hadoop branch being used.
Copy the tez jars and their dependencies into HDFS.
Configure tez-site.xml to set tez.lib.uris to point to the paths in HDFS containing the jars. Please note that the paths are not searched recursively so for basedir and basedir/lib/, you will need to configure the 2 paths as a comma-separated list.
Modify mapred-site.xml to change "mapreduce.framework.name" property from its default value of "yarn" to "yarn-tez"
Set HADOOP_CLASSPATH to have the following paths in it: +
- TEZ_CONF_DIR - location of tez-site.xml
- TEZ_JARS and TEZ_JARS/libs - location of the tez jars and dependencies.
Submit a MR job as you normally would using something like: +
+
```
$HADOOP_PREFIX/bin/hadoop jar hadoop-mapreduce-client-jobclient-VERSION-tests.jar sleep -mt 1 -rt 1 -m 1 -r 1
```
+
This will use the TEZ DAG ApplicationMaster to run the MR job. This can be verified by looking at the AM's logs from the YARN ResourceManager UI.
There is a basic example of using an MRR job in the tez-mapreduce-examples.jar. Refer to OrderedWordCount.java in the source code. To run this example: +
+
```
$HADOOP_PREFIX/bin/hadoop jar tez-mapreduce-examples.jar orderedwordcount <input> <output>
```
+
This will use the TEZ DAG ApplicationMaster to run the ordered word count job. This job is similar to the word count example except that it also orders all words based on the frequency of occurrence.

Modified: incubator/tez/site/issue-tracking.html URL: http://svn.apache.org/viewvc/incubator/tez/site/issue-tracking.html?rev=1539485&r1=1539484&r2=1539485&view=diff ============================================================================== --- incubator/tez/site/issue-tracking.html (original) +++ incubator/tez/site/issue-tracking.html Wed Nov 6 22:32:04 2013 @@ -1,15 +1,15 @@ - + - Issue Tracking + Tez - Issue Tracking @@ -145,7 +145,7 @@ -

Last Published: 2013-08-08

Last Published: 2013-11-06

Version: 0.2.0-SNAPSHOT

@@ -279,7 +279,14 @@

Overview

This project uses JIRA a J2EE-based, issue tracking and project management application.

Issue Tracking

Issues, bugs, and feature requests should be submitted to the following issue tracking system for this project.

http://issues.apache.org/jira/browse/TEZ

Overview

This project uses JIRA a J2EE-based, issue tracking and project management application.

Issue Tracking

Issues, bugs, and feature requests should be submitted to the following issue tracking system for this project.

http://issues.apache.org/jira/browse/TEZ

Modified: incubator/tez/site/license.html URL: http://svn.apache.org/viewvc/incubator/tez/site/license.html?rev=1539485&r1=1539484&r2=1539485&view=diff ============================================================================== --- incubator/tez/site/license.html (original) +++ incubator/tez/site/license.html Wed Nov 6 22:32:04 2013 @@ -1,15 +1,15 @@ - + - Project License + Tez - Project License @@ -145,7 +145,7 @@ -

Last Published: 2013-08-08

Last Published: 2013-11-06

Version: 0.2.0-SNAPSHOT

@@ -280,7 +280,15 @@

Overview

Typically the licenses listed for the project are that of the project itself, and not of dependencies.

Project License

Apache 2

+                      
+Overview

+Typically the licenses listed for the project are that of the project itself, and not of dependencies.
+
+Project License

+
+Apache 2

+
+                                  Apache License
                            Version 2.0, January 2004
                         http://www.apache.org/licenses/

Modified: incubator/tez/site/mail-lists.html
URL: http://svn.apache.org/viewvc/incubator/tez/site/mail-lists.html?rev=1539485&r1=1539484&r2=1539485&view=diff
==============================================================================
--- incubator/tez/site/mail-lists.html (original)
+++ incubator/tez/site/mail-lists.html Wed Nov  6 22:32:04 2013
@@ -1,15 +1,15 @@
 
 
 
   
     
     
-    
+    
     
-    Project Mailing Lists
+    Tez - Project Mailing Lists
     
     
     
@@ -145,7 +145,7 @@
         
                 
                     
-                  Last Published: 2013-08-08
 |
+                  Last Published: 2013-11-06
 |
               Version: 0.2.0-SNAPSHOT
             
                             
@@ -279,7 +279,40 @@
                         
         
                                   
-            Project Mailing Lists
These are the mailing lists that have been established for this project. For each list, there is a subscribe, unsubscribe, and an archive link.
Name Subscribe Unsubscribe Post Archive
User list Subscribe Unsubscribe Post -
Development list Subscribe Unsubscrib
 e Post -
Commit list Subscribe Unsubscribe Post -
+            
+Project Mailing Lists

+These are the mailing lists that have been established for this project. For each list, there is a subscribe, unsubscribe, and an archive link.
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+Name Subscribe Unsubscribe Post Archive
User list Subscribe Unsubscribe Post -
Development list Subscribe Unsubscribe Post -
Commit list Subscribe Unsubscribe Post -
JIRA Issues list Subscribe Unsubscribe Post -
                   
             
           

Modified: incubator/tez/site/privacy-policy.html
URL: http://svn.apache.org/viewvc/incubator/tez/site/privacy-policy.html?rev=1539485&r1=1539484&r2=1539485&view=diff
==============================================================================
--- incubator/tez/site/privacy-policy.html (original)
+++ incubator/tez/site/privacy-policy.html Wed Nov  6 22:32:04 2013
@@ -1,6 +1,6 @@
 
 
 
@@ -9,9 +9,9 @@
     
     
     
-    
+    
     
-    Privacy Policy
+    Tez - Privacy Policy
     
     
     
@@ -147,7 +147,7 @@
         
                 
                     
-                  Last Published: 2013-08-08
 |
+                  Last Published: 2013-11-06
 |
               Version: 0.2.0-SNAPSHOT
             
                             
@@ -283,7 +283,18 @@
                         
         
                                   
-            Privacy Policy
Information about your use of this website is collected using server access logs and a tracking cookie. The collected information consists of the following:
The IP address from which you access the website;
The type of browser and operating system you use to access our site;
The date and time you access our site;
The pages you visit; and
The addresses of pages from where you followed a link to our site.
Part of this information is gathered using a tracking cookie set by the Google Analytics service and handled by Google as described in their privacy policy. See your browser documentation for instructions on how to disable the cookie if you prefer not to share this dat
 a with Google.
We use the gathered information to help us make our site more useful to visitors and to better understand how and when our site is used. We do not track or collect personally identifiable information or associate gathered data with any personally identifying information from other sources.
By using this website, you consent to the collection of this data in the manner and for the purpose described above.
+            
+Privacy Policy
+Information about your use of this website is collected using server access logs and a tracking cookie. The collected information consists of the following:
+
+The IP address from which you access the website;
+The type of browser and operating system you use to access our site;
+The date and time you access our site;
+The pages you visit; and
+The addresses of pages from where you followed a link to our site.
+Part of this information is gathered using a tracking cookie set by the Google Analytics service and handled by Google as described in their privacy policy. See your browser documentation for instructions on how to disable the cookie if you prefer not to share this data with Google.
+We use the gathered information to help us make our site more useful to visitors and to better understand how and when our site is used. We do not track or collect personally identifiable information or associate gathered data with any personally identifying information from other sources.
+By using this website, you consent to the collection of this data in the manner and for the purpose described above.

Name	Subscribe	Unsubscribe	Post	Archive
User list	Subscribe	Unsubscribe	Post	-
Development list	Subscribe	Unsubscrib e	Post	-
Commit list	Subscribe	Unsubscribe	Post	-

Name	Subscribe	Unsubscribe	Post	Archive
User list	Subscribe	Unsubscribe	Post	-
Development list	Subscribe	Unsubscribe	Post	-
Commit list	Subscribe	Unsubscribe	Post	-
JIRA Issues list	Subscribe	Unsubscribe	Post	-

Modified: incubator/tez/site/project-info.html URL: http://svn.apache.org/viewvc/incubator/tez/site/project-info.html?rev=1539485&r1=1539484&r2=1539485&view=diff ============================================================================== --- incubator/tez/site/project-info.html (original) +++ incubator/tez/site/project-info.html Wed Nov 6 22:32:04 2013 @@ -1,15 +1,15 @@ - + - Project Information + Tez - Project Information @@ -145,7 +145,7 @@ -

Last Published: 2013-08-08

Last Published: 2013-11-06

Version: 0.2.0-SNAPSHOT

@@ -281,7 +281,27 @@

Project Information

This document provides an overview of the various documents and links that are part of this project's general information. All of this content is automatically generated by Maven on behalf of the project.

Overview

Document	Description
Project Team	This document provides information on the members of this project. These are the individuals who have contributed to the project in one form or another.
Mailing Lists	This document provides subscription and archive information for this project's mailing lists.
Issue Tracking	This is a link to the issue management system for this project. Issues (bugs, features, change requests) can be created and queried using this link.
Project License	This is a link to the definitions of project licenses.

Project Information

Overview

+ + + + + + + + + + + + + + + +

Document	Description
Project Team	This document provides information on the members of this project. These are the individuals who have contributed to the project in one form or another.
Mailing Lists	This document provides subscription and archive information for this project's mailing lists.
Issue Tracking	This is a link to the issue management system for this project. Issues (bugs, features, change requests) can be created and queried using this link.
Project License	This is a link to the definitions of project licenses.

Modified: incubator/tez/site/talks.html URL: http://svn.apache.org/viewvc/incubator/tez/site/talks.html?rev=1539485&r1=1539484&r2=1539485&view=diff ============================================================================== --- incubator/tez/site/talks.html (original) +++ incubator/tez/site/talks.html Wed Nov 6 22:32:04 2013 @@ -1,15 +1,15 @@ - + - + Tez - @@ -145,7 +145,7 @@ -

Last Published: 2013-08-08

Last Published: 2013-11-06

Version: 0.2.0-SNAPSHOT

@@ -279,7 +279,17 @@

Talks

Apache Tez : Accelerating Hadoop Query Processing by Arun Murthy and Bikas Saha at Hadoop Summit 2013, San Jose, CA, USA
- Slides
- Video

User Meetup Recordings

Recording from Meetup on July 31st, 2013 at Hortonworks Inc

Talks

Apache Tez : Accelerating Hadoop Query Processing by Arun Murthy and Bikas Saha at Hadoop Summit 2013, San Jose, CA, USA +
- Slides
- Video

User Meetup Recordings

Recording from Meetup on July 31st, 2013 at Hortonworks Inc

Modified: incubator/tez/site/team-list.html URL: http://svn.apache.org/viewvc/incubator/tez/site/team-list.html?rev=1539485&r1=1539484&r2=1539485&view=diff ============================================================================== --- incubator/tez/site/team-list.html (original) +++ incubator/tez/site/team-list.html Wed Nov 6 22:32:04 2013 @@ -1,15 +1,15 @@ - + - Team list + Tez - Team list @@ -145,7 +145,7 @@ -

Last Published: 2013-08-08

Last Published: 2013-11-06

Version: 0.2.0-SNAPSHOT

@@ -279,7 +279,71 @@

The Team

A successful project requires many people to play many roles. Some members write code or documentation, while others are valuable as testers, submitting patches and suggestions.

The team is comprised of Members and Contributors. Members have direct access to the source of a project and actively evolve the code-base. Contributors improve the project through submission of patches and suggestions to the Members. The number of Contributors to the project is unbounded. Get involved today. All contributions to the project are greatly appreciated.

Members

The following is a list of developers with commit privileges that have directly contributed to the project in one way or another.

Id	Name	Email	Organization	Ro les	Time Zone	Actual Time (GMT)
acmurthy	Arun C Murthy	acmurthy@apache.org	Hortonworks	PMC	-8	-8
bikas	Bikas Saha	bikas@apache.org	Hortonworks	PMC	-8	-8
hitesh	Hitesh Shah	hitesh@apache.org	Hortonworks	PMC	-8	-8
mliddell	Mike Liddell	mliddell@apache.org	Microsoft	PMC	- 8	-8
sseth	Siddharth Seth	sseth@apache.org	Hortonworks	PMC	-8	-8

Contributors

There are no contributors listed for this project. Please check back again later.