incubator-hama-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Apache Wiki <wikidi...@apache.org>
Subject [Hama Wiki] Update of "BigTableForGmail" by udanax
Date Thu, 04 Dec 2008 07:00:33 GMT
Dear Wiki user,

You have subscribed to a wiki page or wiki category on "Hama Wiki" for change notification.

The following page has been changed by udanax:
http://wiki.apache.org/hama/BigTableForGmail

------------------------------------------------------------------------------
- '''Notice:''' This is only my reasoning
+ == Architecture ==
+ {{{
+ - MDA : Mail Delivery Agent
  
+                                             +-----------------------------+
+                           +-----------+     |  Mail Frontend Web servers  |            
    * Client layer *
+                           |  Watcher  |     |   (web UI, send an mails)   |
+                           +-----+-----+     +------+---------------+------+
+                                 |                  |       ↑       |
+                                SMTP              read     data  sent mail
+                                 |               requests  reply   log
+          +--------------------------------------------------------------------------------------+

+          |                      ↓                  ↓       |       ↓             
              |
+          |              +--------------------------+----------------------+            
        |
+          |              | Broker Servers (MDA & Spam Filtering, ..., etc) +←--+  
          * Broker layer *
+          |              +--------------------------+----------------------+   |        
        |            
+          |                    ↑                    ↑               |          |    
            |
+          +--------------------+--------------------+---------------+----------+-----------------+
+                               |                    |               |          |
+                      Reads user profile       Read contents   Update contents |
+                               |                    |               ↓          |
+     +-----+-------------------+-----+    +---------+----------------------+   |        

+     |       Hbase:UserTable         |    |        Hbase:MIMETable         |   |
+     |     (user profile, logs)      |    |          (MIME data)           |   |        
    * Storage layer *
+     +-------------------------------+    +--------------------------------+   |
+                               ↑                    ↑                          |
+ +-----------------------------+--------------------+----------------------+   |
+ |  Hadoop: MapReduce Jobs (e.g. Log Analysis, SPAM calculation, .., etc)  |←--+
+ +-------------------------------------------------------------------------+
+ }}}
+ 
+ == Table Schema ==
+ 
- In the !BigTable, Row Key is a email address, a unique identifier and a Sender & Receiver.
Column families are meta data. (e.g. from, to, cc, bcc, reply-to, ..., etc)
+ Row Key is a email address, a unique identifier and a Sender & Receiver. Column families
are meta data. (e.g. from, to, cc, bcc, reply-to, ..., etc)
  
  {{{
                           From:                                              To: 
@@ -22, +53 @@

                                                     ...
  }}}
  
- == Social Email Graph ==
- 
- '''Notice:''' It is also only my reasoning
- 

Mime
View raw message