avro-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Doug Cutting (Commented) (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (AVRO-570) python implementation of mapreduce connector
Date Wed, 23 Nov 2011 23:24:40 GMT

    [ https://issues.apache.org/jira/browse/AVRO-570?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13156391#comment-13156391
] 

Doug Cutting commented on AVRO-570:
-----------------------------------

Finally looking at this.  The Java changes look reasonable and all Java tests pass for me.

Python tests fail with:

{code}

[py-test] ./home/cutting/src/avro/trunk/lang/py/build/src/avro/tether/tether_task_runner.py:24:
RuntimeWarning: Parent module 'avro.tether' not found while handling absolute import
  [py-test]   from avro import tether
  [py-test] INFO:root:tether_task_runner.__main__: Task: word_count_task.WordCountTask
  [py-test] INFO:TetherTask:TetherTask.open: Opening connection to parent server on port=42343
  [py-test] MockParentResponder: Recieved 'configure': inputPort=59800
  [py-test] localhost.localdomain - - [23/Nov/2011 15:15:17] "POST / HTTP/1.1" 200 -
  [py-test] .E
  [py-test] ======================================================================
  [py-test] space", 
  [py-test] ERROR: test1 (test_tether_word_count.TestTetherWordCount)
  [py-test]        "fields": [ {"name": "foo", "type": "string"} ] },
  [py-test] ----------------------------------------------------------------------
  [py-test]      {"name": "ReferencedRecord", "type": "record", 
  [py-test] Traceback (most recent call last):
  [py-test]        "fields": [ {"name": "bar", "type": "double"} ] },
  [py-test]   File "/home/cutting/src/avro/trunk/lang/py/build/test/test_tether_word_count.py",
line 187, in test1
  [py-test]      {"name": "TestError",
  [py-test]     proc=subprocess.Popen(args)
  [py-test]       "type": "error", "fields": [ {"name": "message", "type": "string"} ]
  [py-test]   File "/usr/lib/python2.6/subprocess.py", line 623, in __init__
  [py-test]      }
  [py-test]     errread, errwrite)
  [py-test]  ],
  [py-test]   File "/usr/lib/python2.6/subprocess.py", line 1141, in _execute_child
  [py-test] 
  [py-test]     raise child_exception
  [py-test]  "messages": {
  [py-test] OSError: [Errno 2] No such file or directory
  [py-test]      "echo": {
  [py-test] 
  [py-test]          "request": [{"name": "qualified", 
  [py-test] ----------------------------------------------------------------------
  [py-test]              "type": "ReferencedRecord"}],
  [py-test] Ran 45 tests in 8.061s
{code}

Any idea what's causing that?
                
> python implementation of mapreduce connector
> --------------------------------------------
>
>                 Key: AVRO-570
>                 URL: https://issues.apache.org/jira/browse/AVRO-570
>             Project: Avro
>          Issue Type: New Feature
>          Components: python
>    Affects Versions: 1.6.0
>            Reporter: Doug Cutting
>            Assignee: Jeremy Lewi
>            Priority: Critical
>              Labels: hadoop
>             Fix For: 1.7.0
>
>         Attachments: AVRO-570.patch, AVRO-570.patch, AVRO-570.patch, AVRO-570.patch,
AVRO-570.patch, AVRO-570.patch
>
>
> AVRO-512 defines protocols for implementing mapreduce tasks.  It would be good to have
a Python implementation of this.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Mime
View raw message