pig-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Daniel Dai (JIRA)" <j...@apache.org>
Subject [jira] [Resolved] (PIG-4182) e2e tests Scripting_[1-12] fail on Windows
Date Thu, 30 Oct 2014 06:02:33 GMT

     [ https://issues.apache.org/jira/browse/PIG-4182?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Daniel Dai resolved PIG-4182.
-----------------------------
      Resolution: Fixed
    Hadoop Flags: Reviewed

Patch committed to both trunk and 0.14 branch. Thanks Rohini for review!

> e2e tests Scripting_[1-12] fail on Windows
> ------------------------------------------
>
>                 Key: PIG-4182
>                 URL: https://issues.apache.org/jira/browse/PIG-4182
>             Project: Pig
>          Issue Type: Bug
>          Components: impl
>            Reporter: Daniel Dai
>            Assignee: Daniel Dai
>             Fix For: 0.14.0
>
>         Attachments: PIG-4182-1.patch, PIG-4182-2.patch
>
>
> Error message:
> {code}
> 2014-09-11 12:37:56,622 [main] ERROR org.apache.pig.tools.pigstats.PigStats - ERROR 0:
org.apache.pig.backend.executionengine.ExecException: ERROR 2997: Unable to recreate exception
from backed error: AttemptID:attempt_1410405156681_1228_m_000000_3 Info:Error: java.io.IOException:
Deserialization error: could not instantiate 'org.apache.pig.scripting.jython.JythonFunction'
with arguments '[D:\hdp\pig-0.14.0.2.2.0.0-1181\test\e2e\pig\testdist\libexec\python\scriptingudf.py,
square]'
> 	at org.apache.pig.impl.util.ObjectSerializer.deserialize(ObjectSerializer.java:62)
> 	at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigGenericMapBase.setup(PigGenericMapBase.java:180)
> 	at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:142)
> 	at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:784)
> 	at org.apache.hadoop.mapred.MapTask.run(MapTask.java:341)
> 	at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:168)
> 	at java.security.AccessController.doPrivileged(Native Method)
> 	at javax.security.auth.Subject.doAs(Subject.java:415)
> 	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1614)
> 	at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:163)
> Caused by: java.lang.RuntimeException: could not instantiate 'org.apache.pig.scripting.jython.JythonFunction'
with arguments '[D:\hdp\pig-0.14.0.2.2.0.0-1181\test\e2e\pig\testdist\libexec\python\scriptingudf.py,
square]'
> 	at org.apache.pig.impl.PigContext.instantiateFuncFromSpec(PigContext.java:778)
> 	at org.apache.pig.backend.hadoop.executionengine.physicalLayer.expressionOperators.POUserFunc.instantiateFunc(POUserFunc.java:124)
> 	at org.apache.pig.backend.hadoop.executionengine.physicalLayer.expressionOperators.POUserFunc.readObject(POUserFunc.java:584)
> 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
> 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> 	at java.lang.reflect.Method.invoke(Method.java:601)
> 	at java.io.ObjectStreamClass.invokeReadObject(ObjectStreamClass.java:1004)
> 	at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1891)
> 	at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1796)
> 	at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1348)
> 	at java.io.ObjectInputStream.readObject(ObjectInputStream.java:370)
> 	at java.util.ArrayList.readObject(ArrayList.java:733)
> 	at sun.reflect.GeneratedMethodAccessor2.invoke(Unknown Source)
> 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> 	at java.lang.reflect.Method.invoke(Method.java:601)
> 	at java.io.ObjectStreamClass.invokeReadObject(ObjectStreamClass.java:1004)
> 	at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1891)
> 	at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1796)
> 	at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1348)
> 	at java.io.ObjectInputStream.readObject(ObjectInputStream.java:370)
> 	at java.util.HashMap.readObject(HashMap.java:1155)
> 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
> 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> 	at java.lang.reflect.Method.invoke(Method.java:601)
> 	at java.io.ObjectStreamClass.invokeReadObject(ObjectStreamClass.java:1004)
> 	at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1891)
> 	at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1796)
> 	at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1348)
> 	at java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:1989)
> 	at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1913)
> 	at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1796)
> 	at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1348)
> 	at java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:1989)
> 	at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1913)
> 	at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1796)
> 	at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1348)
> 	at java.io.ObjectInputStream.readObject(ObjectInputStream.java:370)
> 	at java.util.ArrayList.readObject(ArrayList.java:733)
> 	at sun.reflect.GeneratedMethodAccessor2.invoke(Unknown Source)
> 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> 	at java.lang.reflect.Method.invoke(Method.java:601)
> 	at java.io.ObjectStreamClass.invokeReadObject(ObjectStreamClass.java:1004)
> 	at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1891)
> 	at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1796)
> 	at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1348)
> 	at java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:1989)
> 	at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1913)
> 	at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1796)
> 	at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1348)
> 	at java.io.ObjectInputStream.readObject(ObjectInputStream.java:370)
> 	at java.util.HashMap.readObject(HashMap.java:1155)
> 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
> 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> 	at java.lang.reflect.Method.invoke(Method.java:601)
> 	at java.io.ObjectStreamClass.invokeReadObject(ObjectStreamClass.java:1004)
> 	at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1891)
> 	at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1796)
> 	at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1348)
> 	at java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:1989)
> 	at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1913)
> 	at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1796)
> 	at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1348)
> 	at java.io.ObjectInputStream.readObject(ObjectInputStream.java:370)
> 	at org.apache.pig.impl.util.ObjectSerializer.deserialize(ObjectSerializer.java:60)
> 	... 9 more
> Caused by: java.lang.reflect.InvocationTargetException
> 	at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
> 	at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57)
> 	at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
> 	at java.lang.reflect.Constructor.newInstance(Constructor.java:525)
> 	at org.apache.pig.impl.PigContext.instantiateFuncFromSpec(PigContext.java:746)
> 	... 75 more
> Caused by: java.lang.IllegalStateException: Could not initialize: D:\hdp\pig-0.14.0.2.2.0.0-1181\test\e2e\pig\testdist\libexec\python\scriptingudf.py
> 	at org.apache.pig.scripting.jython.JythonFunction.<init>(JythonFunction.java:92)
> 	... 80 more
> Caused by: org.apache.pig.backend.executionengine.ExecException: ERROR 1121: Python Error.
Traceback (most recent call last):
>   File "D:\hdp\pig-0.14.0.2.2.0.0-1181\test\e2e\pig\testdist\libexec\python\scriptingudf.py",
line 21, in <module>
> ImportError: No module named stringutil
> 	at org.apache.pig.scripting.jython.JythonScriptEngine$Interpreter.execfile(JythonScriptEngine.java:249)
> 	at org.apache.pig.scripting.jython.JythonScriptEngine$Interpreter.init(JythonScriptEngine.java:163)
> 	at org.apache.pig.scripting.jython.JythonScriptEngine.getFunction(JythonScriptEngine.java:388)
> 	at org.apache.pig.scripting.jython.JythonFunction.<init>(JythonFunction.java:55)
> 	... 80 more
> Caused by: Traceback (most recent call last):
>   File "D:\hdp\pig-0.14.0.2.2.0.0-1181\test\e2e\pig\testdist\libexec\python\scriptingudf.py",
line 21, in <module>
> ImportError: No module named stringutil
> 	at org.python.core.Py.ImportError(Py.java:304)
> 	at org.python.core.imp.import_first(imp.java:755)
> 	at org.python.core.imp.import_module_level(imp.java:837)
> 	at org.python.core.imp.importName(imp.java:917)
> 	at org.python.core.ImportFunction.__call__(__builtin__.java:1220)
> 	at org.python.core.PyObject.__call__(PyObject.java:357)
> 	at org.python.core.__builtin__.__import__(__builtin__.java:1173)
> 	at org.python.core.imp.importOne(imp.java:936)
> 	at org.python.pycode._pyx3.f$0(D:\hdp\pig-0.14.0.2.2.0.0-1181\test\e2e\pig\testdist\libexec\python\scriptingudf.py:97)
> 	at org.python.pycode._pyx3.call_function(D:\hdp\pig-0.14.0.2.2.0.0-1181\test\e2e\pig\testdist\libexec\python\scriptingudf.py)
> 	at org.python.core.PyTableCode.call(PyTableCode.java:165)
> 	at org.python.core.PyCode.call(PyCode.java:18)
> 	at org.python.core.Py.runCode(Py.java:1275)
> 	at org.python.util.PythonInterpreter.execfile(PythonInterpreter.java:235)
> 	at org.apache.pig.scripting.jython.JythonScriptEngine$Interpreter.execfile(JythonScriptEngine.java:217)
> 	... 83 more
> {code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message