Return-Path: 
 <user-return-43927-apmail-spark-user-archive=spark.apache.org@spark.apache.org>
X-Original-To: apmail-spark-user-archive@minotaur.apache.org
Delivered-To: apmail-spark-user-archive@minotaur.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
	by minotaur.apache.org (Postfix) with SMTP id 1197418907
	for <apmail-spark-user-archive@minotaur.apache.org>;
 Fri,  9 Oct 2015 05:28:30 +0000 (UTC)
Received: (qmail 33912 invoked by uid 500); 9 Oct 2015 05:28:26 -0000
Delivered-To: apmail-spark-user-archive@spark.apache.org
Received: (qmail 33824 invoked by uid 500); 9 Oct 2015 05:28:26 -0000
Mailing-List: contact user-help@spark.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:user-help@spark.apache.org>
List-Unsubscribe: <mailto:user-unsubscribe@spark.apache.org>
List-Post: <mailto:user@spark.apache.org>
List-Id: <user.spark.apache.org>
Delivered-To: mailing list user@spark.apache.org
Received: (qmail 33813 invoked by uid 99); 9 Oct 2015 05:28:26 -0000
Received: from Unknown (HELO spamd4-us-west.apache.org) (209.188.14.142)
    by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 09 Oct 2015 05:28:26 +0000
Received: from localhost (localhost [127.0.0.1])
	by spamd4-us-west.apache.org (ASF Mail Server at spamd4-us-west.apache.org)
 with ESMTP id 8ABE8C0BDA
	for <user@spark.apache.org>; Fri,  9 Oct 2015 05:28:25 +0000 (UTC)
X-Virus-Scanned: Debian amavisd-new at spamd4-us-west.apache.org
X-Spam-Flag: NO
X-Spam-Score: 2.899
X-Spam-Level: **
X-Spam-Status: No, score=2.899 tagged_above=-999 required=6.31
	tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1,
	HTML_MESSAGE=3, RCVD_IN_MSPIKE_H2=-0.001, SPF_PASS=-0.001,
	URIBL_BLOCKED=0.001] autolearn=disabled
Authentication-Results: spamd4-us-west.apache.org (amavisd-new);
	dkim=pass (2048-bit key) header.d=gmail.com
Received: from mx1-us-west.apache.org ([10.40.0.8])
	by localhost (spamd4-us-west.apache.org [10.40.0.11]) (amavisd-new,
 port 10024)
	with ESMTP id syrXb0COOgK1 for <user@spark.apache.org>;
	Fri,  9 Oct 2015 05:28:18 +0000 (UTC)
Received: from mail-vk0-f43.google.com (mail-vk0-f43.google.com
 [209.85.213.43])
	by mx1-us-west.apache.org (ASF Mail Server at mx1-us-west.apache.org) with
 ESMTPS id E072720944
	for <user@spark.apache.org>; Fri,  9 Oct 2015 05:28:17 +0000 (UTC)
Received: by vkgd64 with SMTP id d64so45330124vkg.0
        for <user@spark.apache.org>; Thu, 08 Oct 2015 22:28:17 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
        d=gmail.com; s=20120113;
        h=mime-version:date:message-id:subject:from:to:content-type;
        bh=3H8iyG7/EL+JMjq7OfbrzUboFltwY99mc+6xS9qklb8=;
        b=f1wxrpS/uLSUQtV1wmsHuQHJu64mNfiRCZ6xBYuRIr2ssN9wE2bJCbKNVjMhMiYKdQ
         ARMXgLFpIbw64c2eVlKwjz71YihzDxHVdKGHKcGbaqeQdtj+a7YAl3dj34o7UeqpFW/u
         lDl2ftid1MvemPW+dB68uP8LEgCLOKifS7IVAToHEw+zBO8/iu13lh/i7E4JC4Te1C9n
         httklc1RX97FF//5p2ZCbR0WrSihHWnt7Svj7UjxAO6VEhrL/rVeAaDrhWs649ahGlQW
         Hy5I9iK2z8VgPJOuJvUqhraQDET2kJQWLvqA95wXZLs+4ASjaKowFMsukiZ+g5pe4bBi
         KuWA==
MIME-Version: 1.0
X-Received: by 10.31.11.209 with SMTP id 200mr7565577vkl.84.1444368497130;
 Thu, 08 Oct 2015 22:28:17 -0700 (PDT)
Received: by 10.31.77.198 with HTTP; Thu, 8 Oct 2015 22:28:17 -0700 (PDT)
Date: Thu, 8 Oct 2015 22:28:17 -0700
Message-ID: 
 <CAKc2hF_hh9Bv0DLf3VBSv+4fSet8pWvjqcUYnOFWXombDLM=ng@mail.gmail.com>
Subject: weird issue with sqlContext.createDataFrame - pyspark 1.3.1
From: ping yan <sharonyan@gmail.com>
To: user <user@spark.apache.org>
Content-Type: multipart/alternative; boundary=001a1145675c32470b0521a53fa9

--001a1145675c32470b0521a53fa9
Content-Type: text/plain; charset=UTF-8

I really cannot figure out what this is about..
(tried to import pandas, in case that is a dependency, but it didn't help.)

>>> from pyspark.sql import SQLContext
>>> sqlContext=SQLContext(sc)
>>> sqlContext.createDataFrame(l).collect()
Traceback (most recent call last):
  File "<stdin>", line 1, in <module>
  File
"/opt/cloudera/parcels/CDH-5.4.2-1.cdh5.4.2.p0.2/lib/spark/python/pyspark/sql/context.py",
line 318, in createDataFrame
    if has_pandas and isinstance(data, pandas.DataFrame):
AttributeError: 'module' object has no attribute 'DataFrame'

Would appreciate any pointers.

Thanks!
Ping

--001a1145675c32470b0521a53fa9
Content-Type: text/html; charset=UTF-8
Content-Transfer-Encoding: quoted-printable

<div dir=3D"ltr"><div>I really cannot figure out what this is about..=C2=A0=
</div><div>(tried to import pandas, in case that is a dependency, but it di=
dn&#39;t help.)</div><div><br></div><div>&gt;&gt;&gt; from pyspark.sql impo=
rt SQLContext</div><div>&gt;&gt;&gt; sqlContext=3DSQLContext(sc)</div><div>=
&gt;&gt;&gt; sqlContext.createDataFrame(l).collect()</div><div>Traceback (m=
ost recent call last):</div><div>=C2=A0 File &quot;&lt;stdin&gt;&quot;, lin=
e 1, in &lt;module&gt;</div><div>=C2=A0 File &quot;/opt/cloudera/parcels/CD=
H-5.4.2-1.cdh5.4.2.p0.2/lib/spark/python/pyspark/sql/context.py&quot;, line=
 318, in createDataFrame</div><div>=C2=A0 =C2=A0 if has_pandas and isinstan=
ce(data, pandas.DataFrame):</div><div>AttributeError: &#39;module&#39; obje=
ct has no attribute &#39;DataFrame&#39;</div><div><br></div><div>Would appr=
eciate any pointers.=C2=A0</div><div><br></div><div>Thanks!<br>Ping</div><d=
iv><br></div><div class=3D"gmail_signature"><div><br><br></div></div>
</div>

--001a1145675c32470b0521a53fa9--