Mailing-List: contact user-help@spark.apache.org; run by ezmlm
Precedence: bulk
MIME-Version: 1.0
In-Reply-To: 
 <CAKc2hF_hh9Bv0DLf3VBSv+4fSet8pWvjqcUYnOFWXombDLM=ng@mail.gmail.com>
References: 
 <CAKc2hF_hh9Bv0DLf3VBSv+4fSet8pWvjqcUYnOFWXombDLM=ng@mail.gmail.com>
Date: Fri, 9 Oct 2015 11:04:33 -0700
Message-ID: 
 <CA+2Pv=jNrA37s0ixHr8OfzUFeUpEjexKB1EgUKeTMs+FokrusA@mail.gmail.com>
Subject: Re: weird issue with sqlContext.createDataFrame - pyspark 1.3.1
From: Davies Liu <davies@databricks.com>
To: ping yan <sharonyan@gmail.com>
Cc: user <user@spark.apache.org>
Content-Type: text/plain; charset=UTF-8

Is it possible that you have an very old version of pandas, that does
not have DataFrame (or in different submodule).

Could you try this:
```
>>> import pandas
>>> pandas.__version__
'0.14.0'
```

On Thu, Oct 8, 2015 at 10:28 PM, ping yan <sharonyan@gmail.com> wrote:
> I really cannot figure out what this is about..
> (tried to import pandas, in case that is a dependency, but it didn't help.)
>
>>>> from pyspark.sql import SQLContext
>>>> sqlContext=SQLContext(sc)
>>>> sqlContext.createDataFrame(l).collect()
> Traceback (most recent call last):
>   File "<stdin>", line 1, in <module>
>   File
> "/opt/cloudera/parcels/CDH-5.4.2-1.cdh5.4.2.p0.2/lib/spark/python/pyspark/sql/context.py",
> line 318, in createDataFrame
>     if has_pandas and isinstance(data, pandas.DataFrame):
> AttributeError: 'module' object has no attribute 'DataFrame'
>
> Would appreciate any pointers.
>
> Thanks!
> Ping
>
>
>

---------------------------------------------------------------------
To unsubscribe, e-mail: user-unsubscribe@spark.apache.org
For additional commands, e-mail: user-help@spark.apache.org