spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Nikhil (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (SPARK-23215) Dataset Grouping: Index out of bounds error
Date Thu, 25 Jan 2018 18:24:00 GMT

     [ https://issues.apache.org/jira/browse/SPARK-23215?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Nikhil updated SPARK-23215:
---------------------------
    Description: 
Peforming groupByKey operation followed by reduceGroups on dataset results in java.lang.ArrayIndexOutOfBoundsException.

*Input data(*spark_issue.csv*):*
1,nikhil
2,amit
3,rajeev
1,nikhil
2,amit2
3,rajeev2

*Attached Code,csv and stacktrace.*

*Note:* If we change the data so that all rows are distinct over two columns of input csv,
it does not throw anĀ error.

  was:
Peforming groupByKey operation followed by reduceGroups on dataset results in java.lang.ArrayIndexOutOfBoundsException.

*Input data(*spark_issue.csv*):*
1,nikhil
2,amit
3,rajeev
1,nikhil
2,amit2
3,rajeev2

*Attached Code,csv and stacktrace.*

*Note:* If we change the data so that all rows are distinct over two columns of input csv,
it does not throw error.


> Dataset Grouping: Index out of bounds error
> -------------------------------------------
>
>                 Key: SPARK-23215
>                 URL: https://issues.apache.org/jira/browse/SPARK-23215
>             Project: Spark
>          Issue Type: Bug
>          Components: Spark Core
>    Affects Versions: 2.1.0, 2.2.0
>            Reporter: Nikhil
>            Priority: Major
>         Attachments: SparkIndexOutOfBoundsIssue.java, spark_issue.csv, stack_trace.txt
>
>
> Peforming groupByKey operation followed by reduceGroups on dataset results in java.lang.ArrayIndexOutOfBoundsException.
> *Input data(*spark_issue.csv*):*
> 1,nikhil
> 2,amit
> 3,rajeev
> 1,nikhil
> 2,amit2
> 3,rajeev2
> *Attached Code,csv and stacktrace.*
> *Note:* If we change the data so that all rows are distinct over two columns of input
csv, it does not throw anĀ error.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org


Mime
View raw message