Return-Path: X-Original-To: apmail-flink-user-archive@minotaur.apache.org Delivered-To: apmail-flink-user-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id C18F81888D for ; Mon, 18 Jan 2016 13:27:00 +0000 (UTC) Received: (qmail 76685 invoked by uid 500); 18 Jan 2016 13:27:00 -0000 Delivered-To: apmail-flink-user-archive@flink.apache.org Received: (qmail 76597 invoked by uid 500); 18 Jan 2016 13:27:00 -0000 Mailing-List: contact user-help@flink.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@flink.apache.org Delivered-To: mailing list user@flink.apache.org Received: (qmail 76577 invoked by uid 99); 18 Jan 2016 13:27:00 -0000 Received: from mail-relay.apache.org (HELO mail-relay.apache.org) (140.211.11.15) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 18 Jan 2016 13:27:00 +0000 Received: from mail-wm0-f44.google.com (mail-wm0-f44.google.com [74.125.82.44]) by mail-relay.apache.org (ASF Mail Server at mail-relay.apache.org) with ESMTPSA id E25081A0040 for ; Mon, 18 Jan 2016 13:26:59 +0000 (UTC) Received: by mail-wm0-f44.google.com with SMTP id l65so99503196wmf.1 for ; Mon, 18 Jan 2016 05:26:59 -0800 (PST) X-Gm-Message-State: AG10YORxd7dU/H686xN8BAN8y4K8cDkeH3R/NHTe7xLl/OEJxBFNqKLe9xtaqbIEVrl+lq4ZzxFJJOdf5dU+cQ== MIME-Version: 1.0 X-Received: by 10.28.45.207 with SMTP id t198mr14044400wmt.32.1453123618376; Mon, 18 Jan 2016 05:26:58 -0800 (PST) Received: by 10.28.13.209 with HTTP; Mon, 18 Jan 2016 05:26:58 -0800 (PST) In-Reply-To: References: Date: Mon, 18 Jan 2016 14:26:58 +0100 X-Gmail-Original-Message-ID: Message-ID: Subject: Re: InvalidTypesException - Input mismatch: Basic type 'Integer' expected but was 'Long' From: Till Rohrmann To: user@flink.apache.org Content-Type: multipart/related; boundary=001a11422b9c16bcb205299bb508 --001a11422b9c16bcb205299bb508 Content-Type: multipart/alternative; boundary=001a11422b9c16bcad05299bb507 --001a11422b9c16bcad05299bb507 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable Hi Biplob, no version 0.10.1 and 1.0-SNAPSHOT are different. Could you bump your Flink version to the latter and try again if you can reproduce your problem? Cheers, Till =E2=80=8B On Mon, Jan 18, 2016 at 2:24 PM, Biplob Biswas wrote: > Hi Till, > > I am using flink 0.10.1 and if i am not wrong it corresponds to the > 1.0-Snapshot you mentioned. > > [image: Inline image 1] > > If wrong, please suggest what should I do to fix it. > > Thanks & Regards > Biplob Biswas > > On Mon, Jan 18, 2016 at 11:23 AM, Till Rohrmann > wrote: > >> Hi Biplob, >> >> which version of Flink are you using? With version 1.0-SNAPSHOT, I >> cannot reproduce your problem. >> >> Cheers, >> Till >> =E2=80=8B >> >> On Sun, Jan 17, 2016 at 4:56 PM, Biplob Biswas >> wrote: >> >>> Hi, >>> >>> I am getting the following exception when i am using the map function >>> >>> Exception in thread "main" >>>> org.apache.flink.api.common.functions.InvalidTypesException: The retur= n >>>> type of function 'computeWeightedDistribution(GraphWeighted.java:73)' = could >>>> not be determined automatically, due to type erasure. You can give typ= e >>>> information hints by using the returns(...) method on the result of th= e >>>> transformation call, or by letting your function implement the >>>> 'ResultTypeQueryable' interface. >>>> at org.apache.flink.api.java.DataSet.getType(DataSet.java:176) >>>> at org.apache.flink.api.java.DataSet.groupBy(DataSet.java:692) >>>> at aim3.GraphWeighted.computeWeightedDistribution(GraphWeighted.java:7= 4) >>>> at aim3.SlashdotZooInDegree.main(SlashdotZooInDegree.java:39) >>>> Caused by: org.apache.flink.api.common.functions.InvalidTypesException= : >>>> Input mismatch: Basic type 'Integer' expected but was 'Long'. >>>> at >>>> org.apache.flink.api.java.typeutils.TypeExtractor.validateInputType(Ty= peExtractor.java:767) >>>> at >>>> org.apache.flink.api.java.typeutils.TypeExtractor.getUnaryOperatorRetu= rnType(TypeExtractor.java:276) >>>> at >>>> org.apache.flink.api.java.typeutils.TypeExtractor.getMapReturnTypes(Ty= peExtractor.java:110) >>>> at org.apache.flink.api.java.DataSet.map(DataSet.java:213) >>>> at aim3.GraphWeighted.computeWeightedDistribution(GraphWeighted.java:7= 3) >>>> ... 1 more >>> >>> >>> >>> This is the part of the code which I am trying to run : >>> >>> DataSet> distinctVertex =3D sourceVertex >>>> .union(destinationVertex) >>>> .groupBy(0) >>>> .aggregate(Aggregations.SUM, 1); >>>> // Compute the degrees (degree, count) >>>> >>>> DataSet> degreeCount =3D distinctVertex >>>> .map(new DegreeMapper()) >>>> .groupBy(0) >>>> .aggregate(Aggregations.SUM, 1); >>> >>> >>> >>> and the error I am getting is at this line *.map(new DegreeMapper())* >>> >>> Also, the degree mapper is a simply map function which emits the second >>> column and 1 as follows: >>> >>>> >>>> public static class DegreeMapper implements >>>> MapFunction, Tuple2> { >>>> private static final long serialVersionUID =3D 1L; >>>> public Tuple2 map(Tuple2 input) throws >>>> Exception { >>>> return new Tuple2(input.f1, 1); >>>> } >>>> } >>> >>> >>> >>> Now I am lost as to what I did wrong and why I am getting that error, >>> any help would be appreciated. >>> >>> Thanks a lot. >>> >>> Thanks & Regards >>> Biplob Biswas >>> >> >> > --001a11422b9c16bcad05299bb507 Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: quoted-printable

Hi Biplob,

no version 0.1= 0.1 and 1.0-SNAPSHOT are different. Could yo= u bump your Flink version to the latter and try again if you can reproduce = your problem?

Cheers,
Till

=E2=80=8B

On Mon, Jan 18, 2016 at 2:2= 4 PM, Biplob Biswas <revolutionisme@gmail.com> wrote:=
Hi Till,

=
I am using flink 0.10.1 and if i am not wrong it corresponds to the 1.= 0-Snapshot you mentioned.

3D"Inline
<= div class=3D"gmail_extra">
If wrong, pl= ease suggest what should I do to fix it.

Thanks & Re= gards
Biplob Biswas

On Mon, Jan 18= , 2016 at 11:23 AM, Till Rohrmann <trohrmann@apache.org> = wrote:

Hi Biplob,

which version of Flink are you = using? With version 1.0-SNAPSHOT, I cannot reproduc= e your problem.

Cheers,
Till

=E2=80=8B
=

On Sun,= Jan 17, 2016 at 4:56 PM, Biplob Biswas <revolutionisme@gmail.com> wrote:
Hi,

<= /div>
I am getting the following exception w= hen i am using the map function=C2=A0
=
Exception in thr= ead "main" org.apache.flink.api.common.functions.InvalidTypesExce= ption: The return type of function 'computeWeightedDistribution(GraphWe= ighted.java:73)' could not be determined automatically, due to type era= sure. You can give type information hints by using the returns(...) method = on the result of the transformation call, or by letting your function imple= ment the 'ResultTypeQueryable' interface.
at org.apache.flink.api.java.DataSet.getType(DataSet= .java:176)
at org.apache.fl= ink.api.java.DataSet.groupBy(DataSet.java:692)
at aim3.GraphWeighted.computeWeightedDistribution(Graph= Weighted.java:74)
at aim3.S= lashdotZooInDegree.main(SlashdotZooInDegree.java:39)
Caused by: org.apac= he.flink.api.common.functions.InvalidTypesException: Input mismatch: Basic = type 'Integer' expected but was 'Long'.
at org.apache.flink.api.java.typeutils.TypeExt= ractor.validateInputType(TypeExtractor.java:767)
at org.apache.flink.api.java.typeutils.TypeExtractor.= getUnaryOperatorReturnType(TypeExtractor.java:276)
at org.apache.flink.api.java.typeutils.TypeExtracto= r.getMapReturnTypes(TypeExtractor.java:110)
at org.apache.flink.api.java.DataSet.map(DataSet.java:213)=
at aim3.GraphWeighted.comp= uteWeightedDistribution(GraphWeighted.java:73)
... 1 more


This is the part of the code which I am trying to run :

=
DataSet<Tuple2<String, Long>> distinctVertex = =3D sourceVertex
=C2=A0 =C2=A0=C2=A0 .union(destinationVertex)
=C2=A0 =C2=A0=C2=A0 .groupBy(0)
=C2=A0 =C2=A0=C2=A0= .aggregate(Aggregations= .SUM, 1);
=C2=A0 =C2=A0 =C2=A0 =C2=A0 // Compute the degrees (degree, co= unt)
=C2=A0 =C2=A0=C2=A0
=C2=A0 =C2=A0=C2=A0 DataSet<= ;Tuple2<Long, Integer>> degreeCount =3D distinctVertex
=C2=A0 = =C2=A0=C2=A0 .map(ne= w DegreeMapper())
=C2=A0 =C2=A0=C2=A0 .groupBy(0)
=C2=A0 =C2=A0=C2=A0 .aggregate(Aggregations.SUM, 1);


and the error I am ge= tting is at this line=C2=A0.map(new De= greeMapper())

Also, the degree mapper is a simply map function whi= ch emits the second column and 1 as follows:

=C2=A0 =C2=A0 public static class DegreeMapper implements MapF= unction<Tuple2<String, Long>, Tuple2<Long, Integer>> { private static final long se= rialVersionUID =3D 1L;
pub= lic Tuple2<Long, Integer> map(Tuple2<String, Long> input) throw= s Exception {
return new = Tuple2<Long, Integer>(input.f1, 1);
}
=C2=A0 =C2=A0 }


Now I am lost as to what I did wrong and why I= am getting that error, any help would be appreciated.

Thanks a lot.

Thanks & Regards
Biplob Biswas



--001a11422b9c16bcad05299bb507-- --001a11422b9c16bcb205299bb508 Content-Type: image/png; name="image.png" Content-Disposition: inline; filename="image.png" Content-Transfer-Encoding: base64 Content-ID: X-Attachment-Id: ii_15254e76362bc914 iVBORw0KGgoAAAANSUhEUgAAAKUAAAA7CAYAAAAaR0rpAAAQUUlEQVR4Ae1dfVAc5Rn/7X1A4kEI gRgjREW5aMg1iTEx9WjUVquFjEptpeo4Ta3OodOpnKMZjdL6hX90mI5HvxS0GuzXiNpBYmBSjZoo 1NQY0wZJBIxfUUgISSCEg7vjtvO8t3vsHbd3e3e7ByR7M8t+vO/z8T778Dzvu/t73+V4nueh/3QL TCMLGKaRLroqugWYBVLmlGOHPwZt+k+3QCwLaO6Ufq8b/W8+iL7NFTi+64+x9BHKW1HBceAqWiPW 76ktBscVo7YnYrHGFwXdSD9hK54aRcLaSXppYJOeWhRrwTdMe+mpKk75cf8gIm1dR0+AM6ZhtPcj ZOQPYvRQB8ZHBqTyoxzbYe+ojuB4rahxtkehS0WRHa5uHtQd5/kW2JxW2X+gVGijqYzCSrTxbags 1FRKCHPmlHJjHbnrIRwAtBzoQ82H34Rsrt3foLm7F5zBCMsF18A7PAtmiw9DnVvCyWXPbTagcUtY OGxtQr3DAYcsVaoLSlDX7YK9vgmR43qq9Zn58gybNm3Cxo0b4fP5QlpD53S9oaEh5HqkE9fjf0fb ps0h21t/bkbD75tZdcvi6+E+ZoE5YwgDe16OxCLitaINVbA5ayQ3uwe11R1wbSgLqd9aMZFKAym/ B7XFHEKyf2sFuOJaMBdnKUmkqRD4C+mvtiL+tFy4DuX2ejSJXhmNfyulw4DskLQfjUZOJwlNcW1X iE0gKeM4pW0M2E3slgTsF9YtiMg3El2oOvGcGfbv34+dO3eiqqoq6JjkkHRO1/ft24fx8fGoPN9/ /l6c/4PRkK2wdAz514zg+lcfx03b/4FxPhPwAz73IE5+tScqv4nCEpQ5pDd7CxpRjnVhqaSkbiKV Ouop5ReissqB+qCXAK1N9XBUVaIQraiwNqJcTL8tQHWwT9gOZ2dZIC23ONAe8g8xoVX0oxj8q4EG SvvdLsC5XuiexKCJqBPROGFrCbS9AY2oDyqWCD9yLCsay7uFbgmPupIgQ+FAhm9rDZy2lih04Xyi nxueeOIJrFmzJuiYbrc76JB0vbq6GkajMSqXRQvmwpLJY+VCb8i2YoEXSzO8GB4bwZwlZRjut+CM eUMY2PVKVH7SwpINLnRUByJca40TNuZY0hoAKAqy6FM6cWNKyuAIptRWNHW4sIGM3NOFDrTDaRUi ZWk92ju7BYZ2uFglAESPDnSF9R7CJEtO7SiyKuDfQP8YAAorUeVoBxOdiE5EYxfaxNhVTXRpEuK3 BY3tDlRF6zzK8bUWwV5fipDIL7FMvIcGs9nMHE90zPLycuagokOaTCZFPDsPf4W3Dw5G3A4e60f2 susw+LUBllwP+vdsw7hnRBFfUGpEI7a01qJadCwpJaWTUqCFDTq64bKLhSXY4OpgUbCnthod5esC zsCKHUJ9IcJODgkiE2X7HrqhNiwORnAl/HvQ1SFlr4RGWj/Wsdr8RHkR+LLBEI8GrGfBIaTbJJLF sWcDHXI8iojkiMPDw2xP50odcnvVzXjsq6O499ODEbcnvj6G9ppKmLMWYXTQgPQsYGDPNoVqUiq2 wVnqBEIcSyDv7kS7vQgUpMCcY4Jt4bpyoLEGNY22iQhQuBg21EtS9kT9xI7ENFoHlu2i8m+fGLgx XR0oI6KoNDJaEU27EzVCP5b+8YLpOyF+gX7xRFcmgtwYfAsr29DtsqNDeXqJIAQIPhISHfP2228H pXSlDklcRwcHcNEcj+xmPWMUo8ePIHf1LTj+VQayFg7h4DuxB1BBjUs2wGWXSS1UBieslL7Xd8IW jJR0synK1qPeVhZwGMYwMFoGPcYRBhxyz0OD8icdSNI/V42ibmn/Kxp/O2ydgWjCsf6g4MiIRjNJ uHChBHUtDtSXBroh61E+kb4T4leIyjbh8ZZgl8kRT0bPYPeJg9UpCQByqse4zqnx7vv1iiuQf65F VpTPx6Pv6xFc+9vX8H7V1Vi67iT2brZg1caXYVlYIEt3ahXQKJYcOLXP/GaiDZV1GGO07HBfHwZP ZMjX8vMYc5+EOWMuMgtW4pNtH2LshBeHd7+DgnWni1PKm0cvCbWAKk7547o3Q7lGOSu47h6cONiD +cu+g/S5uVFq6kWnqwVUSd+nq/H0dmtjgeBARxv2OlfdAvFbQHfK+G2mU2hsAVX6lFrpePTLrfji wxqBPQ8EQfIElufBwYALimuQueASrVTQ+U6BBaZ1n/LDV9Zi6TX0SJhemg+C9w4C3uPgfYPs3D96 BPs73saqm3dNgel0kVpZYFpHyjMvuhP/aXLAD06Ikn4WIQOQOh5GjseStY9rZRud7xRZYFr3KUcy S/GB/z5YVj6DrEufRc63X8B8+ybkXLYJ6cufRbvvISD7itimE984MOiaBIrFYFhK0NoSmljSFPOM xUhBudgujosOhmD1RPiawDcZWlE1jdqqmVMqBQiL7QvfD50cw+Z39+GSi1djdmYeLFn5yJpH2yJk ZS9CzvzzsHSJDc3v7gsnDTtvRUVpPRwE8WoTEDpiDS1Q1VrwFPUN2VO7RCAKvR4UYXDSSgLOsQmS V5BUngythL9GbdXEKffu3Yvt27fD76d0m9hv++5PUXRBHuZlZbB31GlGDulmA9JNQLqZQ5rZgIL8 +TCbjeg8cCiGEAFWFqPWjCpmCHzxnT4hoiKg9EHvs3nwdaGgaCRDmwIjqe6UFCEHBgbQ29uLHTt2 JOyYx4fcOOvMbGYCo4GD2WRAmonDrDQjzCYOJqMBBg64sCAPXV/2y5qqgiOMZQBAMRnvJ03LwrEc yjsogerJT2pjUUgy0SpeVPzk+kHBIQc9XR2wMwBn4HLhYpsEFxpSddJJMrShzKT2I1iriOaX2idQ p6KCJvuFdSFCmQXPVHdKQt5cfvnlWLhwYUKO+dYL5aAt6/PH0f+WA19s/QVe2uTC4b6vYTQAv3p4 I0wGA/Z9/D+8+Owf0H+oF4eOnAg2KPygjm+BA4GJXm3RAKyMMBbynNIhy5ngFWIw40PFA5Prh7do +p7L696OjqIG8LyIioreBtWdksQZDIaEHdM91IeLr3sKa3/yJ1z6w1qcNT8H9rxPsG3r6/DzwJEj R+DneXyw899Y7/gl3n3nDfQfUwgYjm4LgJw3CvK8cX1gukDQH1lHX4wOMlEgOKBQgIon/SLVVyIn ZttSUCGS7kysHeXhc1jo+pF38cxjj+Extv0T4uhAE6ckeeSYxcXFSEtLYxGT5voo+Y36jDBZFgS3 eTnzkD4rA3lcOzw+Hn4/z/YcZ2DOSd2Fk6NjSlgnWYem9dpDU6SAuCYdIkYBcqbgYEQBKl6ufgQ5 4ek6PCVHa2wytLJ85XSXJQCQuxZ3PfIIHmHbjVgi1NXMKWmQ09bWBo/Hw1L5kiWiyGhaAm6fETRP bceuA3j1rU5kL7sHtmufxLjnKLw+P+Zm58Dj8yPvnAL85bmnsWTpcszLksdyRpcWT6kd5Q1taEEc c1HiRcVHqT9JUzYvRpzWS3PhCZhP8zFC+3mT6OhCMrRy/OPRPaJSExc1cUpySBrk0GCH+pbUx6TI qeTn9hng8/NYsWQRvrvqAviNGfCb5oCuuz087n/4Sbg941hlvxK33n4XbMtXInfuGUpYq1KnpK4b 5Y3Wiem60bjGi4qPVj9cDkXPFqCUocQpHMcBHk6GNlwP8Twe3UUamb3qrxkpldHjoEQcknT83aMl KHe+hl17P0f/0CgODY7gZ6Ur0ei6AVf9/CX2eIj6lPQa3MD5MXLiGL7sG8KPrlou08RUX6ZI1YQy hZ36VGunrjxt2qr6a0Yafefk5LC2xxMhRWOJ6buoMB++cT/G/TxL53TdyHnB8xzMnB9mow8jw8fx 308OYfF5+SL51O/pGaC9CBumXhPtNdCorapHStESFDHJQeP9PfrADbIko/l3hpTlz8/EmmUFuOSi c2Cgh5ZT+aOOvtWJdvb4KY5UOpU6Jypb47Zq5pSJtlen0y2gbPSh20m3QAotoDtlCo2ti1JmAdUH OsrExq41GXVONAHEuY46j22/mVxj2vYpJ6HOfUOAh1DnxwModM8xdO75F1bfunsm21/XPYIFpm2k nIw6pyjpZ8vN0Z5Q5wUX3x2hSfqlmW6BadunHJ2zDju9Aup8dT1yLnseuZcFUOezVz6HNs8DSMu/ RZn9RaBAKpDnyjRSt5bYvlMEga6ZU9JzykR/w24PNr+3D5esXIXZmfk4IysfmXPzMDdnEUOeZ887 D8uWXYzmHUpAHilGnifa6ITpkkGRJ0MrUZgBRtR7NquJUyaLPN+x+wCs556F3OxM0PP3NJMBs9OM SDcZGOqcEOjnLczF7HQz9nb3Sqwjd3gKIs/FpiaDIk+GVpSvwV51p6QImSzy/NjQCM4+M5u9ETIa DUgzG2E2cphlBmhahMkUQJ1bz89Dz8EjUc2SeuQ5qSOzBji9CRGXH+Ska7JHQGeH1JXBarKFg089 BLrqTpks8pxuaW//EMNhPvfXZty4/kFseaMdJkKdVz3E0OdPb3oNZT99ENu278ThgeGoTpl65Lnc 2uHi4qrC6sHdLnSUSmdSStHZMmuLR23p9ClMFoGuulOSaZJBnhN938AwG2W/vvU9/Kbqbjzz4uu0 HIGAOufwUvM7eOrJSvztla0qos5JsgrIc2GF3klrh7P1woWVe0mUdM1zOocEnS23trjC6MnYTeWf 4MBLgrYPb6NUvzAEumaPhETkeXNzcxB5vnTpUqkqssfD7gCSnEAW83Lmsq9TELCXUOcE9KVfdtYc eD2+FKHOSaIUeS4sbs46+JWy7UiugNYWD5/TUoI2PkweTRhrog8JBHQKINCVYZQYAj1BWtm20T+O gLYvYd2Y9bJVgwUMgb42eKpJpCTuiSLPiXZ+dgatiYEVtsW47a5Hse77xfD4IKDOgdUrLsJtdz+K 712+OkWoc9JKIfJc+KbOpLXDhfXCg19R6alFdb0kcgZvSZxroCeDIk+GVkMEuiaRMhnkOd2bM7Mt MBu9+PWGO+DxeDFrlhmjHj/ue7gabu84qu6/A+7RMQb07dj/mfR2an5MyPOuYiu4Rhe6wxc3YNID a4d3clZwzoA6tBBCXUlgvfBi+lQKu0wzLNska7FLVRfrTvCAoyXyDEqGIg98soU4kKyYkzZFUcnQ ijzC94RAr7bCSo23O+CQrkEfXlfmXPXXjMkiz0nPl9/YjVVWC8bN2RgdT2fAXoJL0s0cD6LOacnq IRw4eBQ3Xb1Cpnn65dRYQF0EuurpW0Sexzs3R2q8vAXZeP/jQzD7+pCTfgwWkxtGzgMOPqQZvMhM c4Mb68NHnZ+xVC+l1Y+nwAICAp19NkYF8apHSlGnRJHnRO/x+vDa9r3Y29MLjzfyJ/jOzrVgzbfO x+qic6cedS42+nTb06BGA7S9Zk55ut0fvb3qWUD19K2eajqn09UCulOernd+Grdbk0dCarRXR56r YcWZyWPa9il15PnMdCg1tJ62kVJHnqtxe2cmj2nrlAHkeRauXLMYJgPB1Yzs4Tkt2TIy5sHbO7tw Yf61M9Pq00prevAtfshUepykkuxxUSPKE/hAqmYDnemDPE/SuDq5QgsEMKG1PUL1JNDo/wdC5Wze 8J7B2gAAAABJRU5ErkJggg== --001a11422b9c16bcb205299bb508--