asterixdb-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Eugenia Gabrielova <genia.likes.scie...@gmail.com>
Subject Re: Demo not working?
Date Mon, 08 Jun 2015 19:15:42 GMT
Thanks, that's very informative - I'll add test cases for both...

On Mon, Jun 8, 2015 at 12:11 PM, Brandon Lim <brandodl@uci.edu> wrote:

> Hey Eugenia,
>
> Actually, 0.6 - 0.9 works. 0.5 and below doesn’t. I’m guessing somewhere
> it is being rounded down to 0, so nothing shows? And if it’s 0.6 - 0.9,
> it’s being rounded up to 1?
>
> Best Regards,
> Brandon Lim
>
>
>
> On Jun 8, 2015, at 12:06 PM, Brandon Lim <brandodl@uci.edu> wrote:
>
> > Hey Eugenia,
> >
> > I changed the minimum slider option to 0.1 for the group size, but if I
> actually do a group size less than latitude and longitude 1, say 0.5, it’ll
> show the cells and how many tweets, but if I click on the bubbles, it
> doesn’t populate the screen with the tweets. For some reason it works for
> latitude and longitude of 1 and above, but not between 0.1 and 1.
> >
> > I was wondering if you would know why is that.
> >
> > Best Regards,
> > Brandon Lim
> >
> >
> >
> > On Jun 7, 2015, at 4:09 PM, Eugenia Gabrielova <
> genia.likes.science@gmail.com> wrote:
> >
> >> Thank you for the feedback about the grid size, and awesome to hear you
> got your demo working!
> >>
> >> On Sun, Jun 7, 2015 at 3:08 PM, Brandon Lim <brandodl@uci.edu> wrote:
> >> Hi Eugenia,
> >>
> >> So for an update regarding the demo, I was able to get the dataset in
> and run it with the Tweetbook Demo successfully. The only thing worth
> noting regarding the larger sample size is that the parameters for the
> group size might need to be significantly smaller (instead of the smallest
> group size being 1 latitude and 1 longitude) because a larger sample size
> means it could have thousands of tweets in one area, which would be too
> much to populate on the screen at once. But overall, the demo works great.
> Thanks!
> >>
> >>
> >> Best Regards,
> >> Brandon Lim
> >>
> >>
> >>
> >> On May 31, 2015, at 5:10 PM, Brandon Lim <brandodl@uci.edu> wrote:
> >>
> >>> Hi Eugenia,
> >>>
> >>> My dataset is a 14 GB dataset of archived tweets that was given to me.
> A sample of it can be found here:
> >>>
> >>>
> https://drive.google.com/file/d/0B131hq-YqiMHbkNXd3NUa2xGeGc/view?usp=sharing
> >>>
> >>> I ended up changing my query (because my X coordinates were longitude
> and my Y coordinates were latitude originally) by switching the coordinates
> and the demo works fantastic now. Thanks so much for the help. I will let
> you know if I have further questions, but for now, it seems like it is
> working well.
> >>>
> >>> @Professor Carey & Ian
> >>> We should definitely add lat/long to the documentation.
> >>>
> >>> Best Regards,
> >>> Brandon Lim
> >>>
> >>> On May 31, 2015, at 3:44 PM, Eugenia Gabrielova <
> genia.likes.science@gmail.com> wrote:
> >>>
> >>>> Hi Brandon,
> >>>>
> >>>> AsterixDB Lat/Lng: I am pretty sure the points in AsterixDB are
> created with Latitude, Longitude. Same with Google Maps API. In the Spatial
> docs (
> http://asterix.ics.uci.edu/documentation/aql/functions.html#SpatialFunctions)
> example under "point", the following example is shown, and only longitude
> can scale up to magnitude 180: use dataverse TinySocial; let $c :=
> point("55.05,-138.04") return {"point": $c}. I remember running into this
> exact same thing though - perhaps it would be good to specify
> latitude/longitude arguments in the docs, not just x,y.
> >>>>
> >>>> On recentering: I have just pushed a change that adds home_latitude
> and home_longitude as their own variables - good idea! - and resets them in
> the resetMap() function. The function resetMap() has the code (~ line
> #1118) that moves the map back to center. I don't think there is
> recentering anywhere else in the demo.
> >>>>
> >>>> Los Angeles Spatial issue: Could you give me a bit more information
> on your data source?
> >>>> * Are you using data from the Twitter live API, the original
> Tweetbook demo dataset, or something else?
> >>>> * Does your query on Los Angeles return results with the Query UI (
> 127.0.0.1:19001, on your local machine)?
> >>>>
> >>>> Cheers,
> >>>> Eugenia
> >>>>
> >>>> On Sun, May 31, 2015 at 2:26 PM, Brandon Lim <brandodl@uci.edu>
> wrote:
> >>>> Hi Eugenia,
> >>>>
> >>>> This might not necessarily be a tweet book demo bug or anything, but
> just a confusion. So for the Tweets API, the coordinates are formatted as
> geoJSON (longitude first, latitude second). So for AsterixDB (the
> documentation doesn’t really say), is longitude or latitude x? (I think
> Young-Seok told me before but I can’t find the email). Also, it seems that
> Google Maps API uses latitude first, longitude second.
> >>>>
> >>>> Does the demo account for these inconsistencies? I was able to input
> my data successfully, and if I changed the coordinates in the tweetbook.js
> to
> >>>>
> >>>>   map = new GMaps({
> >>>>       div: '#map',
> >>>>       lat: 34.05,//38.89,
> >>>>       lng: -118.25,//-77.03,
> >>>>       zoom: 4,
> >>>>       draggable: false,
> >>>>   });
> >>>>
> >>>> it would center it in Los Angeles like I wanted, but I wasn’t able
to
> find any tweets in the area and I think it has to do with the spatial
> intersect. Also, is it better to put a global variable for latitude and
> longitude in the tweetbook.js for if we wanted to change the starting
> location? Because changing it in the code above works initially, but when
> you click “Clear”, it resets it to the original, so it must be hardcoded
> elsewhere.
> >>>>
> >>>> Best Regards,
> >>>> Brandon Lim
> >>>>
> >>>>
> >>>>
> >>>> On May 29, 2015, at 5:31 PM, Eugenia Gabrielova <
> genia.likes.science@gmail.com> wrote:
> >>>>
> >>>>> Hi Brandon,
> >>>>>
> >>>>> Just had a chance to add the fix to the branch with a couple
> commits. Let me know if it causes you any further issues. Thanks for making
> me aware of the issue - your feedback is really helpful for some changes to
> make this demo more usable.
> >>>>>
> >>>>> Regards,
> >>>>> Eugenia
> >>>>>
> >>>>> On Fri, May 29, 2015 at 11:07 AM, Eugenia Gabrielova <
> genia.likes.science@gmail.com> wrote:
> >>>>> Sounds like a "feature" (bug) - let me have a look and hotfix that...
> >>>>>
> >>>>> On Fri, May 29, 2015 at 10:33 AM, Brandon Lim <brandodl@uci.edu>
> wrote:
> >>>>> Hey Eugenia,
> >>>>>
> >>>>> I was able to get it to run with my new query and the dataset is
> inside AsterixDB. I was curious to how I can change the spatial intersect
> of the query. Even if I put a location in the location box for the query,
> once I submit the query, it just brings me back to the default spatial area
> on the East Coast.
> >>>>>
> >>>>> Best Regards,
> >>>>> Brandon Lim
> >>>>>
> >>>>>
> >>>>>
> >>>>> On May 28, 2015, at 6:54 PM, Eugenia Gabrielova <
> genia.likes.science@gmail.com> wrote:
> >>>>>
> >>>>>> It's all good, let me know if you have any issues or questions
> about the code (or bugs :P so I can fix them)
> >>>>>>
> >>>>>> On Thu, May 28, 2015 at 6:52 PM, Brandon Lim <brandodl@uci.edu>
> wrote:
> >>>>>> That worked. I must’ve misspelled it twice because I tried
the
> other day as well. Thanks Eugenia.
> >>>>>>
> >>>>>> Also, Thanks Ian!
> >>>>>>
> >>>>>>
> >>>>>> Best Regards,
> >>>>>> Brandon Lim
> >>>>>>
> >>>>>>
> >>>>>>
> >>>>>> On May 28, 2015, at 6:44 PM, Eugenia Gabrielova <
> genia.likes.science@gmail.com> wrote:
> >>>>>>
> >>>>>>> Hi Brandon,
> >>>>>>>
> >>>>>>> Looks like you have the pathspec spelled incorrectly ("eugneia")
> >>>>>>>
> >>>>>>> Try
> >>>>>>> $ git checkout eugenia/tweetbook-demo-fixes
> >>>>>>>
> >>>>>>> On Thu, May 28, 2015 at 6:40 PM, Brandon Lim <brandodl@uci.edu>
> wrote:
> >>>>>>> Hey Eugenia,
> >>>>>>>
> >>>>>>> I tried that, but it says
> >>>>>>>
> >>>>>>> git checkout eugneia/tweetbook-demo-fixes
> >>>>>>> error: pathspec 'eugneia/tweetbook-demo-fixes' did not match
any
> file(s) known to git.
> >>>>>>>
> >>>>>>> When I did
> >>>>>>>
> >>>>>>> git branch
> >>>>>>>
> >>>>>>> Only master showed up.
> >>>>>>>
> >>>>>>> Best Regards,
> >>>>>>> Brandon Lim
> >>>>>>>
> >>>>>>>
> >>>>>>>
> >>>>>>> On May 28, 2015, at 6:35 PM, Eugenia Gabrielova <
> genia.likes.science@gmail.com> wrote:
> >>>>>>>
> >>>>>>>> Hi Brandon!
> >>>>>>>>
> >>>>>>>> Any luck fetching the upstream branch?
> >>>>>>>>
> >>>>>>>> $ cd path/to/your/sandbox
> >>>>>>>> $ git fetch
> >>>>>>>> $ git checkout eugenia/tweetbook-demo-fixes
> >>>>>>>>
> >>>>>>>> Let me know if that works for you.
> >>>>>>>>
> >>>>>>>> On Wed, May 27, 2015 at 10:13 AM, Brandon Lim <brandodl@uci.edu>
> wrote:
> >>>>>>>> Hey Ian,
> >>>>>>>>
> >>>>>>>> When I clicked the download zip or download tar.gz for
the
> branch, it said 404 not found. I couldn’t figure out how to checkout her
> specific branch. I was only able to checkout the master branch.
> >>>>>>>>
> >>>>>>>> Best Regards,
> >>>>>>>> Brandon Lim
> >>>>>>>>
> >>>>>>>>
> >>>>>>>>
> >>>>>>>> On May 26, 2015, at 10:42 AM, Ian Maxon <imaxon@uci.edu>
wrote:
> >>>>>>>>
> >>>>>>>>> Hey Brandon,
> >>>>>>>>>
> >>>>>>>>> What seemed to be the issue with checking out/downloading
the
> repository? It should just be a matter of checking out that branch and
> doing 'mvn clean package -DskipTests'.
> >>>>>>>>>
> >>>>>>>>> - Ian
> >>>>>>>>>
> >>>>>>>>> On Tue, May 26, 2015 at 10:02 AM, Brandon Lim <brandodl@uci.edu>
> wrote:
> >>>>>>>>> Hey Eugenia,
> >>>>>>>>>
> >>>>>>>>> I wasn’t able to download your up-to-date branch
in the sandbox
> for some reason. Is there another way for me to get access to your most
> up-to-date TweetBook Demo?
> >>>>>>>>>
> >>>>>>>>> Best Regards,
> >>>>>>>>> Brandon Lim
> >>>>>>>>>
> >>>>>>>>>
> >>>>>>>>>
> >>>>>>>>> On May 22, 2015, at 12:17 PM, Eugenia Gabrielova
<
> genia.likes.science@gmail.com> wrote:
> >>>>>>>>>
> >>>>>>>>>> Hi Brandon!
> >>>>>>>>>>
> >>>>>>>>>> As a heads up, I have a branch in sandbox with
some up-to-date
> changes and fixes on the TweetbookDemo. I'll keep an eye out on this thread
> if you have any questions, or I can look through code with you on campus if
> you prefer.
> >>>>>>>>>>
> https://code.google.com/p/asterixdb-sandbox/source/browse/?name=eugenia%2Ftweetbook-demo-fixes#git%2Fasterix-examples%2Fsrc%2Fmain%2Fresources%2Ftweetbook-demo
> >>>>>>>>>>
> >>>>>>>>>> The longitude shift was just a debugging thing
for me when I
> was playing with spatial queries, to match an older version of the
> geospatial demo (pre-Tweetbooks). It's not an Asterix-related thing and can
> easily be removed.
> >>>>>>>>>>
> >>>>>>>>>> On Fri, May 22, 2015 at 11:41 AM, Ian Maxon
<imaxon@uci.edu>
> wrote:
> >>>>>>>>>> Hi Brandon,
> >>>>>>>>>> Interesting. I wasn't quite sure how to solve
this initially,
> but there is a function that does the trick. (however it isn't documented
> in master!...)
> >>>>>>>>>>
> >>>>>>>>>> parse-datetime should be able to do the trick.
For your
> example. "  parse-datetime("Fri May 11 07:53:00 +0000 2012", "W MMM DD
> hh:mm:ss z YYYY")  " will give the proper AQL object from the string. The
> first part is (obviously) the date to be parsed. The second is the
> formatting string, which is not very well documented, but appears to follow
> Java's convention (
> https://docs.oracle.com/javase/7/docs/api/java/text/SimpleDateFormat.html)
> closely.
> >>>>>>>>>>
> >>>>>>>>>> -Ian
> >>>>>>>>>>
> >>>>>>>>>> On Fri, May 22, 2015 at 11:01 AM, Brandon Lim
<brandodl@uci.edu>
> wrote:
> >>>>>>>>>> Hey Ian,
> >>>>>>>>>>
> >>>>>>>>>> Quick question. So I’m trying to align my
dataset or how my
> dataset is handled with the dataset that is currently in use by the
> TweetBook demo, but one thing is that the TweetBook demo allows it to query
> based on datetime.
> >>>>>>>>>>
> >>>>>>>>>> <Screen Shot 2015-05-22 at 10.58.10 AM.png>
> >>>>>>>>>> This is what the data for the TweetBook demo
looks like.
> Everything is already preprocessed.
> >>>>>>>>>>
> >>>>>>>>>>
> >>>>>>>>>>
> >>>>>>>>>> This is what my data looks like. Is there an
easy way to
> convert this into datetime?
> >>>>>>>>>>
> >>>>>>>>>>
> >>>>>>>>>> <Screen Shot 2015-05-22 at 11.01.12 AM.png>
> >>>>>>>>>> Also, do you know why in the TweetBook demo
that the longitude
> sign bit is flipped?
> >>>>>>>>>>
> >>>>>>>>>> Best Regards,
> >>>>>>>>>> Brandon Lim
> >>>>>>>>>>
> >>>>>>>>>>
> >>>>>>>>>
> >>>>>>>>> --
> >>>>>>>>> You received this message because you are subscribed
to the
> Google Groups "asterixdb-users" group.
> >>>>>>>>> To unsubscribe from this group and stop receiving
emails from
> it, send an email to asterixdb-users+unsubscribe@googlegroups.com.
> >>>>>>>>> For more options, visit https://groups.google.com/d/optout.
> >>>>>>>>>
> >>>>>>>>>
> >>>>>>>>> --
> >>>>>>>>> You received this message because you are subscribed
to the
> Google Groups "asterixdb-users" group.
> >>>>>>>>> To unsubscribe from this group and stop receiving
emails from
> it, send an email to asterixdb-users+unsubscribe@googlegroups.com.
> >>>>>>>>> For more options, visit https://groups.google.com/d/optout.
> >>>>>>>>
> >>>>>>>>
> >>>>>>>
> >>>>>>>
> >>>>>>>
> >>>>>>> --
> >>>>>>> You received this message because you are subscribed to
the Google
> Groups "asterixdb-users" group.
> >>>>>>> To unsubscribe from this group and stop receiving emails
from it,
> send an email to asterixdb-users+unsubscribe@googlegroups.com.
> >>>>>>> For more options, visit https://groups.google.com/d/optout.
> >>>>>>
> >>>>>>
> >>>>>>
> >>>>>> --
> >>>>>> You received this message because you are subscribed to the
Google
> Groups "asterixdb-users" group.
> >>>>>> To unsubscribe from this group and stop receiving emails from
it,
> send an email to asterixdb-users+unsubscribe@googlegroups.com.
> >>>>>> For more options, visit https://groups.google.com/d/optout.
> >>>>>
> >>>>>
> >>>>>
> >>>>>
> >>>>> --
> >>>>> You received this message because you are subscribed to the Google
> Groups "asterixdb-users" group.
> >>>>> To unsubscribe from this group and stop receiving emails from it,
> send an email to asterixdb-users+unsubscribe@googlegroups.com.
> >>>>> For more options, visit https://groups.google.com/d/optout.
> >>>>
> >>>>
> >>>
> >>> --
> >>> You received this message because you are subscribed to the Google
> Groups "asterixdb-users" group.
> >>> To unsubscribe from this group and stop receiving emails from it, send
> an email to asterixdb-users+unsubscribe@googlegroups.com.
> >>> For more options, visit https://groups.google.com/d/optout.
> >>>
> >>
> >>
> >>
> >> --
> >> You received this message because you are subscribed to the Google
> Groups "asterixdb-users" group.
> >> To unsubscribe from this group and stop receiving emails from it, send
> an email to asterixdb-users+unsubscribe@googlegroups.com.
> >> For more options, visit https://groups.google.com/d/optout.
> >
> >
>
>

Mime
View raw message