gobblin-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Abhishek Tiwari <a...@apache.org>
Subject Re: Gobblin As Service Question.
Date Mon, 24 Jul 2017 22:16:41 GMT
Hi Olivier,

Vicky's email somehow never made it to the user@gobblin.incubator.apache.org,
however as we can see he emailed to the list. Who can we follow-up with to
see what went wrong?


On Sun, Jul 23, 2017 at 11:45 PM, Vicky Kak <vicky.kak@gmail.com> wrote:

> This email did not go to the Apache Incubation User email list as pointed
> here
> http://incubator.apache.org/projects/gobblin.html
> Can this be fixed?
> Thanks,
> Vicky
> ---------- Forwarded message ----------
> From: Vicky Kak <vicky.kak@gmail.com>
> Date: Mon, Jul 24, 2017 at 12:09 PM
> Subject: Gobblin As Service Question.
> To: user@gobblin.incubator.apache.org
> Hey Guys,
> I have spend some time looking at the gobblin service code, I did also
> start the gobblin as service but could not get it working fully yet.
> I can check from the code that GobblinServiceManager being the bootstrap
> class for the gobblin service, it creates the following Catalogs
> - Topology Catalog.
> - Flow Catalog.
> - Template Catalog.
> From the naming conventions it seems that the template catalog might be
> storing the job templates, I guess the gobblin job templates need to be
> defined at location defined at gobblin.service.templateCatalogs.fullyQualifiedPath
> property.
> I am yet not able to make from the code how the end user will make the
> explicit calls to the Gobblin service node? I am not sure if we can invoke
> jobs explicitly using rest endpoint  or we need to rely on the scheduling,
> the jobs defined in the template will be triggered automatically using the
> flow controllers in the gobblin cluster.
> The use case that I am trying is to make the explicit job calls via the
> REST interface, I have these questions
> 1) How can we configure the specific rest port for gobblin service?
> 2) How can we trigger the specific jobs via the rest endpoint as defined
> in 1?
> 3) What will be the impact of adding more gobblin service nodes, it seems
> the nodes will get added to the topology and then the user can trigger a
> job from any of the nodes in the rest endpoint? What value do we get by
> adding more nodes to the cluster?
> Regards,
> Vicky
> --
> You received this message because you are subscribed to the Google Groups
> "gobblin-users" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to gobblin-users+unsubscribe@googlegroups.com.
> To post to this group, send email to gobblin-users@googlegroups.com.
> To view this discussion on the web visit https://groups.google.com/d/
> msgid/gobblin-users/CAPaCpY-3uromW0YD8Ww%2BGrOLQ74bAmb1Td-
> AZTr%3DFxCmDsq%2Bww%40mail.gmail.com
> <https://groups.google.com/d/msgid/gobblin-users/CAPaCpY-3uromW0YD8Ww%2BGrOLQ74bAmb1Td-AZTr%3DFxCmDsq%2Bww%40mail.gmail.com?utm_medium=email&utm_source=footer>
> .
> For more options, visit https://groups.google.com/d/optout.

View raw message