HUE... spark, hive, zeppelin

[Merlijn Sebrechts]

Thanks a lot for this! I'll definitely take a look at this. I have a paper
deadline on the 22, so I'll probably won't have time until Tuesday.

As a general comment for all the big data Charm, whats the reasoning behind
not using upstart jobs? I think the `script`, `pre-start` and `pre-stop`
stanza's would be great for this... Any plans to move to systemd jobs for
Xenial?


Kind regards
Merlijn

2016-02-18 15:31 GMT+01:00 Cory Johns <cory.johns at canonical.com>:

> (Adding the bigdata list.)
>
> Thanks, Andrew.  I'd also like to add my own small PR:
>
> https://github.com/juju-solutions/interface-spark/pull/3
>
> Merlijn, I know you were interested in and perhaps working on Hue
> yourself.  Hopefully there hasn't been too much parallel effort going on,
> and hopefully this work benefits you.  Perhaps you could give it a review
> as well?
>
> On Thu, Feb 18, 2016 at 7:25 AM, Andrew Mcleod <
> andrew.mcleod at canonical.com> wrote:
>
>> Ok, so I'm done for HUE for the time being.
>>
>> !!!!!!! PLEASE REVIEW !!!!!!!
>>
>> https://github.com/juju-solutions/layer-apache-zeppelin/pull/3
>> https://github.com/juju-solutions/layer-apache-spark/pull/7
>> https://github.com/juju-solutions/layer-apache-hive/pull/8
>> https://github.com/juju-solutions/interface-spark/pull/2
>>
>>
>> I have changed some states (from related => joined and available =>
>> ready) in the spark interface and spark reactive (as discussed)
>>
>>
>>
>> *** benchmark layer / interface will need to be updated to join to this
>> new spark layer*
>>
>> I've added the livy server into spark with some caveats:
>>
>> 1. The start and stop clauses are a bit dodgy (i dont know of a better
>> way to do it right now, and the jps process name is "Main"...)
>>
>> 2. livy CLASSPATH is hard coded - `hadoop classpath` should return the
>> right value, however i couldnt use the utils.env as it was putting a lone
>> ‘=‘ after the classpath insertion, i.e /etc/environments looks like this:
>>
>> STUFF="thing"
>> OTHERSTUFF="otherthing"
>> CLASSPATH="/etc/dir:/dir:/dir:/dir............/dir/dir/dir"
>> =
>>
>> ^ Equals sign out of nowhere.
>>
>>
>>
>>
>
> --
> Bigdata mailing list
> Bigdata at lists.ubuntu.com
> Modify settings or unsubscribe at:
> https://lists.ubuntu.com/mailman/listinfo/bigdata
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://lists.ubuntu.com/archives/bigdata/attachments/20160218/0272bd98/attachment.html>