Livy Spark Server (Dockerized)
Livy Spark Server is a rest interface to interact with Apache Spark. It used by Hue to provide users a spark application notebook.
This modules builds the livy spark server in a container and should be used in combination with ryba/huedocker to provided end to end setup. It can also be used with any other hue installation, or even any other application.
You should start with /bin/ryba prepare -m 'ryba/spark/livy_server' command first.
module.exports =
deps:
krb5_client: module: 'masson/core/krb5_client'
'java': implicit: true, module: 'masson/commons/java'
'hadoop': 'ryba/hadoop/core'
'spark': 'ryba/spark/client'
configure:
'ryba/spark/livy_server/configure'
commands:
'prepare':
'ryba/spark/livy_server/prepare'
'install': [
'ryba/spark/livy_server/install'
'ryba/spark/livy_server/wait'
]
'start':
'ryba/spark/livy_server/start'
'stop':
'ryba/spark/livy_server/stop'
# 'status':
# 'ryba/spark/livy_server/status'