Menu

Livy Spark Server (Dockerized)

Livy Spark Server is a rest interface to interact with Apache Spark. It used by Hue to provide users a spark application notebook.

This modules builds the livy spark server in a container and should be used in combination with ryba/huedocker to provided end to end setup. It can also be used with any other hue installation, or even any other application.

You should start with /bin/ryba prepare -m 'ryba/spark/livy_server' command first.

module.exports =
  deps:
    krb5_client: module: 'masson/core/krb5_client'
    'java': implicit: true, module: 'masson/commons/java'
    'hadoop': 'ryba/hadoop/core'
    'spark': 'ryba/spark/client'
  configure:
    'ryba/spark/livy_server/configure'
  commands:
    'prepare':
      'ryba/spark/livy_server/prepare'
    'install': [
      'ryba/spark/livy_server/install'
      'ryba/spark/livy_server/wait'
    ]
    'start':
      'ryba/spark/livy_server/start'
    'stop':
      'ryba/spark/livy_server/stop'
    # 'status':
    #   'ryba/spark/livy_server/status'