Products

H2O

The H2O section allows you to enable Enterprise Steam to work with H2O. From this section, you can also add new H2O engines and specify launch parameters to be used when starting H2O.

Products section

Configuration

H2O Configuration allows you to enable Enterprise Steam to work with H2O. When enabled, the default-h2o profiles will be available. (See the Profiles section for more information.)

  1. Click the Configuration option under the H2O section.
  2. Enable H2O.
  3. Optionally turn on Internal Secure Connections. This enables SSL internal security.
  4. Optionally specify any additional Hadoop CLASSPATH options. These will be added to HADOOP_CLASSPATH when launching H2O clusters.
  5. Click Save Configuration when you are done.
H2O configuration

Engines

Click the Engines option in the H2O section to view a list of available H2O engines. To install a new H2O engine, download the engine that matches your desired H2O version and Hadoop distribution, then click Browse to upload the file. You can also delete engines that are no longer needed by clicking on the Remove engine icon next to the engine you want to delete.

H2O engines section

Launch Parameters

The Launch Parameters option in the H2O section allows you to specify launch parameters to be used when starting H2O. A list of parameters that can be specified is available in the H2O-3 User Guide.

  1. Click Add Parameter to add a new launch parameter.
  2. Enter the name of the paramter.
  3. Specify a value for the parameter.
  4. Specify if this paramter is the default or an override.
  5. Specify if this is a Hadoop or H2O Driver parameter.
  6. Click Create when you are done.
H2O launch parameters

Sparkling Water

The Sparkling Water section allows you to enable Enterprise Steam integration with Sparkling Water. From this section, you can also upload new Sparkling Water engines and new Python environments.

Products section

Configuration

Sparkling Water Configuration allows you to enable Sparkling Water and/or RSparkling. When enabled, the default-sparkling-internal and default-sparkling-external profiles will be available. (See the Profiles section for more information.)

  1. Click the Configuration option under Sparkling Water.
  2. Enable Sparkling Water and/or R Sparkling.
  3. Specify the path to your Spark home directory (SPARK_HOME).
  4. Specify the path to your Java 8 home directory (JAVA_HOME).
  5. Enable Internal Secure Connections.
  6. Select a Sparkling Water backend to enforce. You can change this to Internal or External backend.
  7. Click Save Configuration when you are done.
Sparkling Water configuration

Engines

Click the Engines option to view a list of available Sparkling Water engines. To install a new Sparkling Water engine, download the engine that matches your version of Spark, then click Browse to upload the ZIP file. You can also delete engines that are no longer needed by clicking on the Remove engine icon next to the engine you want to delete.

Note that the minimum supported versions of Sparkling Water in Enterprise Steam are:

  • 2.1.41

  • 2.2.27

  • 2.3.16

  • 2.4.1

    SW engines section

Python Environments

Click the Python Environments option view a list of available Python environments. Enterprise Steam ships with two default environments - Python 2.7 and Python 3.7. These environments allow Enterprise Steam to utilize PySparkling.

Python Environments page

Add New Python Environment

With Enterprise Steam, you can add a new Python environment from a Python path or from a Conda package.

Add New Conda Pack

Perform the following steps to add a new Python environment from a Conda package.

Note: The OS type where the environment was built must match the OS type of the target machine.

  1. On the Python Environments page, click Add Environment.
  2. Select Conda pack from the Environment Type dropdown menu.
  3. Enter a unique name for this new environment.
  4. Upload the Conda pack archive file.
  5. Click Add Environment when you are done.

Add New Python Path

Perform the following steps to add a new Python environment via a Python path.

  1. On the Python Environments page, click Add Environment.
  2. Select Python path from the Environment Type dropdown menu.
  3. Enter a unique name for this new environment.
  4. Specify the PySpark Python path.
  5. Click Add Environment when you are done.

Deleting Python Environments

Note: The default environments cannot be deleted.

Click the Actions > Remove option beside the Python environment that you want to delete. A confirmation message will display. Click Confirm to complete the removal.

Delete Python environment

Driverless AI

The Driverless AI section allows you to enable and configure Enterprise Steam to manage Driverless AI instances and add new Driverless AI servers.

Products section

Configuration

Note: The DAI process is started by the user who launched the instance in Steam. To avoid any problems with permissions, Unix usernames and UIDs need to be synchronized across NAS and all the machines involved. (This is standard when admins set up machines; their LDAP/AD stores the username-UID pairs.)

The storage directory on NAS has to be readable and writable to all users. The same applies to the directory that stores DAI engines. Directories for DAI instance data are created automatically and are owned and readable only by the user who launched the instance.

  1. Click the Configuration option in the Driverless AI section.
  2. Click Enabled to enable Driverless AI.
  3. Specify the path to the storage directory that is mounted and shared across all Driverless AI servers and the Steam server. When a valid path is specified, then the list of available engines will populate.
  4. Paste your Driverless AI license file in the Driverless AI License File text field.
  5. Click Save Configuration when you are done.
Driverless AI section

Servers

Click the Servers option in the Driverless AI section to view a list of Driverless AI servers.

Driverless AI servers

Adding a Driverless AI Server

  1. Click the Add Server button.
  2. Select an existing H2O Agent.
  3. Click the checkbox beside the profile or profiles that should be assigned to this server.
  4. Click Add Server to complete the configuration.

Viewing Server and Instance Details

Click on Actions > Server or Actions > Instance to view details about this Driverless AI server or the Driverless AI instance(s) associated with this server.

DAI Server actions menu

Disabling/Removing Servers

You can disable or remove servers that have no running Driverless AI instances.

  1. Click on Actions > Stop instance to stop any currently running instances. (Note that instances can also be stopped on the DAI Instances page.)
  2. Click on Actions > Disable to disable the server or Actions > Remove to delete the server from your Enterprise Steam environment.