SparkΒΆ

The Spark tab allows you to enable Spark and provide paths to your Spark home directory and Hadoop configuration directory. When Spark is enabled, then the default-sparkling-internal and default-sparkling-external profiles will be available. (See the Profiles section for more information.)

  1. Navigate to the Configurations > Spark tab.
Spark tab
  1. Enable Sparkling Water and/or R Sparkling.
  2. Specify the path to your Spark home directory (SPARK_HOME).
  3. Specify the path to your Hadoop configuration directory (HADOOP_CONF_DIR).
  4. Specify the path to your Java 8 home directory (JAVA_HOME).
  5. Select a Sparkling Water backend to enforce. This defaults to User Choice. You can change this to Internal or External backend.
  6. Click Save Config when you are done.