SparkΒΆ

The Spark tab allows you to enable Spark and provide paths to your Spark home directory and Hadoop configuration directory. When Spark is enabled, then the default-sparkling-internal and default-sparkling-external profiles will be available. (See the Profiles section for more information.)

  1. Navigate to the Configurations > Spark tab.
Spark tab
  1. Click Enabled to enable Spark.
  2. Spark Home: Specify the path to your Spark home directory (SPARK_HOME).
  3. Hadoop Conf Dir: Specify the path to your Hadoop configuration directory (HADOOP_CONF_DIR).
  4. Java8 Home: Specify the path to your Java 8 home directory (JAVA_HOME).
  5. Default Sparkling Water Backend: Select a Sparkling Water backend to enforce (internal or external); otherwise leave it as a choice for the user.
  6. Click Save Config when you are done.