Using Data Connectors with Native Installs

The config.toml file is available in the etc/dai folder after the RPM, DEB, or TAR SH is installed. Edit following sections to enable access to HDFS, S3, Google Cloud Storage, Google BigQuery, Minio, and Snowflake.

Before enabling a connector, be sure to export the Driverless AI config.toml file or add it to ~/.bashrc. For example:

export DRIVERLESS_AI_CONFIG_FILE=“/config/config.toml”

The sections that follow shows examples describing how to use environment variables in the config.toml file to enable HDFS, S3, Google Cloud Storage, Google Big Query, KDB, Minio, and Snowflake data sources.

• HDFS Setup
  • HDFS with No Authentication
  • HDFS with Keytab-Based Authentication
  • HDFS with Keytab-Based Impersonation
• S3 Setup
  • S3 with No Authentication
  • S3 with Authentication
• Google Cloud Storage Setup
  • GCS with Authentication
• Google Big Query
  • Google BigQuery with Authentication
• KDB Setup
  • KDB with No Authentication
  • KDB with Authentication Example
• Minio Setup
  • Minio with Authentication
• Snowflake
  • Snowflake with Authentication