View on GitHub

skelebot

Machine Learning Project Development Tool

Home


HDFS Kerberos

If your project needs to connect to HDFS with Kerberos authentication, Skelebot can handle this very easily.

You will need to add the configuration manually to set it up. You can follow this template when adding the configurations inside the skelebot.yaml file.

...
components:
  kerberos:
    hdfsUser: my_hadoop_username
    keytab: path/to/user.keytab
    krbConf: path/to/krb.conf
...

The username and keytab fields are fairly straightforward. If you don’t know how to generate a keytab, you can follow this guide.

The krbConf file is the configuration file for your kerberos setup that must be located in the project directory. More information can be found here.


<< Artifacts | Jupyter >>