Secure Cluster

Current Spark handles delegation token for HDFS/HiveMetastore/HBase and periodically performs token renewal.

In details, Client of Spark will obtain the tokens and set it in distribute cache.

To run Spark in kerberos cluster, users need to do kinit or provide principla/keytab when submitting the spark job.

Following are some typical commands for Kerberos.

klist -e -k -t /etc/security/keytab/spark.keytab: list the keytab and its principal

kinit -k -t /etc/security/keytab/spark.keytab spark/[email protected]: init the kerberos ticket

kdestory: destroy the tickets klist: display current available tickets.

results matching ""

    No results matching ""