Skip to content
This repository was archived by the owner on Jul 17, 2024. It is now read-only.

Conversation

didithilmy
Copy link

  • This PR adds CERN_Grid_Certification_Authority(1).crt and CERN_Grid_Certification_Authority(1).crt to a JKS file located at /etc/pki/tls/certs/truststore.jks.
  • It is necessary in preparation for the Spark Connect connector extension, as the inclusion of this certificate would allow Spark Web UI to trust the Analytix Hadoop master proxy and allow the local Web UI installation to send a redirect.
  • However, this PR only adds the certificate to a truststore file. The Spark driver still needs to be configured to use the file as a trust store using the spark.driver.extraJavaOptions option.
    • i.e. spark.driver.extraJavaOptions=-Djavax.net.ssl.trustStore=/etc/ssl/certs/truststore.jks -Djavax.net.ssl.trustStorePassword=password
  • It would be nice if we could have this option enabled globally, but setting JAVA_OPTS and SPARK_JAVA_OPTS didn't seem to work, cc @etejedor @diocas

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant